首页    期刊浏览 2024年12月13日 星期五
登录注册

文章基本信息

  • 标题:A Microservice-Based Big Data Analysis Platform for Online Educational Applications
  • 本地全文:下载
  • 作者:Kehua Miao ; Jie Li ; Wenxing Hong
  • 期刊名称:Scientific Programming
  • 印刷版ISSN:1058-9244
  • 出版年度:2020
  • 卷号:2020
  • 页码:1-13
  • DOI:10.1155/2020/6929750
  • 出版社:Hindawi Publishing Corporation
  • 摘要:

    The booming development of data science and big data technology stacks has inspired continuous iterative updates of data science research or working methods. At present, the granularity of the labor division between data science and big data is more refined. Traditional work methods, from work infrastructure environment construction to data modelling and analysis of working methods, will greatly delay work and research efficiency. In this paper, we focus on the purpose of the current friendly collaboration of the data science team to build data science and big data analysis application platform based on microservices architecture for education or nonprofessional research field. In the environment based on microservices that facilitates updating the components of each component, the platform has a personal code experiment environment that integrates JupyterHub based on Spark and HDFS for multiuser use and a visualized modelling tools which follow the modular design of data science engineering based on Greenplum in-database analysis. The entire web service system is developed based on spring boot.

国家哲学社会科学文献中心版权所有