Find here my MSc Journey : Description, Projects, Tasks ..

Market basket analysis using Pandas and next order prediction by XGBoost

电子科技大学 2020 级《数据挖掘与大数据分析》课程代码。

大数据时代已经迅猛而至，该系统从高校学生管理工作的实际方面出发，开发了一个面向教务以及教师人员的可视化系统，该系统通过采集学生个人信息数据，通过数据展示模块采集学生数据来构建一个完整的在校生数据库，以该数据库为依托来构建学生行为分析预测模块，通过既定算法计算并根据结果值进行后台分析，在前端分学生学科预警，成绩位置预测，综合素质雷达图和个人发展建议，通过设计和开发基于数据分析的在校学生素质发展监测系统，可以对高校在校学生学习发展情况等进行大致准确的判断，对每一位学生的学习和发展进行个性化分析和推荐，对可能存在的挂科情况和可能的不利发展前景等进行前置预警，这一举措可以大大提升高校对学生管理工作的方便程度和教育品质，真正的对每一位学生实现因材施教而不是统一模板化的流程化管理。

2023年プログラミングゼミの課題を解く

This repo contains an algorithm that identifies vendors whose customers have a higher willingness to pay. The inherent inelasticity of these vendors is utilized as part of a price differentiation strategy called "Loved Brands"

Clean data, optimize SQL queries, and write select advanced JOINs to enhance analysis performance. Use SQL DDL to create the data schemas & apply SQL DML to migrate data from a denormalized schema to a normalized

MapReduce Job Development, RDDs Programming, Medical Data Management, Sales Analysis, And Efficient Data Integration For Big Data Analysis. Spark: Big Data Processing, SQOOP Integration, And Spark Structured Streaming For Real-Time Data.

twitter real-time sentiment analysis

The goal of the project is to evaluate the efficiency of laws and policies related to opioid drugs in Florida, Texas, and Washington.

Spotify song requests analysis using Spark Structured streaming and Kafka.

smart city and smart education research based on big data analysis

Detection of credit card freuds and big data analysis of transactions. (csv files were too large to upload on github.)

Combinatorial and Semantic Analysis of Functional Elements

Automated Debugging in Data-Intensive Scalable Computing (SoCC 2017)

Final year major project on big data analysis of instacart dataset and finally Product Bundle Recommendation using pyspark(for clustering) and bigram for recommendation