sparkml

TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows on Apache Spark with minimal hand-tuning

spark 机器学习:利用jupyter工作来讲解算法原理并运行相关例子

Because its never late to start taking notes and 'public' it...

This code is used to build & run a Docker container for performing predictions against a Spark ML Pipeline.

JPMML-SparkML plugin for converting LightGBM-Spark models to PMML

基于Spark+SparkMLlib+Debezium+Deequ打造的简单易用、超高性能大数据治理引擎。适用于批流一体的数据集成和数据分析，支持CDC实时数据采集、机器学习算法模型、数据质量校验、数据标注、敏感数据识别、数据建模、算法建模和OLAP数据分析

Machine learning utilities for model conversion, serialization, loading etc

Recommendation engine in Java. Based on an ALS algorithm (Apache Spark). Train a new model after N seconds.

Simulation of job offers and CVs with real-time processing, classification, and analytics using Kafka, Ray, Spark, and Databricks. Includes a Flask-based recommendation system and Tableau visualizations.

Free High-Quality Financial Data in Azure

A collection of “cookbook-style” scripts for simplifying data engineering and machine learning in Apache Spark.

Helper functions for building complex Spark ML pipelines

bigdata examples about spark and flink

BigData Engineering Capstone Project with Tech-stack : Linux, MySQL, sqoop, HDFS, Hive, Impala, SparkSQL, SparkML, git

Twitter Sentiment Analysis using Spark, MongoDB, and Google Cloud

Transformation of Akamai Logs with Spark ETL and discover of Values and similarities in logs used SparkML and H2O ML

A machine learning at scale demo on flight delay prediction. The project includes an exploration of a series of data transformation and ML pipelines in Apache Spark (via Databricks).

Online latent state estimation with Spark

Data analysis using apache spark

Repo for using scala in a kaggle house price prediction.