Real-time Credit card Fraud Detection is implemented using Spark Kafka and Cassandra. Spark ML Pipeline Stages like String Indexer, One Hot Encoder and Vector Assembler is used for Pre-processing Machine Learning model is created using the Random Forest AlgorithmData balancing is done using K-means Algorithm Integration of Spark Streaming Job with Kafka and CassandraExactly-once semantics is achieved using Spark Streaming custom offset managementAirflow Automation framework is used to automate Spark Jobs on Spark Standalone Cluster.
