It’s easy, Raw logs (Source) –> FluentD –> Kafka/ Kinesis –> Spark Streaming –> DB/ Stream (Results). Tips: use –packages command. I used to manually add jars because of the need of “strict security” in the company’s environment and the casualty was pointless waste of my time.