AWSConfluent Kafka StreamingPysparkDelta LakeDatabricks(Medallion ArchitectureDeltaLiveTables (DLT) with serverlessCDC(SCD Type 1 and Type2)AutoloaderMaterialized ViewsUnity CatalogWorkflowsDBT basic knowledge)Autoloader - streaming experienceDevOps - CI/CDJenkinsAutomation Guidance and service-based offering for the stream processing part