HostedbyConfluent

kafka summit apache kafka confluent current 23 kafka summit london kafka streams stream processing event streaming developer intermediate architecture architect microservices apache flink kafka connect kafkasummit cloud real time data confluent cloud event-driven systems data streaming analytics scalability kubernetes kafka in the enterprise connectors ksqldb distributed systems event driven data mesh core kafka financial services beginner kafka on premises use cases aws data pipeline operator integration retail government kafka clusters real time stream processing security python data architecture sql systems operator/administrator operations kafka connectors kafka cluser schema registry machine learning data pipelines data processing open source debezium metrics aiven applications api ibm cloud native ksql event-driven architecture event driven infrastructure dbt streaming pipelines robinhood clusters iot apache pinot advanced cdc connectors event driven architecture real time analytics streaming ingestion kafka topics druid streaming protocols interactive queries scaling kafka testcontainers zookeeper monitoring azul influxdb microsoft azure apis pipelines wix.com data in motion throughput best practices mqtt twitter mirrormaker 2 aws lambda spring boot platform scalable public sector data engineering flink sql real time applications ml models eos support kafka implementation event driven microservices event driven systems gdpr mongodb serverless tables rocksdb custom partitions consistency semantics migrating kafka kafka clients data lakes events streaming data pipelines cloud data service partitioning strategies integration testing spark structured streaming modern data stack data lakehouse disaster recovery apache nifi kafka 101 governance fraud detection high availability change data capture machine learning models streams at scale shared clusters jdbc source connector geo-replication hybrid/multi-cloud performance kafka without zookeeper observability ebpf clickhouse pinterest cosmos db spring cloud shopify kafka topic disney smt big data jay kreps database event streams schemas application datahub jvm singlestore atlas streaming data data aggregation cloudera porsche faker data gitops multi cloud networking migration legacy systems adoption temporal joins server sent events infrastructure realtime kafka error handling stream data micronaut messages kafka consumers data scientists payloads websockets data governance topics graphql cloud based event based streaming event processing stacktraces sql streaming apache fink asynchronous rlhf large language models a/a replication consumer groups healthcare micro services digital assets task management e commerce monoliths storage engines verbose gc generative ai streaming capabilities new relic consistent hashing flink cdc lakehouses apache hudi medallion architecture data monoliths msa microservices architecture thrivent kafka infrastructure end to end tracing event automation kafkaproxy kip 98 data teams application metrics data warehouse stream governance stream management multihoming time state analytics oxia eda implementation cymo log based changes snapshots lyft sql queries redpanda byoc cloud services byoc self service platforms data domain modeling data use cases fft digital signal processing codes software development software complexity side effects astronomy science nasa lenses 5.3 msk integrity reliability cost optimization multi tenancy cloud based kafka cloud optimization client wrappers traffic management dns dependencies network security autoscaling streaming sql join queries streaming api connector ecosystem workflow engines query serving streaming ingest dsl real-time processing real-time user engagement time-to-value tco batch streaming social security data organization discovery ci/cd record latency fluvii replication hofstadter's law flink connector configurations lsp kafka csta stress test kafka kcctl quix streams system migration double write problems cluster resources kafka on kubernetes openmessaging k8s benchmarking load balancing drift oomkilled event stream registry flamegraphs capacity management mlops real estate kafka summmit source connectors exactly once semantics consumer rebalance protocol single broker failure kafka stransactions transactional api delivery semantics michelin ride sharing real time fraud detection freenow analytics pipeline synchronous api quarkus framework graalvm real-time applications state stores kip-889 kip's kafka applications local state cloud architectures grpc schibsted data distribution sparkplug openapi mercedes-benz client request state store cluster management cruise control exactly-once semantics communications jacob bogie luciano moreira current 22 data platform time series time series collections integrations environments data apps pubsub data messaging streaming graph docker containers snowflake sink connector snowpipe postgres micro service templates application developers operability reprocessing batch system supercomputer confluent operator central streaming system error state state machine flexibility new handler debug commit log commmit-log delete policies log retention separate sections resiliency complier emerging hardware bytewax river python libraries large scale applications verification method hashing composite message key keys balance data dev experience lakefs databricks high end tooling jsonschemas json event data platform wikmedia serving producer requests tiered storage sla customer data monitoring platform animals raspberry pi input streams bugfix outage back-filling data analysis lambda architecture streaming stack enterprise data mesh stream processing theory lsm tree shared storage slas user-defined breaking schema changes table evolutions iceberg tables avro schemas timestamps multi tenant certificate management ci360 sas customer intelligence oltp databases batch processing apache druid druid cluster distributed load multi tenant control plane kcp infrastructure management apachi hudi kafka pipeline insights data latency batched data actual spend content engineering business systems business processes field level cryptography client side cryptography user-defined function subscription feeds data tools event hubs protocol support event stream broker hyperscale paas smart clients high fan-in kraft shared databases prisma real-time data stream processing tools data application sql statement developer experience point-in-time queries versioning event-based systems data stores read models data driven culture reliable data flow rapid scale evolution of technology batch-based analytics mds resource consumption connector clusters efficient metadata upserts schema enforcement acid transactions delta lake cloud object storage runbooks repeatable standards coe workstreams cluster linking polling kafka events end-to-end traceability event streaming architectures system failures deployment complexity data throughput blockchain cloud provider messaging messaging api software engineering data landscape modern data flow geospatial use cases custom processing capabilities rebalance protocol reference application interactive query sticky partitioner batch size auto-tuning event implementing event modeling application configuration ml platforms data/ml spark citrix streaming implementation enablement support data serialization optimization multiplayer multi-user crdt department of defense intelligence computing model natural language processing modern ai tts text generation stt nlp canonical stream data domains system tests low-latency distributed caches cache invalidation digital payment engineering platforms web workflow schema evolution gaming evergreen airbnb java microframeworks e-commerce real time ingestion latency business metrics grafana compact topic configs business logic floating observers multi data center setup zapier commandline tools streampunk eventual consistency streaming machine learning radicalbit dead letter queue dead letter topics retry policy ci pipelines webhooks event driven data webhook rest api standby tasks smooth scaling managed kafka multi-cluster system stripe spectrumk electronic health data medical data siem/soar modernization data security information security cybersecurity trino scaling streaming pipeline data streams cost reduction global data mesh cryptography connect pipelines kafkasink code modular technologies database events testing kafka running at scale data cache protobuf building confluent cloud kafka v3.1 kafka v3.0 kafka v2.8 topic id geo-replicated streaming platform release process rpo rto stretch clusters metadata spring framework opentelemetry connect pipeline modern architectures video games data transit worldwide network kafka in space consumer producer azure qlik airwallex hazlecast kafka api redis customer service swim.ai couchbase sunpower salesforce netconomy red hat gloo aspecto paypal hotstar logging nodejs rockset walmart influx data reddit wells fargo gcp nordstrom prime broker clear street imply netflix meetup ksap21 kafkacat stream table single message transforms schema management tim berglund zhamak dehghani demo bakdata opalab workshop github automatic provisioning clusterss linkedin oauth kerberos asyncapi kafka connector digitalis scala java ksml graph database tigergraph apicurio registry schema modern real time sink configuration mongdb enterprise kong connect free now streaming apps streaming architecture hermes google hyprid equalum data mining innovation server access jvm heap interactive gaming cqrs fault tolerant boomi stateful applications eda sink connector codeless log ticketing single source transaction streamthoughts production azkarra physics of streaming newton investment management investment microsoft rust fetch api kafka wire protocol structure jupiter sse spring web reactive domain driven adidas goldman sachs testing c++ single topic multiple events quorum controller zillow immutable log secure applications service mesh pluralsight ao ao.com scale patterns architectures modern cyber intelligence brokers financial data raft etl keynote kafka summi kafka does what? new to kafka