Data Streaming Engineer with Kafka Messaging.
Company: Themesoft Inc.
Location: Richardson
Posted on: June 24, 2022
Job Description:
Data Streaming Engineer with Kafka Messaging.Richardson TX - Day
1 Onsite -Hybrid Mode.Client is open for Both Contract and Full
time.Please submit 10+ Years resume.Technical experience:
- Design and recommend the best approach suited for data movement
to/from different sources using Apache/Confluent Kafka.
- Good understanding of Event-based architecture, messaging
frameworks and stream processing solutions using Kafka Messaging
framework.
- Hands-on experience working on Kafka connect using schema
registry in a high-volume environment.
- Strong knowledge and exposure to Kafka brokers, zookeepers,
KSQL, KStream and Kafka Control centre.
- Good knowledge of big data ecosystem to design and develop
capabilities to deliver solutions using CI/CD pipelines.
- Skilled experience in writing and troubleshooting
Python/PySpark scripts to generate extracts, cleanse, conform and
deliver data for consumption
- Strong working knowledge of the AWS Data analytics eco-system
such as AWS Glue, S3, Athena, SQS etc.
- Good understanding of other AWS services such as CloudWatch
monitoring, scheduling and automation services
- Good experience working on Kafka connectors such as MQ
connectors, Elastic Search connectors, JDBC connectors, File stream
connectors, JMS source connectors, Tasks, Workers, converters, and
Transforms.
- Working knowledge on Kafka Rest proxy and experience on custom
connectors using the Kafka core concepts and API.
- Create topics, set up redundancy cluster, deploy monitoring
tools, and alerts, and has good knowledge of best practices.
- Develop and ensure adherence to published system architectural
decisions and development standardsGood to have:
- Ability to perform data-related benchmarking, performance
analysis and tuning.
- Understanding of Data warehouse architecture and data
modelling
- Strong skills in In-memory applications, Database Design, and
Data Integration
- Ability to guide and mentor team members on using Kafka.Raja
RamanathanWork: (972)-400-1106r.ram@themesoft.com
Keywords: Themesoft Inc., Richardson , Data Streaming Engineer with Kafka Messaging., Engineering , Richardson, Texas
Didn't find what you're looking for? Search again!
Loading more jobs...