Job Title:
Kafka Admin/Developer
Location:
Boston, MA
Duration:
12+ Months
Company Overview:
Pulivarthi Group is a premier global provider of staffing and IT technology solutions, renowned for delivering exceptional services tailored to each client's unique needs. With a steadfast commitment to excellence, we merge expertise with innovation, ensuring cost-effective solutions of the highest quality. Our diverse client base spans healthcare, finance, government, and beyond, reflecting our adaptability and proficiency across industries. Operating in the United States, Canada, and Mexico, we pride ourselves on aligning with clients' cultures, deploying top-tier talent, and utilizing cutting-edge technologies. Pulivarthi Group stands as a beacon of reliability, efficiency, and innovation in the realm of staffing solutions.
Job Overview/Summary:
We are seeking a Kafka Admin/Developer with strong expertise in Apache/Confluent Kafka, Spark/PySpark, and Big Data to manage and develop Kafka-based systems. The candidate will be responsible for working with Kafka brokers, zookeepers, and other related technologies. This role involves managing large-scale data streams, integrating with RDBMS systems, and collaborating on cloud technologies like AWS, Azure, and GCP.
Responsibilities:
- Manage and develop Kafka systems, including brokers, zookeepers, KSQL, KStream, and Kafka Control Center.
- Work with AvroConverters, JsonConverters, and StringConverters to process and integrate data.
- Administer and monitor Kafka clusters, ensuring high availability and scalability.
- Troubleshoot and resolve Kafka-related issues in a timely manner.
- Collaborate with teams to design and implement data streaming solutions using Kafka and other big data technologies.
- Integrate Kafka with RDBMS systems such as Oracle and in-memory applications.
- Work with cloud platforms like AWS, Azure, and GCP to optimize Kafka deployments.
- Perform Kafka performance tuning, data migration, and security audits as needed.
Primary Skills:
- Expertise in Apache/Confluent Kafka and its components such as brokers, zookeepers, KSQL, KStream, and Kafka Control Center.
- Experience with Spark/PySpark and Big Data technologies.
- Familiarity with AvroConverters, JsonConverters, and StringConverters for data integration.
- Knowledge of RDBMS systems like Oracle and in-memory applications.
- Proficient in cloud technologies like AWS, Azure, and GCP.
- Excellent organizational and problem-solving skills.
Secondary Skills (Good to Have):
- Experience with Kafka security features such as encryption, authentication, and access control.
- Knowledge of data governance, data quality, and data integration best practices.
Qualifications:
- Bachelor’s degree in Computer Science, Engineering, or a related field.
- 5+ years of experience with Kafka administration and development.
- Hands-on experience with Spark, PySpark, and Big Data tools.
- Familiarity with cloud platforms such as AWS, Azure, or GCP.
Benefits/Perks:
- Competitive salary and comprehensive benefits package.
- Opportunity to work on cutting-edge data streaming technologies.
- Collaborative, innovative, and dynamic work environment.
Application Instructions:
To apply, please submit your resume detailing your experience with Kafka, Spark, and related technologies.
