DEVOPS ENGINEER (KAFKA, NIFI)

DevOps Engineer
(Experienced- Kafka, Nifi)

Job brief

Our Data Engineer will have a combination of technical skills, communication skills, and a business knowledge base. The candidate would work on multiple medium to large projects having the opportunity to communicate with multi-talented and multi-cultured clients around the globe.

Requirement

• Excellent written and oral English communication skills.
• 2-5 years of hands-on experience in Kafka/Nifi domains.
• Ability to work in Lahore, or relocate to Lahore.
• Degree in Computer Science and or related expertise.

Qualifications (Mandatory)

• Experience on Apache Kafka 2. x – above and/or Confluent Kafka 4.x & above.
• Development skills in Apache NiFi. Experience in developing production NiFi workflows integrating data from third-party REST API sources.
• Familiar with JSON schemas and calling REST APIs from tools such as ‘curl’ or Java/Scala/Python libraries.
• Provide expertise and hands-on experience working on Kafka connectors such as MQ connectors, MongoDB, Elastic Search connectors, JDBC connectors, File stream connector, JMS source connectors, Tasks, Workers, converters, Transforms.
• Provide expertise and hands-on experience working on JsonConverters, and StringConverters.
• Knowledge of specific operating systems (Linux), servers, and shell scripting

Qualifications (Good to have)

• Wrote Kafka producers to stream the data from external rest APIs to Kafka topics.
• Should have hands-on experience with Zookeeper and corresponding CLI to investigate and troubleshoot Kafka environment.
• Demonstrated experience with databases (i.e., SQL, NoSQL, Hive, Cassandra, In-Memory, MongoDB, HBase)
• Experience in confluent replicator Configuration to perform replication between the clusters in a multi-region environment.
• Knowledge of partition of Kafka messages and setting up the replication factors in Kafka Cluster.
• Wrote Kafka producers to stream the data from external rest APIs to Kafka topics.
• Should have performed security compliance duties for Kafka as a product and provided solutions to the product users.
• Should have experience in Configuring and Setup Schema Registry, Kafka Connect & KSQL clusters.
• Provide expertise in Kafka brokers, zookeepers, KSQL, KStream and Kafka Control center.
• Experience in Architectural Design of Kafka Cluster and presented it to the business partners to educate them about our Kafka Strategy.
• Provide expertise and hands-on experience on custom connectors using the Kafka core concepts and API.
• Working knowledge on Kafka Rest proxy.

About the Company

thdinfinity is an elite full-cycle software development company with a world-class team of talented data scientists, developers, designers, mathematicians, engineers, and creative artists. We sign in every day to a much fun-filled environment which helps us to look and develop things our clients would enjoy. Our technology development is based on simplicity inspired by our culture of integrity and originality.

What we offer

• 8 hours a day, 5 days a week.
• Salary of PKR 100K-PKR 500K depending on the qualification and experience.
• Very cozy Lahore office with all the perfect “feel at home” amenities.
• All the market competitive benefits including delivery bonuses, annual incentive plans, health insurances for self and family, mobilization and OPD allowances, Provident Fund, and Car Entitlement Benefits, Leave Encashment etc.
• Flexi-Working Time Zones
• Self-Development Programs