As a certified Spark & Hadoop Developer (CCA175) and Confluent Certified Kafka Developer (CCDAK), I bring a decade of experience in implementing enterprise application solutions using a diverse range of technologies including Core Java, J2EE, RESTful services, Hibernate, Spring Framework, Servicemix ESB, Apache Camel, Spark, Sqoop, Hive, HDFS, Kafka, Cassandra, and various testing frameworks. My current role as a Senior Software Engineer at Luxoft involves working on the Analytics platform and support team, where I manage data pipelines from various sources to the Hadoop platform, develop Spark jobs for ETL processes, and create oozie workflows for Tableau reporting. Previously, at CIGNEX, I specialized in Big Data solutions as a Senior Software Engineer. My career also includes significant contributions at Brodos AG and Silver Touch Technologies Ltd, where I managed backend server development, created and integrated multiple services, and adhered to SCRUM Agile methodologies for project management. With a Bachelor's degree in Computer Science from Hemchandracharya North Gujarat University and multiple certifications, my technical expertise spans big data technologies, real-time big data CEP, and extensive Java/J2EE development. Proficient in English, I am equipped to tackle complex technical challenges and deliver high-quality software solutions.
Kafka, Apache Cassandra, Hibernate, J2EE, Java, JavaScript, JUnit Testing Framework, RESTful services
• Managed the end-to-end data pipeline process, ensuring seamless data flow from various sources to the Hadoop platform.
• Integrated data from multiple sources, including databases, APIs, and external systems, into the Hadoop ecosystem.
• Implemented data validation and cleansing procedures to maintain high data quality and reliability.
• Provided ongoing support for the analytics platform, troubleshooting issues, optimizing performance, and ensuring system stability.
• Scheduled Oozie workflows to run at specified intervals, ensuring that the data is regularly updated and available for reporting in Tableau.
• Monitored the execution of Oozie workflows, identifying and resolving any failures or performance issues to ensure reliable data processing.
• Automated ETL processes to ensure timely updates to the semantic layer, enabling real-time or near-real-time reporting.
• Big Data Solutions Development: I was responsible for designing, developing, and implementing big data solutions using technologies such as Apache Spark, Hadoop, and Kafka. This included creating data processing pipelines, integrating data from various sources, and ensuring the efficient handling of large datasets.
• ETL Process Management: I developed and managed ETL (Extract, Transform, Load) processes to ensure data was accurately ingested, transformed, and loaded into the appropriate storage systems. This involved working with tools like Apache Sqoop, Hive, and HDFS to maintain data integrity and quality.
• Client Collaboration and Requirements Gathering: I worked closely with clients to gather requirements, understand their business needs, and translate these into technical solutions. This involved regular communication, presenting technical solutions, and ensuring client satisfaction with the delivered products.
• Mentorship and Team Leadership: As a senior engineer, I provided mentorship and guidance to junior developers and team members. This included conducting code reviews, offering technical advice, and fostering a collaborative and productive team environment to ensure project success.
Working under Brodos offshore development centre associated with Silvertouch Technologies Ltd.This is the project which is managing complete server side backend with creation of OSGI and Rest Services for Apache Servicemix. We created several services, for example. Cassandra service, Oracle service, File Service, Scheduler Service. These all services are interconnected within one Servicemix ESB and communicate with each other to provide complete Point Of Sell solutions. For the ContentCard project, we are providing a platform to sell digital products which includes Software licence, mobile top-up recharge etc. For this purpose we integrated different API based on the client. For example, Microsoft Rest API, Nexway SOAP API. For project management, we followed SCRUM Agile methodology and we used JIRA to manage projects. For code quality management, we used Fisheye for code review and Sonar for quality assurance.
