Appu V account profile

Personal details

Appu V

Lives in India

Highlights

Google Cloud Preparing for Google Cloud Certification: Cloud Data Engr Professional Certificate

View certificate

Data Engineering, Big Data, and Machine Learning on GCP Specialization (Google Cloud)

View certificate

Highlights

Google Cloud Preparing for Google Cloud Certification: Cloud Data Engr Professional Certificate

View certificate

Data Engineering, Big Data, and Machine Learning on GCP Specialization (Google Cloud)

View certificate

Additional info

Links & Resume

Github

Other

Experience

Work history

Data Engineer at NeST Digital

(September 2021 - Present)

Development of Realtime Streaming applications using Kafka and Java in cloud (AWS). Hands on experience in Docker, Kubernetes, Spring boot, Promethueus, Thanos, Apicurio, Flink, Fluentd, Elastic.

Data Engineer at E&Y

(May 2020 - September 2021)

Developed end to end Kafka streams applications using schema registry and connectors. Implemented end to end ETL solution using AWS Glue, S3, Athena, step functions, CloudWatch and Redshift. Deployed EKS, airflow and Jenkins using terraform. Designed SFTP file watcher using airflow, shell script and python. Implemented Data Quality and Validation framework using Great Expectation and Apache Spark.

Data Engineer at Cognizant

(June 2018 - March 2020)

Design and development of big data solutions using Solr, Hbase, Spark, Hive and AWS. Lead a team to build an ETL solution of Talend Data Fabric V7 with Spark in AWS from scratch to production. Worked on product design and Implementation of a big data ETL using Marklogic, Sagemaker, Athenna and Spark.

Data Engineer at Tata Consultancy Services

(January 2015 - June 2018)

Developed production ready scala spark codes using an existing client framework. Designed and developed streaming application using MQTT and Kinesis for an IOT use case. Developed Spark jobs to extract valuable insights from a flight data. Implemented recommender system based on mahout and Hadoop. Client experience of 3 months at NSW Sydney.