United States

Data engineering

Postgraduate Degree

Vinoth Nageshwaran

Data Engineer

Analytical skills

Pandas

Python

Airflow

ChatGPT

GitHub

BigML

Understanding factors that lead to a motivated team - recognition, communication and more.

Keeping team members motivated

Decision making as a software engineer or lead - how to become better at making the right choices

Making better tech choices

Tips for transitioning into a new role or company.

Changing roles

Practice HR, technical and behavioural interviews with mentors.

Practice mock interviews

Talk to people who've broken into the tech industry and learn their stories.

Breaking into tech

Learn the best ways to answer technical interview questions with frameworks

Acing technical interview questions

Manage team expectations and get the most out of your meetings.

Running effective meetings

Learn how to properly present your work and share ideas and opinions.

Presenting your work with impact

Streaming real-time data using Apache Kafka, Kafka Connect AWS service Kinesis.
Building near real-time data pipeline using Snowflake Pipe Task/Streams.
Developing Data Ingestion pipeline using Snowflake Pipe and copy commands.
Consuming 3rd party API into Snowflake data cloud.
Automation pipeline using Python3.
Data-orchestration and Application Monitoring using Apache Airflow.
Creating Table driven ETL tool using Airflow.
Building Dynamic Mapping using Airflow.
Create/ Build Cloud Infrastructure using Terraform for AWS services.
CI/CD Pipeline using Github and Github actions.
Building S3 data lake-driven architecture and creating a dimensional Model from Transactional data.
Performing Tuning Snowflake Queries by Optimizing the queries data caches.
Data Migration from Vertica to Snowflake using AWS DMS service and Snowflake Copy Command.
Building end-to-end cloud infrastructure in AWS using various AWS services like EC2/RDS/VPC/s3/Route53, ElastiCache, Kinesis, SNS,  Lambda, cloud Monitor, and cloud watch.
Building Cloud consumption report using Tableau.

•	Done certification in “PowerCenter Data Integration 9.X: Developer Specialist” 
•	Strong experience in ETL using Informatica Power Center (Mapping Designer, Workflow Manager, Workflow Monitor, Source Analyzer, Transformation developer, Mapplet Designer,  and Repository manager).Good exposure on optimizing the SQL and performance tuning using Explain Plan.Thorough understanding of Software Development Life Cycle (SDLC) including requirements analysis, system analysis, design, development, documentation, training, implementation and post-implementation review.
•	Creating Detail technical design document and USER Manual for new Joiners. 
•	Strong in SQL, T-SQL, PL/SQL, SQL*LOADER, SQL*PLUS, MS-SQL & PRO*C
•	Extensive knowledge on the PowerCenter components as PowerCenter Designer, PowerCenter Repository Manager, Workflow Manager and Workflow Monitor.
•	Thorough knowledge in creating ETL’s to perform the data load from different data sources and good understanding in installation of Informatica.
•	Experienced in developing the mappings and transformations using PowerCenter Designer and executing the mappings through Work Flow Manager from multiple sources to multiple targets.
•	Knowledge in Full Life Cycle development of Data Warehousing with experience in ensuring quality and compliance to coding standards.
•	Good experience with Data Cleansing, Data Analysis, Data Profiling and necessary Test plans to ensure successful execution of the data loading processes
•	IBM data quality tools of DataStage were used to help with the cleansing for migration.
•	Hands on Experience using Push Down Optimization (PDO).
•	Good experience with Data Cleansing, Data Analysis, Data Profiling and necessary Test plans to ensure successful execution of the data loading processes.
•	Strong at developing complex mappings with Custom Transformations, XML Sources.
•	Experience in developing Stored Procedures, Functions, Views and Triggers, SQL queries using SQL Server and Oracle P

•	Analyzing the source data coming from different sources and working with business users and developers to develop the Model.
•	Involved in Dimensional modeling to Design and develop STAR Schema, Using ER-win to design Fact and Dimension Tables.
•	Extracted, Transformed and Loaded OLTP data into the Staging area and Data Warehouse using Informatica mappings and complex transformations (Aggregator, Joiner, Lookup (Connected & Unconnected), Source Qualifier, Filter, Update Strategy, Stored Procedure, Router, and Expression).
•	Developed number of complex InformaticaMappings, Mapplets and Reusable Transformations for different types of tests in Customer information, Monthly and Yearly Loading of Data.
•	Using Workflow Manager for Workflow and Session Management, database connection management and Scheduling of jobs to be run in the batch process.
•	Fixing invalid Mappings, testing of Stored Procedures and Functions, Unit and Integration Testing of Informatica Sessions, Batches and Target Data.
•	Extracted data from various sources like IMS Data Flat Files and Oracle.
•	Extensively Used Environment SQL commands in workflows prior to extracting the data in the ETL tool.
•	Wrote complex SQL scripts to avoid Informatica joiners and Look-ups to improve the performance, as the volume of the data was heavy.
•	Created Sessions, reusable Worklets and Batches in Workflow Manager and Scheduled the batches and sessions at specified frequency.
•	Used SQL * Loader for Bulk loading.
•	Created Stored Procedures for data transformation purpose.
•	Monitored the sessions using Workflow Monitor.
•	Used stored procedures to create a standard Time dimension, drop and create indexes before and after loading data into the targets.
•	Worked with TeradataBTEQ utilities for ETL development and design.
•	Creation of customized MLOAD scripts on UNIX platform for Teradata loads
•	Removed bottlenecks at source level, transformation level, and target level for the optimum usage of so

Vinoth Nageshwaran🇺🇸

Create an account to accelerate your career with expert mentors worldwide.