Senior Data Engineer 

Overview:

We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. As a Senior Data Engineer, you will play a pivotal role in architecting, designing, and implementing data solutions to meet the evolving needs of our organization. You will be responsible for leveraging your expertise in data profiling, analysis, and engineering to drive insights and enable informed decision-making across various business domains.


Key Responsibilities:

  • Data Profile and Analysis: Utilize advanced techniques to profile, analyze, and understand complex datasets. Apply statistical methods and data visualization tools to extract meaningful insights and trends.
  • SSIS (SQL Server Integration Services): Design, develop, and maintain robust ETL processes using SSIS to ensure efficient data extraction, transformation, and loading operations.
  • Communication Skills: Effectively communicate with stakeholders, including business users, data scientists, and other technical teams, to gather requirements, discuss solutions, and present findings in a clear and concise manner.
  • PowerBI: Develop interactive and visually appealing dashboards and reports using PowerBI to visualize key metrics and KPIs, enabling stakeholders to make data-driven decisions.
  • Pandas Profiling: Leverage Pandas Profiling to automate the exploratory data analysis process and generate comprehensive reports on data quality, distributions, and correlations.
  • Jupyter Notebooks with Pandas/NumPy Pandas Profiling: Collaborate with data scientists and analysts using Jupyter Notebooks to perform data manipulation, analysis, and visualization tasks using Pandas and NumPy libraries.
  • SQL Server Profiler: Monitor and optimize SQL Server database performance using SQL Server Profiler to identify and troubleshoot bottlenecks, slow queries, and other performance issues.


Qualifications:

  • Bachelor's or Master’s degree in Computer Science, Engineering, or a related field.
  • Proven experience in data engineering, with a focus on data profiling, ETL development, and data analysis.
  • Proficiency in SSIS for designing and implementing ETL processes.
  • Strong communication skills with the ability to articulate technical concepts to non-technical stakeholders.
  • Expertise in PowerBI for building interactive dashboards and reports.
  • Familiarity with Pandas Profiling for automating data analysis tasks.
  • Experience working with Jupyter Notebooks and libraries such as Pandas and NumPy.
  • Knowledge of SQL Server Profiler for database performance monitoring and optimization.


Additional Skills (Preferred):

  • Experience with other data visualization tools such as Tableau or QlikView.
  • Knowledge of cloud platforms such as AWS or Azure for deploying data solutions.
  • Familiarity with Agile methodologies and DevOps practices.
  • Certification in relevant technologies (e.g., Microsoft Certified: Data Engineer Associate).