About the Role
The Data Engineer role is responsible for building, optimizing, and maintaining data pipelines, integrations, and database systems that support enterprise analytics and reporting. This position develops and implements data processing logic, designs and manages data models, and uses SQL, Python and other programming tools to ensure reliable movement and transformation of data across platforms. It supports the day-to-day activities of the team responsible for the design, implementation, maintenance, and performance of enterprise Data Lake, Data Warehouse, and reporting environments. The role also evaluates, implements, and documents emerging data technologies across both structured and unstructured systems, while configuring and troubleshooting data-related applications. Additionally, the Data Engineer collaborates closely with engineering and business teams to ensure best practices are followed and provides development and operational support to other IT resources.
Responsibilities
- Provide overall development, programming, coding and troubleshooting effort for all Data warehouse and Reporting technologies.
- Collaborate with Data Architecture and Core Development teams to assure adherence to best practices and process standardization.
- Participate in design, development and implementation of Data Analytics and Data Warehouse projects, Data Governance, Data Quality systems for standardization of member data.
- Participate in data related activities for the digital platform conversion project.
- Perform implementation, maintenance, and documentation of existing and emerging database technologies on premises as well as cloud infrastructure.
- Provide advanced support for SQL database, NoSQL database and cloud database enabled applications.
- Configure and maintain the organization’s Operation Data Store (ODS), ensuring near real-time data availability for transactional reporting needs.
- Maintain, configure and automate changes required for the organization’s core Data Warehouse system (Relational Database) to perform effectively on the daily load and the nightly data extract transform and load (ETL) process.
- Develop datasets for analytics in Data Analytics platform and create advanced reporting within Business Intelligence tools.
- Develop and maintain data fields utilized by the Fraud department to actively monitor fraud alerts on live systems.
- Assist in deploying various business applications from lower environments to production using automated build tools and scripting.
- Provide advanced support for database systems, including High Availability using Always on Availability Groups (AG’s) and Basic Availability Groups (BAG’s), Disaster Recovery, performance tuning, troubleshooting long running queries, index maintenance, and analyzing query plans.
- Act as SME for various business applications used by departments such as accounting, finance, consumer lending, collections, fraud, card services, support services and ensure IT systems are kept up to date according to the organization’s policies.
- Follow agile software development methodologies - Scrum process for software development and Kanban for bugs and tickets.
- Participate in help desk functions periodically to ensure quality service is provided according to company standards in a timely and effective manner.
- Create or update and make improvements to related procedure/manuals identifying Standard Operation Procedures (SOP) for assigned tasks.
- Provide technical support to credit union staff to ensure effective utilization of SQL databases, including capacity and performance planning.
- Establish and maintain regular written and in-person communications with the organization’s end users regarding pertinent IT activities.
- Exhibit excellent customer service skills towards internal and external customers.
- Strive to achieve the organization strategic initiatives that include 360-member view for the organization and support development work needed for the implementation of Single Source of Truth (SSOT), golden records in the ODS system.
- Provide development work required for projects related to the organization’s database technologies and other projects that may directly impact the member and development environments.
- Support Enterprise Data Warehouse systems, Big Data Analytics platforms and Business Intelligence.
- Help with the organization’s development operations function to ensure productivity, quality and customer service demands are met according to the organization’s standards.
- Ensure member service and satisfaction are a priority in database related projects and implementations.
- Provide technical support to Business Users, troubleshoot and resolve database related issues.
- Perform various tasks, projects and administrative duties as assigned.
Requirements
- Requires an undergraduate degree in computer science, information systems, or related discipline.
- Minimum of five years of experience in database engineering and analytics.
- Hand-on experience with modern analytics platforms such as Snowflake or Azure Synapse Analytics is a must.
- Experience with ETL development using SSIS and hybrid data integration using Azure Data Factory (ADF) or Apache Airflow or Informatica IICS.
- Knowledge and experience configuring and maintaining an Operational Data Store (ODS) using unstructured databases such as MongoDB Atlas in Azure or Cosmos DB.
- Required hands-on experience with Data Quality for data standardization, and for data integration, and data governance best practices.
- Skilled in data transformation using Business Intelligence Development Studio (BIDS).
- Experience in developing and administering reports using Power BI or Tableau.
- Expertise in scripting and automation using PowerShell.
- Familiarity with source control and code promotion tools such as Visual Studio, Bitbucket, and Azure DevOps Server is a plus.
- Experience with enterprise applications such as Power Automate, Active Directory, SharePoint Online, Jira, and Confluence is a plus.
- Experience with data encryption technologies including TDE, data masking, obfuscation, Always Encrypted, and column-level encryption is a plus.
- Knowledge of programming languages such as .NET, HTML, XML, JavaScript, and Python is preferred.
- Experience configuring and maintaining web applications using Microsoft IIS and Java is preferred.
- Certifications around Snowflake, Microsoft SQL Server, Microsoft Azure Fundamentals is a plus.
- Banking industry experience is a plus.
- Ability to tolerate periods of continuous sitting.
- Ability to operate and utilize a personal computer and peripherals.
Skills
- SQL
- Python
- Snowflake
- Azure Synapse Analytics
- SnowSQL
- Microsoft SQL Server
- T-SQL
- SSRS
- SSIS
- MySQL on Amazon RDS
- Azure SQL Database/Managed Instance
- Azure Data Factory (ADF)
- Apache Airflow
- Informatica IICS
- MongoDB Atlas
- Cosmos DB
- Business Intelligence Development Studio (BIDS)
- Power BI
- Tableau
- PowerShell
- Visual Studio
- Bitbucket
- Azure DevOps Server
- Power Automate
- Active Directory
- SharePoint Online
- Jira
- Confluence
- TDE
- Data Masking
- Obfuscation
- .NET
- HTML
- XML
- JavaScript
- Microsoft IIS
- Java
Experience Level
- Minimum of five years of experience
Education Level
- Undergraduate degree in computer science, information systems, or related discipline
Salary/Compensations
- $122,573.13 - $141,587.11
About the Company
- The Eight Superpowers: Provides leadership through modeling of behaviors and bringing forward new ideas and new ways of doing things.
- Demonstrates empathy, self-reflection, and adjustment of own behaviors, showing effective emotional intelligence.
- Practices active listening in communications with others, giving someone full attention and listening to understand, not just respond.
- Demonstrates grit, persisting in application of knowledge, skills, and behaviors to achieve goals and address obstacles.
- Models intrinsic motivation; is self-driven to meet or exceed objectives, timelines, and quality measures while building and sustaining effective relationships.
- Applies creative problem-solving to provide clarity, handle resources under one’s control, and address stressful situations; finds ways to meet individual, team, and member goals, by navigating through barriers.
- Shares a diverse set of perspectives, work and life experiences, as well as religious and cultural differences. Actively seeks out differences in values, ideas, and priorities. Respects and value the differences of others, including but not limited to: national origin, language, race, color, disability, ethnicity, gender, age, religion, sexual orientation, gender identity, socioeconomic status, veteran status, and family structures. Believes a diverse workplace is essential to the company’s success.
- Values and shows appreciating for the unique qualities and experiences of each person-inclusion; appreciates and effectively utilizes the talents and skills of others to achieve objectives; is open to the perspective of others; and encourages collaboration, flexibility and fairness. Makes each employee feel valued and supported for their unique qualities.
- Work requires concentrated mental attention and focus.
- Work is primarily within a cubicle office subject to conversational noise and interruptions found in that environment.
