Senior Data Engineer

Company: Texas Capital Bank
Location: Richardson
Posted on: May 28, 2023

Job Description:

A Sr. Data Engineer is proficient in the development of all aspects of data processing including data warehouse architecture/modeling and ETL processing. The position focuses on development and delivery of analytical solutions using various tools including AWS Glue, Lambda, Snowflake and AWS RDS. A Sr. Data Engineer must be able to work autonomously with little guidance or instruction to deliver business value.Partner with business stakeholders to gather requirements and translate them into technical specifications and process documentation for IT counterparts (onshore and offshore)Highly proficient in the architecture and development of an event driven data warehouse; streaming, batch, data modeling, and storageAdvanced database knowledge; creating/optimizing SQL queries, stored procedures, functions, partitioning data, indexing, and reading execution plansSkilled experience in writing and troubleshooting Python/PySpark scripts to generate extracts, cleanse, conform and deliver data for consumptionExpert level of understanding and implementing ETL architecture; data profiling, process flow, metric logging, and error handlingSupport continuous improvement by investigating and presenting alternatives to processes and technologies to an architectural review boardDevelop and ensure adherence to published system architectural decisions and development standardsLead and foster junior data engineers in their careers to produce higher quality solutions at a faster velocity through optimization training and code reviewMulti-task across several ongoing projects and daily duties of varying priorities as requiredInteract with global technical teams to communicate business requirements and collaboratively build data solutionsEducationBachelor's degree in computer science or MIS related area required or equivalent experience (industry experience substitutable)Job experience4-8 years of total experience in data engineering/Cloud development activity.1+ years of experience in Banking and financial domain Technical RequirementMust be extremely proficient in Data Warehouse ETL Design/Architecture, dimensional/relational data modelling.Experience in atleast one ETL development project, writing/analyzing complex stored procedures.Should have entry level/intermediate experience in Python/PySpark - working knowledge on spark/pandas dataframe, spark multi-threading, exception handling, familiarity with different boto3 libraries, data transformation and ingestion methods, ability to write UDF.Snowflake - Familiarity with stages and external tables, commands in snowflake like copy, unload data to/from S3, working knowledge of variant data type, flattening nested structure thru SQL, familiarity with marketplace integrations, role-based masking, pipes, data cloning, logs, user and role management is nice to have.Familiarity with Coalesce is an added advantage for this jobCollibra integration experience for Data Quality and Governance in ETL pipeline development is nice to have.AWS - Should have hands-on experience with S3, Glue (jobs, triggers, workflow, catalog, connectors, crawlers), CloudWatch, RDS and secrets manager.AWS - VPC, IAM, Lambda, SNS, SQS, MWAA and Athena is nice to have.Should have hands-on experience with version controlling tools like github, working knowledge on configuring, setting up CI/CD pipelines using yaml, pip files. Streaming Services - Familiarity with Confluent Kafka or spark streaming or Kinesis (or equivalent) is nice to have.Data Vault 2.0 (hubs satellite links) experience will be aHighly proficient in Publisher, PowerPoint, SharePoint, Visio, Confluence and Azure DevOpsWorking knowledge of best practices in value-driven development (requirements management, prototyping, hypothesis-driven development, usability testing)Good communicator with problem solving mindset and focus on process improvementStrong time management skills and a proven track record of meeting various deadlinesStrong executive presentation skills with expertise in PowerPoint and presentation best practices.Consistently demonstrates clear and concise written and verbal communication skillsGood interpersonal skills, ability to interact with Senior ManagementHighly self-motivated with a strong sense of initiativeExcellent multitasking skills and task management strategiesAbility to work well in a team environment, meet deadlines, demonstrate good time management, and multi-task in a fast-paced project environment.PDN-99294314-b4fe-4051-a722-8ddf79ae5aae

Keywords: Texas Capital Bank, Richardson , Senior Data Engineer, Engineering , Richardson, Texas