[Remote] Senior Data Engineer
Note: The job is a remote job and is open to candidates in USA. Paul Hastings is a leading international law firm that provides innovative legal solutions to many of the world's top financial institutions and Fortune Global 500 companies. They are seeking a Senior Data Engineer to design, build, and maintain modern data pipelines and integration solutions in the Azure Cloud, enabling enterprise analytics for their clients. The role involves collaboration with architects, analysts, and business stakeholders to deliver scalable and efficient data solutions.
Responsibilities
- Design, build and manage scalable data pipelines using Azure Data Factory (ADF), Azure Data Lake Storage (ADLS) and Azure Databricks
- Develop ELT frameworks for ingesting and transforming structured and semi-structured data from on-prem and cloud sources
- Implement robust DevOps pipelines for code versioning, testing, deployment and monitoring using Azure DevOps
- Ensure pipeline performance, reliability and observability using tools like Azure Monitor and Log Analytics
- Collaborate with BI teams to support Power BI datasets and ensure optimal data model performance
- Automate environment setup, configuration and permissions using infrastructure-as-code where possible
- Write modular, testable code in Python or PySpark and manage version control with Git
- Support production operations, root cause analysis and performance tuning
- Maintain technical documentation for pipelines, data mappings and deployment processes
- Work as part of an Agile delivery team, participating in sprints, retrospectives and code review; and
- Mentor junior data engineers and promote best practices in CI/CD, version control, and release management
Skills
- Bachelor's degree in Computer Science, Engineering or related field
- 7+ years of data engineering or BI development experience
- 3+ years building data solutions in Microsoft Azure Cloud
- 2+ years using Azure DevOps for automated builds, releases and pipeline orchestration
- Proven experience working with structured and semi-structured data (Parquet, JSON, Avro)
- Advanced proficiency in Azure Data Factory, Azure Data Lake Storage (Gen2) and Azure Databricks
- Experience building and managing CI/CD pipelines in Azure DevOps for data solutions
- Strong SQL and ELT experience; familiarity with schema design (e.g., star, snowflake, denormalized)
- Hands-on expertise with PySpark and Databricks notebooks, including Delta Lake workflows
- Familiarity with Git, branching strategies and repository management within Azure Repos
- Understanding of data security and privacy best practices in Azure (RBAC, managed identities, encryption)
- Experience with Power BI dataflows, datasets and refresh configuration
- Experience in professional services, legal, or financial environments
- Familiarity with data cataloging and governance tools (e.g., Microsoft Purview)
- Experience with Agile tools such as Azure Boards or JIRA
Benefits
- Medical, Dental, Vision, Life/AD&D, Long Term Care, and Short- and Long-Term Disability
- Flexible Spending Accounts and Health Savings Account
- Healthcare Concierge and Advocacy
- Lifestyle Spending Account
- Voluntary 401(k) Plan and Profit Sharing
- 10 Paid Holidays per year and a generous PTO Program
- Family Support including Paid Parental Leave, Fertility Benefits, Breast Milk Shipping, Back-up Child Care, Elder Care, and Tutoring
- Wellbeing programs (Employee Assistance Program, Relationship Support, Mental Health, Menopause and Midlife Health and Well-Being Events)
- Retirement Plan Consulting
- Anniversary Bonus Program
- Professional Development Programs
- Transportation and Commuter Benefits
- International Travel Insurance
- Critical Illness, Hospital Indemnity and Accident Insurance
- Auto/Home/Pet Insurance
- Prepaid Legal Insurance
- Employee Discounts
- And More!
Company Overview
Company H1B Sponsorship