Senior Big Data Engineer – Remote – Join arenaflex’s Cutting‑Edge Data Innovation Team, Hadoop & Spark Specialist, Python/Scala, Cloud‑Native Solutions

About arenaflex

arenaflex is a global leader in financial services technology, renowned for delivering innovative products and solutions that empower millions of customers worldwide. With a heritage of more than a century in the industry, arenaflex has continuously reinvented itself by embracing emerging technologies, data‑driven decision making, and a culture of relentless curiosity. As a forward‑thinking organization, arenaflex invests heavily in big‑data platforms, machine learning pipelines, and cloud‑native architectures to stay ahead of the competition and to provide unparalleled experiences to its partners and end‑users.

Our mission is to transform raw data into actionable insights that drive strategic growth, improve risk management, and enhance customer satisfaction. We are looking for passionate, high‑performing engineers who thrive in fast‑paced environments and who are eager to shape the future of data engineering at arenaflex.

Why This Role Matters

As a Senior Big Data Engineer at arenaflex, you will be a cornerstone of a dynamic, cross‑functional team that builds and operates large‑scale data platforms. Your work will directly influence how millions of transactions are processed, how fraud is detected, and how personalized offers are delivered in real time. This is a unique opportunity to work with cutting‑edge technologies such as Hadoop, Spark, Hive, PySpark, and cloud services (GCP/AWS), while collaborating with product managers, data scientists, and business analysts to turn complex data challenges into elegant, scalable solutions.

Key Responsibilities

• Design, develop, and maintain robust data pipelines that ingest, transform, and store petabytes of structured and unstructured data.
• Write clean, efficient, and well‑documented code in Python, Scala, or Java, adhering to best practices for readability, testability, and performance.
• Lead code reviews, enforce coding standards, and champion continuous improvement initiatives across the engineering team.
• Collaborate with data scientists to operationalize machine‑learning models, ensuring they run reliably at scale on Hadoop and Spark clusters.
• Implement and optimize complex SQL queries, Hive scripts, and PySpark DataFrames to support analytical workloads and reporting dashboards.
• Develop and maintain data‑warehouse schemas, ensuring data integrity, consistency, and compliance with regulatory requirements.
• Architect and deploy micro‑services on cloud platforms (GCP/AWS) that expose data services to downstream applications via RESTful APIs or streaming platforms like Kafka.
• Monitor, troubleshoot, and resolve performance bottlenecks in distributed systems, leveraging tools such as YARN, Spark UI, and custom metrics.
• Participate in Agile ceremonies, including sprint planning, daily stand‑ups, and retrospectives, to deliver incremental value and maintain transparency.
• Mentor junior engineers, fostering a culture of knowledge sharing, peer learning, and technical excellence.
• Stay abreast of emerging trends in big‑data technologies, cloud computing, and data engineering best practices, and proactively recommend improvements.

Essential Qualifications

• Education: Bachelor’s degree in Computer Science, Software Engineering, Information Systems, or a related discipline.
• Experience: Minimum 2 + years of hands‑on software development experience, with a proven track record of leading engineering teams or scrum squads.
• Big Data Expertise: At least 2 + years of professional experience working with Hadoop, Hive, and Spark (including PySpark or Spark‑SQL).
• Data Warehousing Knowledge: Demonstrated understanding of data‑modeling concepts, dimensional modeling, and ETL best practices.
• Programming Proficiency: Strong command of Java, Python, or Scala; ability to write production‑grade code and perform refactoring for long‑term maintainability.
• SQL Mastery: Advanced skills in writing optimized Hive and Spark SQL queries, including complex joins, window functions, and performance tuning.
• UNIX Shell Scripting: Experience automating workflows and data pipelines using Bash or similar shell environments.
• Distributed Systems Insight: Solid grasp of the architecture and operational nuances of Hadoop clusters, including HDFS, YARN, and resource management.
• Analytical Mindset: Ability to translate business requirements into technical specifications, design scalable solutions, and communicate findings clearly.

Preferred Qualifications & Skills

• Hands‑on experience with cloud platforms (Google Cloud Platform or Amazon Web Services) and building cloud‑native data solutions.
• Familiarity with streaming technologies such as Apache Kafka, including designing and maintaining real‑time data pipelines.
• Experience with version control systems (GitHub, Bitbucket) and CI/CD pipelines (Jenkins, GitLab CI, Azure DevOps).
• Knowledge of NoSQL databases (HBase, Couchbase, MongoDB) and their integration with Hadoop ecosystems.
• Exposure to containerization (Docker) and orchestration (Kubernetes) for deploying scalable data services.
• Strong problem‑solving abilities, with a track record of identifying root causes and implementing effective solutions.
• Excellent communication and interpersonal skills, enabling effective collaboration with cross‑functional stakeholders.
• Demonstrated leadership in mentoring junior engineers and fostering a culture of continuous learning.

Core Skills & Competencies

• Technical Acumen: Deep understanding of big‑data processing frameworks, data modeling, and cloud infrastructure.
• Collaboration: Ability to work closely with product owners, data scientists, and operations teams to deliver end‑to‑end solutions.
• Innovation: Proactive mindset that seeks out new technologies, evaluates their fit, and pilots innovative approaches.
• Quality Focus: Commitment to writing testable, maintainable code and employing automated testing strategies.
• Adaptability: Comfort operating in a fast‑changing environment, handling multiple priorities, and delivering under tight deadlines.
• Business Insight: Understanding of financial services regulations and the importance of data security and compliance.

Career Growth & Learning Opportunities

arenaflex invests heavily in the professional development of its employees. As a Senior Big Data Engineer, you will have access to:

• Mentorship programs with senior architects and industry thought leaders.
• Sponsored certifications in cloud platforms (e.g., Google Cloud Professional Data Engineer, AWS Certified Big Data – Specialty).
• Internal hackathons and innovation labs where you can prototype new ideas and showcase your work.
• Opportunities to lead high‑visibility projects that directly impact the company’s strategic roadmap.
• Cross‑functional rotations that broaden your expertise in data science, product management, and security.

Compensation, Perks & Benefits

arenaflex offers a competitive compensation package that reflects your experience and expertise. While exact figures are tailored to each candidate, you can expect:

• Hourly rates ranging from $20 – $30 per hour, with performance‑based bonuses.
• Comprehensive health, dental, and vision insurance plans.
• Retirement savings options with company matching contributions.
• Generous paid time off, parental leave, and flexible work‑from‑home arrangements.
• Professional development stipend for conferences, courses, and certifications.
• Access to cutting‑edge tools, cloud credits, and a collaborative tech stack.
• Employee assistance programs, wellness initiatives, and community‑building events.

Work Environment & Culture at arenaflex

Our culture is built on the pillars of curiosity, collaboration, and continuous improvement. At arenaflex you will find:

• A diverse, inclusive workforce where every voice is valued.
• Flat organizational structures that empower engineers to make decisions and own outcomes.
• Regular “Tech Talk” sessions, brown‑bag lunches, and knowledge‑sharing forums.
• Agile methodologies that promote transparency, rapid feedback, and iterative delivery.
• Commitment to ethical data handling, security best practices, and regulatory compliance.
• A supportive leadership team that champions work‑life balance and employee well‑being.

Application Process

If you are ready to tackle complex data challenges, drive innovation, and grow your career with a world‑class organization, we want to hear from you. To apply, click the link below and submit your resume, cover letter, and any relevant portfolio or project samples.

Apply Now – Join arenaflex’s Big Data Engineering Team

Join arenaflex Today

At arenaflex, you will be part of a visionary team that turns massive data sets into strategic assets. Your expertise will help shape the future of financial technology, while you enjoy a rewarding career path, competitive compensation, and a vibrant, supportive community. Don’t miss the chance to make an impact—apply today and start your journey with arenaflex!