Experienced Full Stack Data Engineer – Web & Cloud Application Development at arenaflex

At arenaflex, we're on a mission to revolutionize the way we collect, process, and analyze data. As a key member of our Dataworks team, you'll play a vital role in designing and driving the development of our data pipelines, working closely with IT, business, developers, and data scientists to deliver high-value insights and solutions.

About arenaflex

arenaflex is a leading provider of innovative logistics and transportation solutions. With a strong commitment to technology and innovation, we're constantly pushing the boundaries of what's possible in the industry. Our Dataworks team is at the forefront of this effort, using cutting-edge data engineering techniques to drive business growth and improvement.

Job Summary

We're seeking an experienced Full Stack Data Engineer to join our Dataworks team. As a key member of this team, you'll be responsible for designing, developing, and maintaining our data pipelines, working closely with cross-functional teams to deliver high-value insights and solutions. This is an exciting opportunity to work with a talented team of data engineers, developers, and data scientists to drive business growth and improvement.

Key Responsibilities

* Design and develop data pipelines to collect, process, and analyze large-scale data sets

• Collaborate with cross-functional teams to deliver high-value insights and solutions
• Work closely with IT, business, developers, and data scientists to ensure data quality and integrity
• Develop and maintain data processing and analytics tools and technologies
• Troubleshoot and resolve complex data-related issues
• Provide technical guidance and support to junior team members
• Stay up-to-date with industry trends and emerging technologies

Unexpected Expected Set of Responsibilities

As a Full Stack Data Engineer at arenaflex, you'll be responsible for a wide range of tasks, including:

• Designing and developing data pipelines to collect, process, and analyze large-scale data sets
• Collaborating with cross-functional teams to deliver high-value insights and solutions
• Working closely with IT, business, developers, and data scientists to ensure data quality and integrity
• Developing and maintaining data processing and analytics tools and technologies
• Troubleshooting and resolving complex data-related issues
• Providing technical guidance and support to junior team members
• Staying up-to-date with industry trends and emerging technologies

Fundamental Work Obligations and Obligations

* Understanding both the business and technical issues Dataworks aims to address

• Building tools, stages, and pipelines to empower teams to clearly and neatly investigate data, build models, and drive decisions
• Scaling from "PC scale" to "team scale" issues, in terms of both infrastructure and problem design and method
• Collaborating across teams to drive the creation of data-driven functional insights that mean high-value improved solutions
• Delivering clear and actionable value quickly, working closely with different teams of changing backgrounds and disciplines
• Classifying best practices for future reuse as available, reusable examples, layouts, and code bases
• Connecting with senior technologists from the broader project and beyond arenaflex (partner environments and clients) to make collaborative energies and ensure smooth solutions to downstream functional frameworks

Expertise/Information Thought about an Or more

* Technical foundation in software engineering, programming, database frameworks, distributed frameworks

• Familiarity with distributed and cloud environments and a deep understanding of enhancing computational considerations with theoretical properties
• Experience in building robust cloud-based data engineering and curation solutions to make data items useful for various applications
• Detailed knowledge of the Microsoft Azure tooling for large-scale data engineering endeavors and solutions is highly preferred. Experience with any combination of the following Azure tools: Azure Databricks, Azure Data Factory, Azure SQL Data Warehouse, Azure Machine Learning
• Creating and operationalizing functions and solutions including under close to real-time high-volume streaming circumstances
• Active development skills with the ability to work at the code level and help troubleshoot hard-to-resolve issues
• A compelling history of planning and delivering large-scale technical solutions, which convey clear, ongoing value
• Direct experience having built and delivered strong, complex production systems that execute current, data handling strategies at scale
• Ability to set switch, to offer support to distributed teams which might require a "specialist programmer" to unblock a particularly difficult technical obstruction, and to figure out through issues as they are still being defined
• Exhibited ability to deliver technical projects with a team, frequently working under close time constraints to deliver value
• An 'engineering' attitude, able to make fast, practical decisions to improve performance, accelerate progress or amplify influence
• Comfort with working with distributed teams on code-based expectations, using version control frameworks and code reviews
• Ability to lead data analysis, research, and heredity studies to record and upgrade data quality and access
• Utilization of agile and devops practices for project and software management including continuous integration and continuous delivery

Shown mastery working with some of the following common languages and tools:

* Flink (Scala and PySpark), Kafka and other high-volume data tools

• SQL and NoSQL storage tools, like MySQL, Postgres, MongoDB/CosmosDB
• Java, Python data tools
• Azure DevOps experience to track work, develop using git-integrated version control examples, and build and use CI/CD pipelines
• Working knowledge and experience executing data engineering patterns to help shifting business needs
• Experience with various data types (json, xml, parquet, avro, unstructured) for both batch and streaming ingestions
• Utilization of Azure Kubernetes Services, Eventhubs, or other related advancements to execute streaming ingestions
• Experience creating and implementing warning and monitoring systems
• Working knowledge of Infrastructure as Code (IaC) through Terraform to create and deploy assets
• Execution experience across various data stores, messaging frameworks, and data processing engines
• Data joining through APIs as well as REST services
• PowerPlatform (PowerBI, PowerApp, PowerAutomate) development experience an or more

Least Capabilities:

Information Architect I:

* Four-year college education in Data Frameworks, Software engineering or a quantitative discipline like Math or Designing or potentially One (1) year comparable conventional preparation or work insight

• Essential knowledge in data engineering and AI structures including plan, development and execution of highly complex frameworks and data pipelines
• Essential knowledge in Data Frameworks including plan, development and execution of large-scale or online transaction-based frameworks
• Experience as a junior member of multi-functional project teams
• Solid oral and written communication skills
• A connected postgraduate education might counterbalance the connected experience requirements

Sponsorship isn't available for Information Designer I job.

Information Specialist II:

* Four-year certification in Software engineering, Data Frameworks, a connected quantitative field, for example, Designing or Math or identical proper preparation or work insight

• Two (2) years comparable work insight in estimation and examination, quantitative business critical thinking, reproduction improvement and additionally prescient examination
• Solid knowledge in data engineering and AI structures including plan, development and execution of highly complex frameworks and data pipelines
• Solid knowledge in Data Frameworks including plan, development and execution of large-scale or online transaction-based frameworks
• Solid comprehension of the transportation business, contenders, and developing advancements
• Experience as a member of multi-functional project teams
• Solid oral and written communication skills
• A connected postgraduate education might balance the connected experience requirements

Sponsorship isn't available for Information Architect II job.

Information Designer III:

* Four-year college education in Data Frameworks, Software engineering or a quantitative discipline like Math or Designing as well as comparable conventional preparation or work insight

• Three to Four (3 - 4) years identical work insight in estimation and examination, quantitative business critical thinking, recreation improvement or potentially prescient examination
• Broad knowledge in data engineering and AI structures including plan, development and execution of highly complex frameworks and data pipelines
• Broad knowledge in Data Frameworks including plan, development and execution of large-scale or online transaction-based frameworks
• Solid comprehension of the transportation business, contenders, and advancing advancements
• Experience giving authority in a general preparation or counseling setting
• Experience as a senior member of multi-functional project teams
• Solid oral and written communication skills
• A connected postgraduate education might counterbalance the connected experience requirements

Information Designer Lead:

* Four-year college education in Data Frameworks, Software engineering, or a quantitative discipline like Science or Designing as well as identical conventional preparation or work insight

• Five to Seven (5 - 7) years identical work insight in estimation and examination, quantitative business critical thinking, recreation improvement or potentially prescient examination
• Broad knowledge in data engineering and AI structures including plan, development and execution of highly complex frameworks and data pipelines
• Broad knowledge in Data Frameworks including plan, development and execution of large-scale or online transaction-based frameworks
• Solid comprehension of the transportation business, contenders, and developing advancements
• Experience giving initiative in a general preparation or counseling setting
• Experience as a leader or a senior member of multi-functional project teams
• Solid oral and written communication skills
• A connected postgraduate education might balance the connected experience requirements

Residence/Movement Data:

* This position can be domiciled anywhere in the US.

Application Standards:

* Transfer current copy of Resume (Microsoft Word or PDF format only) and answer work screening survey.

Extra Data

Colorado, Nevada, Connecticut, New York, California, Rhode Island, Washington, Hawaii, Illinois and New Jersey Residents Only - Compensation: Monthly Pay: $6,317.00 - $15,477.00. This pay range is provided as a reasonable estimate of the current starting compensation range for this job. Factors that may be used to determine your actual compensation may include your qualifications, experience, and performance.

Top 10 Interview Questions

* Can you tell us about yourself?

• What interests you about this position?
• What are your strengths?
• What are your weaknesses?
• Can you give an example of a time when you solved a problem creatively?
• How do you handle stress and pressure?
• How would you describe your work style?
• Can you tell us about a time when you had to work with a difficult colleague or supervisor?
• How do you stay organized and prioritize tasks?
• What are your long-term career goals?

Document Required:

* Required Documents for This Recruitment: The candidate should have this Document Before Apply Online. Candidates Are Suggested To Read the Official Notification Before Applying.

• Document – Qualifications certificate with mark sheets.
• Passport size Photographs
• Signature

How to apply:

* All the eligible candidates can apply for This Job as mentioned below

• Read the official notification carefully From the Official Website.
• Read the Notification Carefully Before Applying.
• Fill out The Application Form (The link Is Given Below)
• Attach the Required Document and Passport Size Photo with Signature.
• Then Submit. Done.

Apply Job! Apply for this job