Software Engineer (Big Data)
About us! We are dedicated to offer end-to-end IT solutions and services to customers. We integrate our vast experience with world-class technology and state-of-the-art infrastructure to offer business-friendly solutions to customers. We recognize the importance of nurturing relationships with our customers that reflect our true culture of ethics and mutual admiration. Our prime objective has always been true satisfaction of our Clients and candidates. Towards achieving this, we associate very closely with them and provide solutions to their varied needs. We place high premium on our people, quality and business values. We primarily operate on two chief practices- Staffing and Solutions which are strengthened by our core competency, an expert human capital! We are E-Verified with USCIS. Please drop us a line to know more about us. Job Reference Id: 2564 Job Descrption: Work in Platform for Advance Analytics and Collaboration (PAAC), architect the core WLM services model and led the framework design and development effort for provisioning compute resources on GAIA compute platform (private cloud). Develop and proto-type WLM profiling agents for Hadoop, Oracle, Teradata and Greenplum to capture resource consumption snapshots and persist them to Hazelcast Data Grid. Conceptualize and helped build the Impala, Spark and Hive Sandboxes for rapid data discovery while adhering to LOB specific data security and data governance policies. Develop Data Transporter API using Sqoop and Restful services to simplify the data ingestion process from LOB specific EDWs into Enterprise Data Reservoir. Develop a Rest API in Ruby to open an SFTP connection to Tapad FTP location, to download Device Adjacency JSON Files to JDPA landing zone in Amazon S3.Create PIG jobs to load compressed GZip Tapad Data Files from S3 and transform them to CSV formatted RTL files in Amazon S3. Develop Storm Topologies and its associated Spouts and Bolts to load the RTL files from S3 and export the adjacency data to HBase Environment: SparkSQL, Spark, Kafka, Scala, Impala, Hive, Sqoop, GAIA, Hazelcast, Hadoop, YARN, REST Services, Shell Scripting, CDH 5.5.2 and RHEL 6 Spark, Storm, Pig, HBase, Scala, JRuby, Genie, Github, AWS, Amazon S3, Amazon EC2, OSX, FTP, Oozie workflow, React-Native, Nodejs, AWS, kubernetes, docker images. Multiple Openings Location: Farmington Hills, MI and various unanticipated locations throughout the US as assigned which may require relocation. Interested applicants may send their resumes to Wise Gen, Inc. Attn: HR, 32985 Hamilton Court, Suite 210, Farmington Hills, MI- 48334. Resumes must specify all relevant experience and education. This position requires an individual with at least a bachelor's degree Computer Science, or Computer & information science engineering or related field. For a position at the level offered, it is not uncommon for the incumbent to also hold a master's degree and/or a number of years of experience of increasing responsibility in the same or related field. Job Title: Network Engineer Apply Job!