Hadoop Consultants

# of Openings
Job Category


About Us

OpenSky is a rapidly growing Professional Services organization that operates on the premise that highly skilled, smart, experienced, and energetic people are the catalyst of any successful enterprise. Our focus lies in delivering information technology (IT) services centered on infrastructure, security, and compliance requirements within our client’s environment. OpenSky’s proven consulting engagement methodology ensures timely delivery of critical technology initiatives. We offer uniquely objective solutions to our clients by providing a vendor-neutral response to complex hardware and software decisions. Our resultant response and delivery relies on qualified consultants that adhere to a project-based approach on every engagement.


At OpenSky, we have a passion for partnering with our customers on their most complex information technology projects. We encourage a spirit of collaboration and open communication with our customers, partners, consultants, and internal teams. Our values include customer-focused excellence, teamwork, open communication, and a sense of urgency in everything we do.


About the Opportunity


One of our clients in Connecticut would like to add a consultant to its team of engineers who are updating the client's big data platform.  The platform will rely on Hadoop technologies with a focus on high availability and security of data.  The role is planned for six months but has potential for extension, and will be based in the Hartford area.  It is expected that over half of the time the consultant will be working on-site with the client's team in the client's main office location.  Here are more details about the responsibilities for this role:

  • Architect, design, automate and develop a new big data infrastructure platform, primarily based on Hadoop technologies, ensuring that the infrastructure is highly-available and secure.
  • Work closely with Management and client Data Scientist teams to define and refine the existing big data platform to achieve client product and business objectives.
  • Collaborate with other internal client technology teams and architects to define and develop cross-function technology stack interactions.
  • Research and experiment with emerging technologies and tools related to big data (Hadoop 3.0, AWS).
  • Work with the the client's management team to establish and reinforce disciplined software development processes and best-practices.
  • Maintain and support the platform on a day-to-day basis.

About You

The consultant for this role will have the following background:

  • Strong understanding of Linux systems, Kerberos, AD integration and networking.
  • Experience supporting a 24×7 high-availability production environment
  • Experience in such technologies as Puppet, Ansible and Salt.
  • Knowledge of SCM (Git) and Scripting Languages (Python, Scala, Java, etc)
  • A broad knowledge of multiple infrastructure disciplines.
  • Ability to learn quickly and problem solve.
  • Expert level experience with Big Data Technologies (HDFS, Yarn, Hive, HBase, Phoenix, Spark, Solr, Zookeeper). 
  • Understanding of concepts and technology relative to real-time and batch processing in Hadoop.
  • Working knowledge of web technologies and protocols (JAVA/NoSQL/JSON/REST/JMS).
  • At least 5 years of experience building and managing distributed systems.
  • 5+ years of experience with Architecting Distributed Solutions dealing with high volume of data on  highly-scalable, multi-node environments.
  • Excellent written/oral communication skills.


OpenSky Corporation is an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veteran status, sexual orientation and gender identity or any other characteristic protected by law.




Sorry the Share function is not working properly at this moment. Please refresh the page and try again later.
Share on your newsfeed