• Competitive
  • Singapour, Singapore
  • CDI, Plein-temps
  • OCBC Bank
  • 18 janv. 18

Systems Analyst – Hadoop Architect

Systems Analyst – Hadoop Architect

  • The responsibilities include, but not limited to the following:
    • Design, deploy, manage big data platform
    • Install, maintain & upgrade Hadoop ecosystem components
    • Monitor Hadoop cluster for job performance and capacity planning
  • Configuration and management of security for Hadoop clusters.
  • Manage and monitor Hadoop cluster and platform infrastructure.
  • Automate cluster node provisioning and repetitive operational tasks.
  • Develop detailed design documentation of the Hadoop platform and integration with data ingestion and visualization tools
  • Work closely with the Infrastructure Management teams (Storage, Network, Unix, Backup) to develop a support model for Hadoop Cluster platform and services


Qualifications
  • A good degree in Computer Science or equivalent, with minimum 4 years in design and implementation of big data Hadoop ecosystem.
  • A deep understanding of Hadoop design principals, cluster connectivity, security and the factors that affect distributed system performance.
  • Professional experience with Hadoop technologies (complete ecosystem) such as HDFS, Hbase, Pig, Zookeeper, Hive, Impala, Kafka, Yam, Flume, MapR, MapRFS/Reduce
  • Proficiency in Cloudera, Hortonworks, or MapR control systems.
  • Strong knowledge on Spark and Flink
  • Experience working with integration of structured and unstructured data
  • Experience in implementing online functions and API using Hadoop
  • Experience in database sharding, replication, recovery, and performance optimizations
  • Strong knowledge in Hadoop monitoring tools
*LI-CY