Big Data

  Apache -Cassandra Cassandra is a NoSQL database which is distributed and scalable. It is provided by Apache Software Foundation. Apache Cassandra is highly scalable, high performance, distributed NoSQL database. Cassandra is designed to handle huge amount of data across many commodity servers, providing high availability without a single point of failure. Cassandra has a distributed architecture which is capable to handle a huge amount of data. Data is placed on different machines with more than one replication factor to attain a high availability without a single point of failure. Step 1: Before cassandra you have to need install java1.8>=  https://www.oracle.com/in/java/technologies/javase/javase8-archive-downloads.html step 2: python is needed for  install cassandra  Install Python 2.7 sudo apt-add-repository universe sudo apt update sudo apt install python2-minimal python2 -V Step 3: Download cassandra 3.11.15  https://cassandra.apache.org/_/download.ht...

 Data Migration Using Apache Sqoop  Sqoop: sql + hadoop = sqoop actually sqoop is one of the component in hadoop and it was initially developed and maintained by Cloudera. sqoop is a data pipeline tool used to transfer the data between RDBMS(Relational Database Management System) to Hadoop. It can be a any rdbms data. There are three ways to import from rdbms to hadoop 1) RDBMS to HDFS 2) RDBMS to Hive 3) RDBMS to Hbase we can do export to rdbms from hive and hdfs  only  1)HDFS to RDBMS  2)Hive to RDBMS Here we use the Mysql(Rdbms) commands for import    1) MySql to HDFS bin/sqoop import --connect jdbc:mysql://localhost/db -username root -password 123 --table Persons -m1 2)Mysql to Hive bin/sqoop import --connect jdbc:mysql://localhost/db -username root -password 123 --table test --hive-table mysqltohive --create-hive-table --hive-import -m1 3)Mysql to Hbase bin/sqoop import --connect jdbc:mysql://localhost/test --username root --password root --table...