Meteorological Big Data mining: A survey

Abstract

Meteorological data is generated on day to day basis through various techniques. Hadoop distributed file system is used to handle such a rapid growth of data by storing data in distributed system. There are many architecture exist which uses Hive and pig query tools to extract data from HDFS and then apply Mapreduce for analyzing data. Apache spark is also used for faster analysis. To further improve time efficiency for large datasets, data mining algorithms are also used in distributed manner. All work has been done on traditional framework with the lack of any user interface and effective visualization. We will propose a framework which is more efficient to handle meteorological data with user interface and effective visualization.