Wednesday, November 15, 2017
Code For Deleting Output Folder If Exist In Hadoop MapReduce Jobs
Code For Deleting Output Folder If Exist In Hadoop MapReduce Jobs
Mostly Hadoop MapReduce Jobs operates with two arguments.
Input directory and Output directory.
Each time when we run our MapReduce job we need to give non-existing folder as our output path. So while we are doing a Trail and Error method in our MR jobs. It is good if it automatically deletes the output folder if exists.
Here is the code for that:
/*Provides access to configuration parameters*/
Configuration conf = new Configuration();
/*Creating Filesystem object with the configuration*/
FileSystem fs = FileSystem.get(conf);
/*Check if output path (args[1])exist or not*/
if(fs.exists(new Path(args[1]))){
/*If exist delete the output path*/
fs.delete(new Path(args[1]),true);
}
Subscribe to:
Post Comments (Atom)
No comments:
Post a Comment