List of saveNamespace() Examples

Examples of saveNamespace()

org.apache.hadoop.hdfs.DistributedFileSystem.saveNamespace()
Save namespace image. @see org.apache.hadoop.hdfs.protocol.ClientProtocol#saveNamespace()
org.apache.hadoop.hdfs.server.namenode.FSImage.saveNamespace()
Save the contents of the FS image and create empty edits. In order to minimize the recovery effort in case of failure during saveNamespace the algorithm reduces discrepancy between directory states by performing updates in the following order:
1. rename current to lastcheckpoint.tmp for all of them,
2. save image and recreate edits for all of them,
3. rename lastcheckpoint.tmp to previous.checkpoint.
On stage (2) we first save all images, then recreate edits. Otherwise the name-node may purge all edits and fail, in which case the journal will be lost.
org.apache.hadoop.hdfs.server.namenode.NameNode.saveNamespace()
@inheritDoc
org.apache.hadoop.hdfs.server.protocol.NamenodeProtocols.saveNamespace()

Examples of org.apache.hadoop.hdfs.server.protocol.NamenodeProtocols.saveNamespace()

      writeFile(fs, new Path(baseDir, "file1"), buffer, bufferSize);
      writeFile(fs, new Path(baseDir, "file2"), buffer, bufferSize);
      
      // save image
      namenode.setSafeMode(SafeModeAction.SAFEMODE_ENTER, false);
      namenode.saveNamespace();
      namenode.setSafeMode(SafeModeAction.SAFEMODE_LEAVE, false);
      
      // write more files
      writeFile(fs, new Path(baseDir, "file3"), buffer, bufferSize);
      writeFile(fs, new Path(baseDir, "file4"), buffer, bufferSize);

View Full Code Here

Examples of org.apache.hadoop.hdfs.server.protocol.NamenodeProtocols.saveNamespace()


      // Now primary NN saves namespace 3 times
      NamenodeProtocols nn = cluster.getNameNodeRpc();
      nn.setSafeMode(SafeModeAction.SAFEMODE_ENTER, false);
      for (int i = 0; i < 3; i++) {
        nn.saveNamespace();
      }
      nn.setSafeMode(SafeModeAction.SAFEMODE_LEAVE, false);
      
      // Now the secondary tries to checkpoint again with its
      // old image in memory.

View Full Code Here

Examples of org.apache.hadoop.hdfs.server.protocol.NamenodeProtocols.saveNamespace()


      // Now primary NN saves namespace 3 times
      NamenodeProtocols nn = cluster.getNameNodeRpc();
      nn.setSafeMode(SafeModeAction.SAFEMODE_ENTER, false);
      for (int i = 0; i < 3; i++) {
        nn.saveNamespace();
      }
      nn.setSafeMode(SafeModeAction.SAFEMODE_LEAVE, false);
      
      // Now the secondary tries to checkpoint again with its
      // old image in memory.

View Full Code Here

Examples of org.apache.hadoop.hdfs.server.protocol.NamenodeProtocols.saveNamespace()

    namenode.getNamesystem().mkdirs("/test",
        new PermissionStatus("hairong", null, FsPermission.getDefault()), true);
    NamenodeProtocols nnRpc = namenode.getRpcServer();
    assertTrue(nnRpc.getFileInfo("/test").isDir());
    nnRpc.setSafeMode(SafeModeAction.SAFEMODE_ENTER);
    nnRpc.saveNamespace();
    namenode.stop();
    namenode.join();


    // compress image using default codec
    LOG.info("Read an uncomressed image and store it compressed using default codec.");

View Full Code Here

Examples of org.apache.hadoop.hdfs.server.protocol.NamenodeProtocols.saveNamespace()

  private void checkNameSpace(Configuration conf) throws IOException {
    NameNode namenode = new NameNode(conf);
    NamenodeProtocols nnRpc = namenode.getRpcServer();
    assertTrue(nnRpc.getFileInfo("/test").isDir());
    nnRpc.setSafeMode(SafeModeAction.SAFEMODE_ENTER);
    nnRpc.saveNamespace();
    namenode.stop();
    namenode.join();
  }
  
  public void testImageChecksum() throws Exception {

View Full Code Here

Examples of org.apache.hadoop.hdfs.server.protocol.NamenodeProtocols.saveNamespace()

      writeFile(fs, new Path(baseDir, "file1"), buffer, bufferSize);
      writeFile(fs, new Path(baseDir, "file2"), buffer, bufferSize);
      
      // save image
      namenode.setSafeMode(SafeModeAction.SAFEMODE_ENTER);
      namenode.saveNamespace();
      namenode.setSafeMode(SafeModeAction.SAFEMODE_LEAVE);
      
      // write more files
      writeFile(fs, new Path(baseDir, "file3"), buffer, bufferSize);
      writeFile(fs, new Path(baseDir, "file4"), buffer, bufferSize);

View Full Code Here

Examples of org.apache.hadoop.hdfs.server.protocol.NamenodeProtocols.saveNamespace()


      // Now primary NN saves namespace 3 times
      NamenodeProtocols nn = cluster.getNameNodeRpc();
      nn.setSafeMode(SafeModeAction.SAFEMODE_ENTER);
      for (int i = 0; i < 3; i++) {
        nn.saveNamespace();
      }
      nn.setSafeMode(SafeModeAction.SAFEMODE_LEAVE);
      
      // Now the secondary tries to checkpoint again with its
      // old image in memory.

View Full Code Here

Examples of org.apache.hadoop.hdfs.server.protocol.NamenodeProtocols.saveNamespace()

    namenode.getNamesystem().mkdirs("/test",
        new PermissionStatus("hairong", null, FsPermission.getDefault()), true);
    NamenodeProtocols nnRpc = namenode.getRpcServer();
    assertTrue(nnRpc.getFileInfo("/test").isDir());
    nnRpc.setSafeMode(SafeModeAction.SAFEMODE_ENTER);
    nnRpc.saveNamespace();
    namenode.stop();
    namenode.join();


    // compress image using default codec
    LOG.info("Read an uncomressed image and store it compressed using default codec.");

View Full Code Here

Examples of org.apache.hadoop.hdfs.server.protocol.NamenodeProtocols.saveNamespace()

  private void checkNameSpace(Configuration conf) throws IOException {
    NameNode namenode = new NameNode(conf);
    NamenodeProtocols nnRpc = namenode.getRpcServer();
    assertTrue(nnRpc.getFileInfo("/test").isDir());
    nnRpc.setSafeMode(SafeModeAction.SAFEMODE_ENTER);
    nnRpc.saveNamespace();
    namenode.stop();
    namenode.join();
  }
  
  public void testImageChecksum() throws Exception {

View Full Code Here

Examples of org.apache.hadoop.hdfs.server.protocol.NamenodeProtocols.saveNamespace()


      // Now primary NN saves namespace 3 times
      NamenodeProtocols nn = cluster.getNameNodeRpc();
      nn.setSafeMode(SafeModeAction.SAFEMODE_ENTER);
      for (int i = 0; i < 3; i++) {
        nn.saveNamespace();
      }
      nn.setSafeMode(SafeModeAction.SAFEMODE_LEAVE);
      
      // Now the secondary tries to checkpoint again with its
      // old image in memory.

View Full Code Here

0 1 2 3 4 5

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.