Examples of Hasher

cascading.tuple.Hasher
The Hasher allows a {@link java.util.Comparator} implementation to also be delegated to during hashCode generationduring grouping partitioning.
If a Comparator is used to compare two types during grouping, its likely the {@code hashCode} value betweenthe two objects will not be consistent. This allows to objects being equal to hash to the same bucket (reducer) during partitioning.
com.boundlessgeo.geoserver.util.Hasher
ds.org/.
com.cloudhopper.commons.util.Hasher
.com/jjlauer" target=window>http://twitter.com/jjlauer)
com.facebook.presto.jdbc.internal.guava.hash.Hasher
A {@link PrimitiveSink} that can compute a hash code after reading the input. Each hasher shouldtranslate all multibyte values ( {@link #putInt(int)}, {@link #putLong(long)}, etc) to bytes in little-endian order.
Warning: The result of calling any methods after calling {@link #hash} is undefined.
Warning: Using a specific character encoding when hashing a {@link CharSequence} with{@link #putString(CharSequence,Charset)} is generally only useful for cross-languagecompatibility (otherwise prefer {@link #putUnencodedChars}). However, the character encodings must be identical across languages. Also beware that {@link Charset} definitions may occasionallychange between Java releases.
Warning: Chunks of data that are put into the {@link Hasher} are not delimited.The resulting {@link HashCode} is dependent only on the bytes inserted, and the order in whichthey were inserted, not how those bytes were chunked into discrete put() operations. For example, the following three expressions all generate colliding hash codes:
```
    {@code newHasher().putByte(b1).putByte(b2).putByte(b3).hash()}newHasher().putByte(b1).putBytes(new byte[]  b2, b3 }).hash() newHasher().putBytes(new byte[] { b1, b2, b3 }).hash()}
```
If you wish to avoid this, you should either prepend or append the size of each chunk. Keep in mind that when dealing with char sequences, the encoded form of two concatenated char sequences is not equivalent to the concatenation of their encoded form. Therefore, {@link #putString(CharSequence,Charset)} should only be used consistently with completesequences and not broken into chunks. @author Kevin Bourrillion @since 11.0
com.findwise.tools.Hasher
Helper class to get Message Digests in a lightweight fashion. Primarily useful because it lets you get a hex string of the digests instead of the raw bytes. @author joel.westberg
com.google.common.hash.Hasher
A {@link PrimitiveSink} that can compute a hash code after reading the input. Each hasher shouldtranslate all multibyte values ( {@link #putInt(int)}, {@link #putLong(long)}, etc) to bytes in little-endian order.
Warning: The result of calling any methods after calling {@link #hash} is undefined.
Warning: Using a specific character encoding when hashing a {@link CharSequence} with{@link #putString(CharSequence,Charset)} is generally only useful for cross-languagecompatibility (otherwise prefer {@link #putUnencodedChars}). However, the character encodings must be identical across languages. Also beware that {@link Charset} definitions may occasionallychange between Java releases.
Warning: Chunks of data that are put into the {@link Hasher} are not delimited.The resulting {@link HashCode} is dependent only on the bytes inserted, and the order in whichthey were inserted, not how those bytes were chunked into discrete put() operations. For example, the following three expressions all generate colliding hash codes:
```
    {@code newHasher().putByte(b1).putByte(b2).putByte(b3).hash()}newHasher().putByte(b1).putBytes(new byte[]  b2, b3 }).hash() newHasher().putBytes(new byte[] { b1, b2, b3 }).hash()}
```
If you wish to avoid this, you should either prepend or append the size of each chunk. Keep in mind that when dealing with char sequences, the encoded form of two concatenated char sequences is not equivalent to the concatenation of their encoded form. Therefore, {@link #putString(CharSequence,Charset)} should only be used consistently with completesequences and not broken into chunks. @author Kevin Bourrillion @since 11.0
com.google_voltpatches.common.hash.Hasher
A {@link PrimitiveSink} that can compute a hash code after reading the input. Each hasher shouldtranslate all multibyte values ( {@link #putInt(int)}, {@link #putLong(long)}, etc) to bytes in little-endian order.
Warning: The result of calling any methods after calling {@link #hash} is undefined.
Warning: Using a specific character encoding when hashing a {@link CharSequence} with{@link #putString(CharSequence,Charset)} is generally only useful for cross-languagecompatibility (otherwise prefer {@link #putUnencodedChars}). However, the character encodings must be identical across languages. Also beware that {@link Charset} definitions may occasionallychange between Java releases.
Warning: Chunks of data that are put into the {@link Hasher} are not delimited.The resulting {@link HashCode} is dependent only on the bytes inserted, and the order in whichthey were inserted, not how those bytes were chunked into discrete put() operations. For example, the following three expressions all generate colliding hash codes:
```
    {@code newHasher().putByte(b1).putByte(b2).putByte(b3).hash()}newHasher().putByte(b1).putBytes(new byte[]  b2, b3 }).hash() newHasher().putBytes(new byte[] { b1, b2, b3 }).hash()}
```
If you wish to avoid this, you should either prepend or append the size of each chunk. Keep in mind that when dealing with char sequences, the encoded form of two concatenated char sequences is not equivalent to the concatenation of their encoded form. Therefore, {@link #putString(CharSequence,Charset)} should only be used consistently with completesequences and not broken into chunks. @author Kevin Bourrillion @since 11.0
jersey.repackaged.com.google.common.hash.Hasher
A {@link PrimitiveSink} that can compute a hash code after reading the input. Each hasher shouldtranslate all multibyte values ( {@link #putInt(int)}, {@link #putLong(long)}, etc) to bytes in little-endian order.
The result of calling any methods after calling {@link #hash} is undefined.
Warning: Chunks of data that are put into the {@link Hasher} are not delimited.The resulting {@link HashCode} is dependent only on the bytes inserted, and the order in whichthey were inserted, not how those bytes were chunked into discrete put() operations. For example, the following three expressions all generate colliding hash codes:
```
    {@code newHasher().putString("ab").putString("c").hash() newHasher().putString("a").putString("bc").hash() newHasher().putChar('a').putChar('b').putChar('c').hash()}
```
If you wish to avoid this, you should either prepend or append the size of each chunk. For example:
```
    {@code newHasher().putInt(s1.length()).putString(s1).putInt(s2.length()).putString(s2).hash()}
```
@author Kevin Bourrillion @since 11.0
org.eclipse.jgit.treewalk.filter.ByteArraySet.Hasher
org.gradle.api.internal.hash.Hasher
org.openbel.framework.common.util.Hasher

Examples of com.google.common.hash.Hasher

    if (buf.length() == 0) {
      return null;
    }


    LOG.debug("Creating jar file for coprocessor classes: " + buf.toString());
    final Hasher hasher = Hashing.md5().newHasher();
    final byte[] buffer = new byte[COPY_BUFFER_SIZE];


    final Map<String, URL> dependentClasses = new HashMap<String, URL>();
    for (Class<? extends Coprocessor> clz : classes) {
      Dependencies.findClassDependencies(clz.getClassLoader(), new Dependencies.ClassAcceptor() {
        @Override
        public boolean accept(String className, final URL classUrl, URL classPathUrl) {
          // Assuming the endpoint and protocol class doesn't have dependencies
          // other than those comes with HBase and Java.
          if (className.startsWith("co.cask")) {
            if (!dependentClasses.containsKey(className)) {
              dependentClasses.put(className, classUrl);
            }
            return true;
          }
          return false;
        }
      }, clz.getName());
    }


    if (!dependentClasses.isEmpty()) {
      LOG.debug("Adding " + dependentClasses.size() + " classes to jar");
      File jarFile = File.createTempFile(filePrefix, ".jar");
      try {
        JarOutputStream jarOutput = null;
        try {
          jarOutput = new JarOutputStream(new FileOutputStream(jarFile));
          for (Map.Entry<String, URL> entry : dependentClasses.entrySet()) {
            try {
              jarOutput.putNextEntry(new JarEntry(entry.getKey().replace('.', File.separatorChar) + ".class"));
              InputStream inputStream = entry.getValue().openStream();


              try {
                int len = inputStream.read(buffer);
                while (len >= 0) {
                  hasher.putBytes(buffer, 0, len);
                  jarOutput.write(buffer, 0, len);
                  len = inputStream.read(buffer);
                }
              } finally {
                inputStream.close();
              }
            } catch (IOException e) {
              LOG.info("Error writing to jar", e);
              throw Throwables.propagate(e);
            }
          }
        } finally {
          if (jarOutput != null) {
            jarOutput.close();
          }
        }


        // Copy jar file into HDFS
        // Target path is the jarDir + jarMD5.jar
        final Location targetPath = jarDir.append("coprocessor" + hasher.hash().toString() + ".jar");


        // If the file exists and having same since, assume the file doesn't changed
        if (targetPath.exists() && targetPath.length() == jarFile.length()) {
          return targetPath;
        }

View Full Code Here

Examples of com.google.common.hash.Hasher

    }


    @Override
    public int hashCode() {
        HashFunction hf = Hashing.goodFastHash(32);
        Hasher h = hf.newHasher();
        h.putInt(slots.size());
        for (int i=0; i<slots.size(); i++) {
            h.putInt(slots.get(i).size());
            for (int j=0; j<slots.size(); j++) {
                h.putBytes(slots.get(i).get(j).getLowerRange());
                h.putBytes(slots.get(i).get(j).getUpperRange());
            }
        }
        return h.hash().asInt();
    }

View Full Code Here

Examples of com.google.common.hash.Hasher

  //


  /** {@inheritDoc} */
  @Override
  public synchronized String getFingerprint() {
    Hasher hash = Hashing.sha256().newHasher();
    hash.putString(profile.getFingerprint());


    hash.putString("Posts(");
    for (Post post : getPosts()) {
      hash.putString("Post(").putString(post.getId()).putString(")");
    }
    hash.putString(")");


    List<PostReply> replies = new ArrayList<PostReply>(getReplies());
    Collections.sort(replies, Reply.TIME_COMPARATOR);
    hash.putString("Replies(");
    for (PostReply reply : replies) {
      hash.putString("Reply(").putString(reply.getId()).putString(")");
    }
    hash.putString(")");


    List<String> likedPostIds = new ArrayList<String>(getLikedPostIds());
    Collections.sort(likedPostIds);
    hash.putString("LikedPosts(");
    for (String likedPostId : likedPostIds) {
      hash.putString("Post(").putString(likedPostId).putString(")");
    }
    hash.putString(")");


    List<String> likedReplyIds = new ArrayList<String>(getLikedReplyIds());
    Collections.sort(likedReplyIds);
    hash.putString("LikedReplies(");
    for (String likedReplyId : likedReplyIds) {
      hash.putString("Reply(").putString(likedReplyId).putString(")");
    }
    hash.putString(")");


    hash.putString("Albums(");
    for (Album album : rootAlbum.getAlbums()) {
      if (!Album.NOT_EMPTY.apply(album)) {
        continue;
      }
      hash.putString(album.getFingerprint());
    }
    hash.putString(")");


    return hash.hash().toString();
  }

View Full Code Here

Examples of com.google.common.hash.Hasher

  // FINGERPRINTABLE METHODS
  //


  @Override
  public String getFingerprint() {
    Hasher hash = Hashing.sha256().newHasher();
    hash.putString("Image(");
    hash.putString("ID(").putString(id).putString(")");
    hash.putString("Title(").putString(title).putString(")");
    hash.putString("Description(").putString(description).putString(")");
    hash.putString(")");
    return hash.hash().toString();
  }

View Full Code Here

Examples of com.google.common.hash.Hasher

  /**
   * {@inheritDoc}
   */
  @Override
  public String getFingerprint() {
    Hasher hash = Hashing.sha256().newHasher();
    hash.putString("Profile(");
    if (firstName != null) {
      hash.putString("FirstName(").putString(firstName).putString(")");
    }
    if (middleName != null) {
      hash.putString("MiddleName(").putString(middleName).putString(")");
    }
    if (lastName != null) {
      hash.putString("LastName(").putString(lastName).putString(")");
    }
    if (birthDay != null) {
      hash.putString("BirthDay(").putInt(birthDay).putString(")");
    }
    if (birthMonth != null) {
      hash.putString("BirthMonth(").putInt(birthMonth).putString(")");
    }
    if (birthYear != null) {
      hash.putString("BirthYear(").putInt(birthYear).putString(")");
    }
    if (avatar != null) {
      hash.putString("Avatar(").putString(avatar).putString(")");
    }
    hash.putString("ContactInformation(");
    for (Field field : fields) {
      hash.putString(field.getName()).putString("(").putString(field.getValue()).putString(")");
    }
    hash.putString(")");
    hash.putString(")");


    return hash.hash().toString();
  }

View Full Code Here

Examples of com.google.common.hash.Hasher

  // FINGERPRINTABLE METHODS
  //


  @Override
  public String getFingerprint() {
    Hasher hash = Hashing.sha256().newHasher();
    hash.putString("Album(");
    hash.putString("ID(").putString(id).putString(")");
    hash.putString("Title(").putString(title).putString(")");
    hash.putString("Description(").putString(description).putString(")");
    if (albumImage != null) {
      hash.putString("AlbumImage(").putString(albumImage).putString(")");
    }


    /* add nested albums. */
    hash.putString("Albums(");
    for (Album album : albums) {
      hash.putString(album.getFingerprint());
    }
    hash.putString(")");


    /* add images. */
    hash.putString("Images(");
    for (Image image : getImages()) {
      if (image.isInserted()) {
        hash.putString(image.getFingerprint());
      }
    }
    hash.putString(")");


    hash.putString(")");
    return hash.hash().toString();
  }

View Full Code Here

Examples of com.google.common.hash.Hasher

     *
     * @param l the literal to create the hash for
     * @return a 64bit hash key for the literal
     */
    public static String createCacheKey(Literal l) {
        Hasher hasher = Hashing.goodFastHash(64).newHasher();
        hasher.putString(l.getLabel());
        if(l.getDatatype() != null) {
            hasher.putString(l.getDatatype().stringValue());
        }
        if(l.getLanguage() != null) {
            hasher.putString(l.getLanguage().toLowerCase());
        }
        return hasher.hash().toString();
    }

View Full Code Here

Examples of com.google.common.hash.Hasher

     * @param language language of the literal (optional)
     * @param type     datatype URI of the literal (optional)
     * @return a 64bit hash key for the literal
     */
    public static String createCacheKey(String content, Locale language, String type) {
        Hasher hasher = Hashing.goodFastHash(64).newHasher();
        hasher.putString(content);
        if(type != null) {
            hasher.putString(type);
        }
        if(language != null) {
            hasher.putString(language.getLanguage().toLowerCase());
        }
        return hasher.hash().toString();
    }

View Full Code Here

Examples of com.google.common.hash.Hasher

    }
    
    public static String getETag(RepositoryConnection conn, URI resource) throws RepositoryException {
      if (resource == null) return "";
      
        Hasher hasher = buildHasher();
        hasher.putString(resource.stringValue());
        //FIXME: The order of the statements is not defined -> might result in different hash!
        RepositoryResult<Statement> outgoing = conn.getStatements(resource, null, null, true);
        try {
          while (outgoing.hasNext()) {
            Statement statement = outgoing.next();
            hasher.putString(statement.getPredicate().stringValue());
              hasher.putString(statement.getObject().stringValue());
              //TODO: statement modification date?
          }
        } finally {
          outgoing.close();
        }
        RepositoryResult<Statement> incoming = conn.getStatements(null, null, resource, true);
        try {
          while (incoming.hasNext()) {
            Statement statement = incoming.next();
            hasher.putString(statement.getSubject().stringValue());
            hasher.putString(statement.getPredicate().stringValue());
            //TODO: statement modification date?
          }    
        } finally {
          incoming.close();
        }
        return hasher.hash().toString();
    }

View Full Code Here

Examples of com.google.common.hash.Hasher

//    }
    
    public static String getWeakETag(RepositoryConnection conn, Resource resource) throws RepositoryException {
      if (resource == null) return "";
      
        Hasher hasher = buildHasher();
        hasher.putString(resource.stringValue());
        //FIXME: The order of the statements is not defined -> might result in different hash!
        RepositoryResult<Statement> statements = conn.getStatements(resource, null, null, true);
        try {
          while (statements.hasNext()) {
            Statement statement = statements.next();
            hasher.putString(statement.getPredicate().stringValue());
            hasher.putString(statement.getObject().stringValue());
            //TODO: statement modification date?
          }
        } finally {
          statements.close();
        }
        return hasher.hash().toString();
    }

View Full Code Here

0 1 2 3 4 5

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.