Skip to content
/ base Public

A collection of Go utility packages used by GRAIL's tools

License

Notifications You must be signed in to change notification settings

grailbio/base

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commit
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

The grailbio/base project includes all the packages used by many other grailbio Go packages:

  • API documentation: godoc.org/github.com/grailbio/base

  • Issue tracker: github.com/grailbio/base/issues

  • CI

  • recordio: encrypted and compressed record oriented files with indexing support

  • file: unified file API for the local file system and S3

  • digest: common in-memory and serialized representation of digests

  • data: support for measuring and displaying quantities of data

  • intervalmap: fast interval tree

  • limiter: concurrency limiter with context support

  • traverse: concurrent and parallel slice traversal

  • state: file-based state management

  • syncqueue: various flavors of producer-consumer queues

  • unsafe: conversion from []byte to string, etc.

  • compress/libdeflate: efficient block compression/decompression

  • bitset: []uintptr bitset support

  • simd: fast operations on []byte

  • tsv: simple and efficient TSV writer

  • cloud/spotadvisor: provides an interface for fetching and utilizing AWS Spot Advisor data

  • cloud/spotfeed: provides interfaces for interacting with the AWS spot data feed format for files hosted on S3