Skip to content

Commit

Permalink
Wave Metrics
Browse files Browse the repository at this point in the history
- Make multithreaded memcpy for staging transfers for GPU table scan.
- Make variants of bit unpacking in GpuDecoder-inl.cuh. Make selective decoding templatized as opposed to runtime switching.
- Add pieces to GpuDecoderTest, like comparing calling via launchDecode or (multi-function blocks) or decodeGlobal (single function thread blocks).
- Add a metric for driver thread waiting for first continuable stream.
- Check approx correctness of Wave runtimeStats.
- Refactor QueryBenchmarkBase.* from TpchBenchmark. Logic to do sweeps across parameter combinations.
- Add persistent file format to Wave mock format.
- Add benchmark for scan, filter, filter expr, projection. aggregation combinations with Wave and Dwrf.
  • Loading branch information
Orri Erling committed Aug 18, 2024
1 parent 54b16e0 commit f7e137b
Show file tree
Hide file tree
Showing 46 changed files with 2,314 additions and 656 deletions.
24 changes: 24 additions & 0 deletions velox/benchmarks/CMakeLists.txt
Original file line number Diff line number Diff line change
Expand Up @@ -39,3 +39,27 @@ if(${VELOX_ENABLE_BENCHMARKS})
add_subdirectory(tpch)
add_subdirectory(filesystem)
endif()

add_library(velox_query_benchmark QueryBenchmarkBase.cpp)
target_link_libraries(
velox_query_benchmark
velox_aggregates
velox_exec
velox_exec_test_lib
velox_dwio_common
velox_dwio_common_exception
velox_dwio_parquet_reader
velox_dwio_common_test_utils
velox_hive_connector
velox_exception
velox_memory
velox_process
velox_serialization
velox_encode
velox_type
velox_type_fbhive
velox_caching
velox_vector_test_lib
${FOLLY_BENCHMARK}
Folly::folly
fmt::fmt)
Loading

0 comments on commit f7e137b

Please sign in to comment.