Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[QNN EP] [DRAFT] Make QNN EP a shared library #23120

Draft
wants to merge 63 commits into
base: main
Choose a base branch
from
Draft

[QNN EP] [DRAFT] Make QNN EP a shared library #23120

wants to merge 63 commits into from
+1,816 −667

Conversation

adrianlizarraga
Copy link
Contributor

Description

DRAFT
Make QNN EP a shared library that uses the ORT provider API.

Motivation and Context

@adrianlizarraga
Copy shared utils into qnn ep
d035fb4
@adrianlizarraga
Update QNN EP's initializer transpose logic to use only functions exp…
7e46a7d 
…osed by the provider bridge.
@adrianlizarraga
Update comment
a155b33
@adrianlizarraga
Added TransposeBase::DoTranspose() to provider bridge. May elect to r…
e9c5f14 
…evert this in favor of doing the transpose manually in QNN EP
@adrianlizarraga
Add TypeProto_Tensor_has_elem_type() to provider bridge
d0f64dc
@adrianlizarraga
Add to provider bridge: TensorTypeBase class, TensorTypeBase::GetElem…
f8bd2f6 
…entType(), DataTypeImpl::TensorTypeFromONNXEnum()
@adrianlizarraga
Transpose initializers within QNN EP without using CPU EP utils
1f533a9
@adrianlizarraga
Rename transpose func
ccaefb3
@adrianlizarraga
Remove TransposeBase forward declaration from provider bridge
fb765c7
@adrianlizarraga
Rewrite SliceOpBuilder util GetInitializerInputData() to not use func…
0237bca 
…tions not available in the provider bridge.
@adrianlizarraga
Revert addition of TensorTypeBase to provider bridge
e3705b2
@adrianlizarraga
Remove last use of GetTensorShapeFromTensorProto
6f0b3c6
@adrianlizarraga
Add DataTypeUtils::ToType(std::string&) to provider bridge
5939bf6
@adrianlizarraga
Add Logger::GetSeverity() to provider bridge
58dbf49
@adrianlizarraga
Add TensorShapeProto_Dimensions__size to provider bridge
f76b09a
@adrianlizarraga
Add utils::CreateSupportedPartitions() to provider bridege
d189fe6
@adrianlizarraga
Merge main and fix conflicts
a0b3c75
@adrianlizarraga
Use new namespace for NodeAttrHelper
48191ea
@adrianlizarraga
Add to provider bridge: GraphViewer::Nodes(), ConstGraphNodes struct …
e6afd72 
…+ iterators
@adrianlizarraga
Replace usage of cbegin() and cend() in NodeAttrHelper with version t…
0b1e538 
…hat does not need to add new functionality to the provider bridge
@adrianlizarraga
Add convenience function to get the default Env to provider bridge
fb3618d
@adrianlizarraga
Moving ORT includes to a separate header
6b581fd
@adrianlizarraga
Add Node::EdgeEnd wrapper class to provider bridge. Add NodeUnit cons…
a1129e5 
…tructor
@adrianlizarraga
Move more header includes to ort_api.h
ba86c41
@adrianlizarraga
Add GraphViewer::NodeProducesGraphOutput() to provider bridge
2b1ea09
@adrianlizarraga
Replace use of InlinedVector with std::vector and fix newly discovere…
421cd78 
…d bug in qnn_configs_helper
@adrianlizarraga
Eliminate use of qmath.h by introducing new quantization utils for QNN
d94e6f7
@adrianlizarraga
Move includes into qnn/ort_api.h
4eb1e80
@adrianlizarraga
Add TensorProto::has_data_type() to provider bridge
d86fb6c
@adrianlizarraga
Checkpoint: updating usage of provider bridge in ep
187e3b9
@adrianlizarraga
Copy qnn dll for java build
9861ec8
@adrianlizarraga
Add linker -rpath="
b92043d
@adrianlizarraga
two backslashes in rpath
f29ce59
@adrianlizarraga
Copy qnn ep dlls when running java unit tests
5d954d6
@adrianlizarraga
Modify Java bindings to use QNN shared lib
03614bc
@adrianlizarraga
Try to build onnxruntime_providers_shared on Android
421f39f
@adrianlizarraga
Merge branch 'main' into adrianl/qnn-ep-dynamic-lib
7aae2b3
@adrianlizarraga
Pass linker flag to Android build of qnn dll
9354f18
@adrianlizarraga
Try different linker flag for android
e8df64f
@adrianlizarraga
Use -z undefs on android
863ff04
@adrianlizarraga
Expose ETW logger functionality via provider bridge. Fix multithreadi…
ef1b91d 
…ng bug in callback from Etw (QNN EP needs to properly lock a logging mutex).
@adrianlizarraga
Cmake java android: copy libonnxruntime_providers_shared.so and libon…
57e0072 
…nxruntime_providers_qnn.so to directory for building Android AAR package
@adrianlizarraga
QNN Nuget Pipeline: print contents of binaries directory to see if sh…
bd32daa 
…ared libs were copied
@adrianlizarraga
Fix print in yaml
8a65a1d
@adrianlizarraga
Fix cmake copy command for Java build with qnn
7ff94a0
@adrianlizarraga
Try to fix nuget shared lib files for qnn
0fbff4a
@adrianlizarraga
Pass --build_shared_lib when bulding python wheels with qnn [pipelines]
9cbd0fa
@adrianlizarraga
Print correct binary directory in QNN Nuget pipeline
f8747db
@adrianlizarraga
Add onnxruntime_providers_qnn.dll/.so to setup.py so that it gets cop…
058e7bb 
…ied when building python wheel
@adrianlizarraga
Edit Java bindins to allow loading/extracting shared provider libs on…
4172575 
… Android
@adrianlizarraga
Create temp directory for java android
3e39b88
@adrianlizarraga
consistent library loading logic for java android
5ed035f
@adrianlizarraga
Merge branch 'main' into adrianl/qnn-ep-dynamic-lib
6347c5f
@adrianlizarraga
Add temporary logging
6562433
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
ep:QNN issues related to QNN exeution provider
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@adrianlizarraga