How do I build with unicode support? Using Visual Studio 2022 #78

Qriist · 2022-05-12T19:26:16Z

Qriist
May 12, 2022

Hello everyone. I'm working on compiling a custom build of sqlite3mc_dllicu. I have a properly built (confirmed working) non-icu version of my custom dll and have copied the required preprocessor settings to the icu solution. I'm targeting the Win64 Release build

I've also went and grabbed what I believe to be the correct source files from the unicode repo, currently icu4c-71_1-Win64-MSVC2019.zip

Without ICU source files:

Rebuild started...
1>------ Rebuild All started: Project: sqlite3mc_dllicu, Configuration: Release Win64 x64 ------
1>sqlite3mc.c
1>C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c(202381,10): fatal error C1083: Cannot open include file: 'unicode/utypes.h': No such file or directory
1>Done building project "sqlite3mc_vc17_dllicu.vcxproj" -- FAILED.
========== Rebuild All: 0 succeeded, 1 failed, 0 skipped ==========

With ICU source files placed in SQLite3MultipleCiphers\src\unicode:

Rebuild started...
1>------ Rebuild All started: Project: sqlite3mc_dllicu, Configuration: Release Win64 x64 ------
1>sqlite3mc.c
1>C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c(202963,24): warning C4267: '=': conversion from 'size_t' to 'int', possible loss of data
1>C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c(203019,20): warning C4267: '=': conversion from 'size_t' to 'int', possible loss of data
1>   Creating library ..\bin\vc17\dll\release\sqlite3mc_icu_x64.lib and object ..\bin\vc17\dll\release\sqlite3mc_icu_x64.exp
1>sqlite3mc.obj : error LNK2019: unresolved external symbol u_errorName_71 referenced in function icuFunctionError
1>sqlite3mc.obj : error LNK2019: unresolved external symbol u_isspace_71 referenced in function icuNext
1>sqlite3mc.obj : error LNK2019: unresolved external symbol u_foldCase_71 referenced in function icuOpen
1>sqlite3mc.obj : error LNK2019: unresolved external symbol uregex_open_71 referenced in function icuRegexpFunc
1>sqlite3mc.obj : error LNK2019: unresolved external symbol uregex_close_71 referenced in function icuRegexpDelete
1>sqlite3mc.obj : error LNK2019: unresolved external symbol uregex_setText_71 referenced in function icuRegexpFunc
1>sqlite3mc.obj : error LNK2019: unresolved external symbol uregex_matches_71 referenced in function icuRegexpFunc
1>sqlite3mc.obj : error LNK2019: unresolved external symbol u_strToUpper_71 referenced in function icuCaseFunc16
1>sqlite3mc.obj : error LNK2019: unresolved external symbol u_strToLower_71 referenced in function icuCaseFunc16
1>sqlite3mc.obj : error LNK2019: unresolved external symbol u_strToUTF8_71 referenced in function icuNext
1>sqlite3mc.obj : error LNK2019: unresolved external symbol ucol_open_71 referenced in function icuLoadCollation
1>sqlite3mc.obj : error LNK2019: unresolved external symbol ucol_close_71 referenced in function icuLoadCollation
1>sqlite3mc.obj : error LNK2019: unresolved external symbol ucol_strcoll_71 referenced in function icuCollationColl
1>sqlite3mc.obj : error LNK2019: unresolved external symbol ubrk_open_71 referenced in function icuOpen
1>sqlite3mc.obj : error LNK2019: unresolved external symbol ubrk_close_71 referenced in function icuClose
1>sqlite3mc.obj : error LNK2019: unresolved external symbol ubrk_current_71 referenced in function icuNext
1>sqlite3mc.obj : error LNK2019: unresolved external symbol ubrk_next_71 referenced in function icuNext
1>sqlite3mc.obj : error LNK2019: unresolved external symbol ubrk_first_71 referenced in function icuOpen
1>..\bin\vc17\dll\release\sqlite3mc_icu_x64.dll : fatal error LNK1120: 18 unresolved externals
1>Done building project "sqlite3mc_vc17_dllicu.vcxproj" -- FAILED.
========== Rebuild All: 0 succeeded, 1 failed, 0 skipped ==========

I'm at a loss for where to go from here and will glady accept any pointers. Thanks in advance!

utelle · 2022-05-12T21:40:37Z

utelle
May 12, 2022
Maintainer

I'm working on compiling a custom build of sqlite3mc_dllicu. I have a properly built (confirmed working) non-icu version of my custom dll and have copied the required preprocessor settings to the icu solution. I'm targeting the Win64 Release build

I've also went and grabbed what I believe to be the correct source files from the unicode repo, currently icu4c-71_1-Win64-MSVC2019.zip

Yes, that's the correct archive, if you intend to use the 64-bit build of ICU. After downloading you should extract the archive to a directory of your choice, for example C:\Users\Qriist\icu-precompiled\icu-71.1-vs2019. The next step is to define the environment variable LIBICU_PATH:

Open the Start Search, type in “env”, and choose “Edit the system environment variables”:
Click the “Environment Variables…” button.
Set the environment variables as needed. The New button adds an additional variable. ...
i.e.: Name: LIBICUPATH, Value: C:\Users\Qriist\icu-precompiled\icu-71.1-vs2019
Dismiss all of the dialogs by choosing “OK”.

Alternatively, you can set the environment variable from the command prompt:

SET LIBICUPATH=C:\Users\Qriist\icu-precompiled\icu-71.1-vs2019

The build files coming with SQLite3 Multiple Ciphers use this environment variable to define where the ICU header files and link libraries can be found.

Building the SQLite3 Multiple Ciphers DLL with ICU support should then work without problems.

I'm at a loss for where to go from here and will glady accept any pointers. Thanks in advance!

I have to admit that the above mentioned instructions for enabling ICU support should be included in the documentation.

2 replies

Qriist May 13, 2022
Author

LIBICU_PATH / LIBICUPATH

I imagine one of these was a typo but I set both anyways.

I've added the archive's files to the folder set in the step above.

That didn't work so I also copied the include\unicode folder to, uh, every other folder in there. Regardless, the compiler still couldn't find the files.

Rebuild started...
1>------ Rebuild All started: Project: sqlite3mc_dllicu, Configuration: Release Win64 x64 ------
1>sqlite3mc.c
1>C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c(202381,10): fatal error C1083: Cannot open include file: 'unicode/utypes.h': No such file or directory
1>Done building project "sqlite3mc_vc17_dllicu.vcxproj" -- FAILED.
========== Rebuild All: 0 succeeded, 1 failed, 0 skipped ==========

Here's the full errorlist, too.

Severity	Code	Description	Project	File	Line	Suppression State
Error (active)	E0020	identifier "UChar32" is undefined	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202470	
Error (active)	E1696	cannot open source file "unicode/utypes.h"	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202381	
Error (active)	E1696	cannot open source file "unicode/uregex.h"	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202382	
Error (active)	E1696	cannot open source file "unicode/ustring.h"	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202383	
Error (active)	E1696	cannot open source file "unicode/ucol.h"	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202384	
Error (active)	E1696	cannot open source file "unicode/ubrk.h"	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202924	
Error (active)	E1696	cannot open source file "unicode/utf16.h"	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202927	
Error (active)	E0020	identifier "UErrorCode" is undefined	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202405	
Error (active)	E0020	identifier "UChar32" is undefined	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202530	
Error (active)	E0018	expected a ')'	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202530	
Error (active)	E0018	expected a ')'	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202531	
Error (active)	E0020	identifier "UChar32" is undefined	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202562	
Error (active)	E0020	identifier "URegularExpression" is undefined	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202599	
Error (active)	E0020	identifier "pExpr" is undefined	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202599	
Error (active)	E0029	expected an expression	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202599	
Error (active)	E0065	expected a ';'	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202599	
Error (active)	E0020	identifier "UErrorCode" is undefined	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202623	
Error (active)	E0020	identifier "U_ZERO_ERROR" is undefined	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202623	
Error (active)	E0020	identifier "URegularExpression" is undefined	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202624	
Error (active)	E0020	identifier "pExpr" is undefined	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202624	
Error (active)	E0020	identifier "UBool" is undefined	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202625	
Error (active)	E0020	identifier "UChar" is undefined	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202626	
Error (active)	E0020	identifier "UChar" is undefined	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202639	
Error (active)	E0020	identifier "UChar" is undefined	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202706	
Error (active)	E0020	identifier "UChar" is undefined	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202707	
Error (active)	E0020	identifier "zOutput" is undefined	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202707	
Error (active)	E0020	identifier "UErrorCode" is undefined	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202712	
Error (active)	E0020	identifier "zNew" is undefined	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202732	
Error (active)	E0020	identifier "U_ZERO_ERROR" is undefined	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202739	
Error (active)	E0020	identifier "U_BUFFER_OVERFLOW_ERROR" is undefined	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202748	
Error (active)	E0020	identifier "UCollator" is undefined	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202766	
Error (active)	E0020	identifier "p" is undefined	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202766	
Error (active)	E0029	expected an expression	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202766	
Error (active)	E0065	expected a ';'	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202766	
Error (active)	E0020	identifier "UCollationResult" is undefined	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202781	
Error (active)	E0020	identifier "UCollator" is undefined	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202782	
Error (active)	E0020	identifier "p" is undefined	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202782	
Error (active)	E0029	expected an expression	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202782	
Error (active)	E0065	expected a ';'	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202782	
Error (active)	E0020	identifier "UChar" is undefined	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202783	
Error (active)	E0029	expected an expression	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202783	
Error (active)	E0018	expected a ')'	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202783	
Error (active)	E0020	identifier "UCOL_LESS" is undefined	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202785	
Error (active)	E0020	identifier "UCOL_GREATER" is undefined	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202786	
Error (active)	E0020	identifier "UCOL_EQUAL" is undefined	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202787	
Error (active)	E0020	identifier "UErrorCode" is undefined	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202812	
Error (active)	E0020	identifier "U_ZERO_ERROR" is undefined	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202812	
Error (active)	E0020	identifier "UCollator" is undefined	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202815	
Error (active)	E0020	identifier "pUCollator" is undefined	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202815	
Error (active)	E0020	identifier "UBreakIterator" is undefined	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202940	
Error (active)	E0020	identifier "UChar" is undefined	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202942	
Error (active)	E0020	identifier "U_FOLD_CASE_DEFAULT" is undefined	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	203005	
Error (active)	E0020	identifier "UErrorCode" is undefined	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	203006	
Error (active)	E0020	identifier "U_ZERO_ERROR" is undefined	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	203006	
Error (active)	E0020	identifier "UChar32" is undefined	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	203009	
Error (active)	E0020	identifier "UChar" is undefined	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	203024	
Error (active)	E0029	expected an expression	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	203031	
Error (active)	E0031	expression must have integral type	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	203031	
Error (active)	E0020	identifier "UBRK_WORD" is undefined	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	203053	
Error (active)	E0020	identifier "UChar32" is undefined	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	203094	
Error (active)	E0020	identifier "UBRK_DONE" is undefined	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	203098	
Error (active)	E0020	identifier "UErrorCode" is undefined	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	203115	
Error (active)	E0020	identifier "U_ZERO_ERROR" is undefined	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	203115	
Error	C1083	Cannot open include file: 'unicode/utypes.h': No such file or directory	sqlite3mc_dllicu	C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c	202381

utelle May 13, 2022
Maintainer

LIBICU_PATH / LIBICUPATH

I imagine one of these was a typo

Yes, you are right. Sorry for the confusion. LIBICU_PATH is the required value.

You can verify the correct setting from within Visual Studio by opening the properties dialog

(the screenshot is from the 32-bit configuration, but that for the 64-bit configuration looks the same)

and then click on edit for the entry C/C++ - General - Additional Include Directories. The popup dialog shows the paths searched for header files and their evaluated values:

Make sure that the evaluated values are correct.

I've added the archive's files to the folder set in the step above.

You need to extract the complete ICU archive. On your hard disk you should see a similar structure as the following:

You may ignore the bin and lib folders - they are related to the 32-bit ICU version.

That didn't work so I also copied the include\unicode folder to, uh, every other folder in there. Regardless, the compiler still couldn't find the files.

Well, just extracting the complete ICU archive and setting the environment variable LIBICU_PATH correctly should be enough.

Qriist · 2022-05-13T07:59:00Z

Qriist
May 13, 2022
Author

Apparently I needed to reboot... that fixed whatever the enviornment issue was.

Couple warnings but otherwise successful:

Rebuild started...
1>------ Rebuild All started: Project: sqlite3mc_dllicu, Configuration: Release Win64 x64 ------
1>sqlite3mc.c
1>C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c(202963,24): warning C4267: '=': conversion from 'size_t' to 'int', possible loss of data
1>C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c(203019,20): warning C4267: '=': conversion from 'size_t' to 'int', possible loss of data
1>   Creating library ..\bin\vc17\dll\release\sqlite3mc_icu_x64.lib and object ..\bin\vc17\dll\release\sqlite3mc_icu_x64.exp
1>sqlite3mc_vc17_dllicu.vcxproj -> C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\bin\vc17\dll\release\sqlite3mc_icu_x64.dll
1>Done building project "sqlite3mc_vc17_dllicu.vcxproj".
========== Rebuild All: 1 succeeded, 0 failed, 0 skipped ==========

Thanks again!

1 reply

utelle May 13, 2022
Maintainer

Apparently I needed to reboot... that fixed whatever the enviornment issue was.

Usually, restarting Visual Studio should be enough, but with Windows one never knows ...

Couple warnings but otherwise successful:

1>C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c(202963,24): warning C4267: '=': conversion from 'size_t' to 'int', possible loss of data
1>C:\Users\Qriist\source\repos\SQLite3MultipleCiphers\src\sqlite3patched.c(203019,20): warning C4267: '=': conversion from 'size_t' to 'int', possible loss of data

These warnings are related to the SQLite ICU extension. However, you can safely ignore them (unless you intend to handle input strings with a length > 2 GB).

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

How do I build with unicode support? Using Visual Studio 2022 #78

{{title}}

Replies: 2 comments 3 replies

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

Select a reply

How do I build with unicode support? Using Visual Studio 2022 #78

Qriist May 12, 2022

Replies: 2 comments · 3 replies

utelle May 12, 2022 Maintainer

Qriist May 13, 2022 Author

utelle May 13, 2022 Maintainer

Qriist May 13, 2022 Author

utelle May 13, 2022 Maintainer

Qriist
May 12, 2022

Replies: 2 comments 3 replies

utelle
May 12, 2022
Maintainer

Qriist May 13, 2022
Author

utelle May 13, 2022
Maintainer

Qriist
May 13, 2022
Author

utelle May 13, 2022
Maintainer