sarmad asghar   •   6 months ago

Issue in building data flow flex template in python on windows

I was following the steps provided at:

https://github.com/GoogleCloudPlatform/python-docs-samples/tree/main

while building the streaming beam data flow flex template by issuing the command:

python -m requirements.txt

I am getting errors[complete log not attached]:
[...................................................................................
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- System processor: AMD64
-- Performing Test CXX_SUPPORTS_AVX2
-- Performing Test CXX_SUPPORTS_AVX2 - Success
-- Performing Test CXX_SUPPORTS_AVX512
-- Performing Test CXX_SUPPORTS_AVX512 - Failed
-- Arrow build warning level: PRODUCTION
Configured for RELEASE build (set with cmake -DCMAKE_BUILD_TYPE={release,debug,...})
-- Build Type: RELEASE
-- Generator: Visual Studio 15 2017 Win64
-- Build output directory: C:/Users/sarmad/AppData/Local/Temp/pip-install-o2lgfuqi/pyarrow_ed8f95562cbd4c5382d633200e42c78a/build/temp.win-amd64-cpython-311/
-- Found Python3: C:\python-docs-samples-main\env\Scripts\python.exe (found version "3.11.4") found components: Interpreter Development NumPy
-- Found Python3Alt: C:\python-docs-samples-main\env\Scripts\python.exe
CMake Warning (dev) at C:/Program Files/CMake/share/cmake-3.17/Modules/FindPackageHandleStandardArgs.cmake:272 (message):
The package name passed to `find_package_handle_standard_args` (PkgConfig)
does not match the name of the calling package (Arrow). This can lead to
problems in calling code that expects `find_package` result variables
(e.g., `_FOUND`) to follow a certain pattern.
Call Stack (most recent call first):
C:/Program Files/CMake/share/cmake-3.17/Modules/FindPkgConfig.cmake:45 (find_package_handle_standard_args)
cmake_modules/FindArrow.cmake:39 (include)
cmake_modules/FindArrowPython.cmake:46 (find_package)
CMakeLists.txt:229 (find_package)
This warning is for project developers. Use -Wno-dev to suppress it.

-- Could NOT find PkgConfig (missing: PKG_CONFIG_EXECUTABLE)
-- Could NOT find Arrow (missing: Arrow_DIR)
CMake Error at C:/Program Files/CMake/share/cmake-3.17/Modules/FindPackageHandleStandardArgs.cmake:164 (message):
Could NOT find Arrow (missing: ARROW_INCLUDE_DIR ARROW_LIB_DIR
ARROW_FULL_SO_VERSION ARROW_SO_VERSION)
Call Stack (most recent call first):
C:/Program Files/CMake/share/cmake-3.17/Modules/FindPackageHandleStandardArgs.cmake:445 (_FPHSA_FAILURE_MESSAGE)
cmake_modules/FindArrow.cmake:450 (find_package_handle_standard_args)
cmake_modules/FindArrowPython.cmake:46 (find_package)
CMakeLists.txt:229 (find_package)

-- Configuring incomplete, errors occurred!
See also "C:/Users/sarmad/AppData/Local/Temp/pip-install-o2lgfuqi/pyarrow_ed8f95562cbd4c5382d633200e42c78a/build/temp.win-amd64-cpython-311/CMakeFiles/CMakeOutput.log".
See also "C:/Users/sarmad/AppData/Local/Temp/pip-install-o2lgfuqi/pyarrow_ed8f95562cbd4c5382d633200e42c78a/build/temp.win-amd64-cpython-311/CMakeFiles/CMakeError.log".
error: command 'C:\\Program Files\\CMake\\bin\\cmake.exe' failed with exit code 1
[end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for pyarrow
Building wheel for apache-beam (setup.py) ... done
Created wheel for apache-beam: filename=apache_beam-2.41.0-py3-none-any.whl size=2829718 sha256=1bb0273f1ba7b99622ce8a4812a365e9d77b3c8997c6bd4634f49a158236d59d
Stored in directory: c:\users\sarmad\appdata\local\pip\cache\wheels\ec\69\b0\955e07ec063b8b0fd35f7d4d23fd13a577f0c30ba52eebe51f
Building wheel for docopt (setup.py) ... done
Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13775 sha256=ddd6f2bc87c8e908f5952cd204a618bf774d9c618b33422018b88102eedc7e99
Stored in directory: c:\users\sarmad\appdata\local\pip\cache\wheels\1a\b0\8c\4b75c4116c31f83c8f9f047231251e13cc74481cca4a78a9ce
Successfully built crcmod dill google-apitools apache-beam docopt
Failed to build numpy pyarrow
ERROR: Could not build wheels for numpy, pyarrow, which is required to install pyproject.toml-based projects