From 4217fee510d4c592d3e45564d3ee116ae301189f Mon Sep 17 00:00:00 2001 From: Billy O'Neal Date: Wed, 17 Aug 2022 16:44:51 -0700 Subject: [PATCH] Update Windows VMs for Patch Tuesday August 2022 (#26283) MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit * Install haskell-stack with apt instead of piping a sh. * Update pools. * Linux is exploding for some reason. I just found out it is getting created with a 30GB disk I'm guessing may be involved. Did not wait for x64_windows_static_md to finish because enough was already on the floor. PASSING, REMOVE FROM FAIL LIST: angle:arm-uwp (C:\a\2\s\scripts\azure-pipelines/../ci.baseline.txt). PASSING, REMOVE FROM FAIL LIST: angle:arm64-windows (C:\a\1\s\scripts\azure-pipelines/../ci.baseline.txt). PASSING, REMOVE FROM FAIL LIST: angle:x64-uwp (C:\a\2\s\scripts\azure-pipelines/../ci.baseline.txt). PASSING, REMOVE FROM FAIL LIST: angle:x64-windows (C:\a\2\s\scripts\azure-pipelines/../ci.baseline.txt). PASSING, REMOVE FROM FAIL LIST: angle:x64-windows-static (C:\a\2\s\scripts\azure-pipelines/../ci.baseline.txt). PASSING, REMOVE FROM FAIL LIST: angle:x86-windows (C:\a\2\s\scripts\azure-pipelines/../ci.baseline.txt). PASSING, REMOVE FROM FAIL LIST: qtwebengine:x64-windows (C:\a\1\s\scripts\azure-pipelines/../ci.baseline.txt). PASSING, REMOVE FROM FAIL LIST: qtwebengine:x64-windows (C:\a\2\s\scripts\azure-pipelines/../ci.baseline.txt). PASSING, REMOVE FROM FAIL LIST: qtwebengine:x64-windows (C:\a\2\s\scripts\azure-pipelines/../ci.baseline.txt). PASSING, REMOVE FROM FAIL LIST: qtwebengine:x64-windows (C:\a\2\s\scripts\azure-pipelines/../ci.baseline.txt). PASSING, REMOVE FROM FAIL LIST: qtwebengine:x64-windows (C:\a\2\s\scripts\azure-pipelines/../ci.baseline.txt). PASSING, REMOVE FROM FAIL LIST: qtwebengine:x64-windows (C:\a\2\s\scripts\azure-pipelines/../ci.baseline.txt). PASSING, REMOVE FROM FAIL LIST: rsocket:x64-windows (C:\a\2\s\scripts\azure-pipelines/../ci.baseline.txt). PASSING, REMOVE FROM FAIL LIST: rsocket:x64-windows-static (C:\a\2\s\scripts\azure-pipelines/../ci.baseline.txt). REGRESSION: gazebo:x64-windows failed with BUILD_FAILED. If expected, add gazebo:x64-windows=fail to C:\a\2\s\scripts\azure-pipelines/../ci.baseline.txt. ``` D:\installed\x64-windows\include\dart/common/detail/Signal.hpp(87): error C2275: 'dart::common::Signal<_Res(_ArgTypes...),Combiner>::ConnectionBodyType': expected an expression instead of a type D:\installed\x64-windows\include\dart/common/detail/Signal.hpp(87): error C2923: 'std::shared_ptr': 'dart::common::Signal<_Res(_ArgTypes...),Combiner>::ConnectionBodyType' is not a valid template type argument for parameter '_Ty' D:\installed\x64-windows\include\dart/common/detail/Signal.hpp(87): note: see declaration of 'dart::common::Signal<_Res(_ArgTypes...),Combiner>::ConnectionBodyType' D:\installed\x64-windows\include\dart/common/detail/Signal.hpp(87): error C2955: 'std::shared_ptr': use of class template requires template argument list ``` We have been seeing intermittent failures in gazebo:x64-windows and I think this just repro'd that... REGRESSION: graphicsmagick:x64-windows failed with BUILD_FAILED. If expected, add graphicsmagick:x64-windows=fail to C:\a\2\s\scripts\azure-pipelines/../ci.baseline.txt. REGRESSION: graphicsmagick:x64-windows-static failed with BUILD_FAILED. If expected, add graphicsmagick:x64-windows-static=fail to C:\a\2\s\scripts\azure-pipelines/../ci.baseline.txt. REGRESSION: graphicsmagick:x86-windows failed with BUILD_FAILED. If expected, add graphicsmagick:x86-windows=fail to C:\a\2\s\scripts\azure-pipelines/../ci.baseline.txt. ``` D:\buildtrees\graphicsmagick\src\2e465a2909-adf106de54.clean\magick/nt_base.h(95): warning C4005: 'HAVE_FT2BUILD_H': macro redefinition D:\buildtrees\graphicsmagick\src\2e465a2909-adf106de54.clean\magick/magick_config.h(123): note: see previous definition of 'HAVE_FT2BUILD_H' D:\buildtrees\graphicsmagick\src\2e465a2909-adf106de54.clean\magick\effect.c(689) : fatal error C1001: Internal compiler error. (compiler file 'D:\a\_work\1\s\src\vctools\Compiler\Utc\src\p2\main.c', line 224) To work around this problem, try simplifying or changing the program near the locations listed above. If possible please provide a repro here: https://developercommunity.visualstudio.com Please choose the Technical Support command on the Visual C++ Help menu, or open the Technical Support help file for more information cl!RaiseException()+0x6c cl!RaiseException()+0x6c cl!DllGetObjHandler()+0xdb94f cl!DllGetObjHandler()+0x1ac555 ``` 😭 REGRESSION: mathgl:x64-windows failed with POST_BUILD_CHECKS_FAILED. If expected, add mathgl:x64-windows=fail to C:\a\2\s\scripts\azure-pipelines/../ci.baseline.txt. REGRESSION: mathgl:x64-windows-static failed with POST_BUILD_CHECKS_FAILED. If expected, add mathgl:x64-windows-static=fail to C:\a\2\s\scripts\azure-pipelines/../ci.baseline.txt. REGRESSION: mathgl:x86-windows failed with POST_BUILD_CHECKS_FAILED. If expected, add mathgl:x86-windows=fail to C:\a\2\s\scripts\azure-pipelines/../ci.baseline.txt. ``` -- Performing post-build validation The following files contain an absolute path ('D:\packages\mathgl_x64-windows', 'D:\installed', 'D:\buildtrees\mathgl'): D:\packages\mathgl_x64-windows\include\mgl2\config.h There should be no absolute paths in the installed package, only relative ones. Found 1 post-build check problem(s). To submit these ports to curated catalogs, please first correct the portfile: C:\a\2\s\ports\mathgl\portfile.cmake -- Performing post-build validation done error: building mathgl:x64-windows failed with: POST_BUILD_CHECKS_FAILED ``` @autoantwort REGRESSION: qtwebengine:arm64-windows failed with POST_BUILD_CHECKS_FAILED. If expected, add qtwebengine:arm64-windows=fail to C:\a\1\s\scripts\azure-pipelines/../ci.baseline.txt. ``` Building qtwebengine[core,default-features,geolocation,spellchecker,webchannel]:arm64-windows... -- Setting up python virtual environmnent... -- Installing python packages: html5lib -- Setting up python virtual environmnent...finished. CMake Warning at ports/qtwebengine/portfile.cmake:83 (message): Buildtree path 'D:/buildtrees/qtwebengine' is too long. Consider passing --x-buildtrees-root= to vcpkg! Trying to use 'D:/buildtrees/qtwebengine/../tmp' Call Stack (most recent call first): scripts/ports.cmake:147 (include) -- Using cached qtwebengine-everywhere-src-6.3.1.tar.xz. -- Cleaning sources at D:/buildtrees/tmp/src/here-src-6-367c283e50.clean. Use --editable to skip cleaning for the packages you specify. -- Extracting source D:/downloads/qtwebengine-everywhere-src-6.3.1.tar.xz -- Using source at D:/buildtrees/tmp/src/here-src-6-367c283e50.clean -- Found external ninja('1.10.2'). -- Configuring arm64-windows-dbg -- Configuring arm64-windows-rel CMake Warning at D:/installed/x64-windows/share/vcpkg-cmake/vcpkg_cmake_configure.cmake:302 (message): The following variables are not used in CMakeLists.txt: FEATURE_webengine_geolocation FEATURE_webengine_spellchecker FEATURE_webengine_v8_snapshot_support FEATURE_webengine_webchannel FEATURE_webengine_webrtc Please recheck them and remove the unnecessary options from the `vcpkg_cmake_configure` call. If these options should still be passed for whatever reason, please use the `MAYBE_UNUSED_VARIABLES` argument. Call Stack (most recent call first): D:/installed/arm64-windows/share/qtbase/qt_install_submodule.cmake:108 (vcpkg_cmake_configure) ports/qtwebengine/portfile.cmake:102 (qt_cmake_configure) scripts/ports.cmake:147 (include) -- Building arm64-windows-dbg -- Building arm64-windows-rel -- Installing: D:/packages/qtwebengine_arm64-windows/share/qtwebengine/copyright -- Performing post-build validation The folder /include is empty or not present. This indicates the library was not correctly installed. There should be no empty directories in D:\packages\qtwebengine_arm64-windows The following empty directories were found: ``` This was previously blocked by qtwebengine:x64-windows=fail. Will investigate... * Remove attempt to install extra stuff for scale set agents. * Turn on boot diagnostics. * Update pools. * Back out most Linux changes. * Analysis of https://dev.azure.com/vcpkg/public/_build/results?buildId=76482&view=results REGRESSION: graphicsmagick:x86-windows failed with BUILD_FAILED. If expected, add graphicsmagick:x86-windows=fail to C:\a\2\s\scripts\azure-pipelines/../ci.baseline.txt. Added this skip too. REGRESSION: gazebo:x64-windows failed with BUILD_FAILED. If expected, add gazebo:x64-windows=fail to C:\a\2\s\scripts\azure-pipelines/../ci.baseline.txt. ``` C:\PROGRA~1\MICROS~1\2022\ENTERP~1\VC\Tools\MSVC\1433~1.316\bin\Hostx64\x64\cl.exe /TP -DBOOST_ALL_DYN_LINK -DBOOST_ALL_NO_LIB -DBOOST_TEST_DYN_LINK -DBUILDING_DLL -DBUILDING_DLL_GZ_PHYSICS -DFREEIMAGE_LIB -DH5_BUILT_AS_DYNAMIC_LIB -DIGN_PROFILER_ENABLE=0 -DLIBBULLET_VERSION=3.21 -DLIBBULLET_VERSION_GT_282 -DNOMINMAX -DNOUSER -DPROTOBUF_USE_DLLS -DTINYXML2_DEBUG -DTINYXML2_IMPORT -DWIN32_LEAN_AND_MEAN -D_USE_MATH_DEFINES -DdIDEDOUBLE -Dgazebo_physics_EXPORTS -ID:\buildtrees\gazebo\src\46e867c51d-eba7a8151f.clean\test\gtest\include -ID:\buildtrees\gazebo\src\46e867c51d-eba7a8151f.clean -ID:\buildtrees\gazebo\x64-windows-dbg -ID:\installed\x64-windows\debug\..\include\libusb-1.0 -external:ID:\buildtrees\gazebo\src\46e867c51d-eba7a8151f.clean\deps\opende\include -external:ID:\installed\x64-windows\include -external:ID:\installed\x64-windows\debug\..\include -external:ID:\installed\x64-windows\include\ignition\msgs5 -external:ID:\installed\x64-windows\include\ignition\math6 -external:ID:\installed\x64-windows\include\ignition\transport8 -external:ID:\installed\x64-windows\include\ignition\common3 -external:ID:\installed\x64-windows\include\ignition\fuel_tools4 -external:ID:\installed\x64-windows\include\OGRE -external:ID:\installed\x64-windows\include\sdformat-9.8 -external:ID:\installed\x64-windows\include\bullet -external:ID:\installed\x64-windows\include\sdformat-9.8\sdf\.. -external:ID:\installed\x64-windows\include\ignition\cmake2 -external:ID:\installed\x64-windows\include\eigen3 -external:ID:\installed\x64-windows\share\urdfdom_headers\..\..\include -external:ID:\installed\x64-windows\include\urdfdom -external:ID:\installed\x64-windows\include\urdfdom_headers -external:W0 /nologo /DWIN32 /D_WINDOWS /W3 /utf-8 /GR /EHsc /MP /wd4005 /wd4068 /wd4244 /wd4251 /wd4267 /wd4275 /wd4996 /EHsc /D_DEBUG /MDd /Z7 /Ob0 /Od /RTC1 /EHsc -I"D:/installed/x64-windows/include" /Zc:__cplusplus /permissive- /Zc:strictStrings- /Zc:externC- -std:c++17 /showIncludes /Fogazebo\physics\CMakeFiles\gazebo_physics.dir\dart\DARTBoxShape.cc.obj /Fdgazebo\physics\CMakeFiles\gazebo_physics.dir\ /FS -c D:\buildtrees\gazebo\src\46e867c51d-eba7a8151f.clean\gazebo\physics\dart\DARTBoxShape.cc D:\installed\x64-windows\include\dart/common/detail/Signal.hpp(87): error C2275: 'dart::common::Signal<_Res(_ArgTypes...),Combiner>::ConnectionBodyType': expected an expression instead of a type D:\installed\x64-windows\include\dart/common/detail/Signal.hpp(87): error C2923: 'std::shared_ptr': 'dart::common::Signal<_Res(_ArgTypes...),Combiner>::ConnectionBodyType' is not a valid template type argument for parameter '_Ty' D:\installed\x64-windows\include\dart/common/detail/Signal.hpp(87): note: see declaration of 'dart::common::Signal<_Res(_ArgTypes...),Combiner>::ConnectionBodyType' D:\installed\x64-windows\include\dart/common/detail/Signal.hpp(87): error C2955: 'std::shared_ptr': use of class template requires template argument list C:\Program Files\Microsoft Visual Studio\2022\Enterprise\VC\Tools\MSVC\14.33.31629\include\memory(1493): note: see declaration of 'std::shared_ptr' D:\installed\x64-windows\include\dart/common/detail/Signal.hpp(87): error C2955: 'std::shared_ptr': use of class template requires template argument list C:\Program Files\Microsoft Visual Studio\2022\Enterprise\VC\Tools\MSVC\14.33.31629\include\memory(1493): note: see declaration of 'std::shared_ptr' D:\installed\x64-windows\include\dart/common/detail/Signal.hpp(182): error C2275: 'dart::common::Signal::ConnectionBodyType': expected an expression instead of a type D:\installed\x64-windows\include\dart/common/detail/Signal.hpp(182): error C2923: 'std::shared_ptr': 'dart::common::Signal::ConnectionBodyType' is not a valid template type argument for parameter '_Ty' D:\installed\x64-windows\include\dart/common/detail/Signal.hpp(182): note: see declaration of 'dart::common::Signal::ConnectionBodyType' D:\installed\x64-windows\include\dart/common/detail/Signal.hpp(182): error C2955: 'std::shared_ptr': use of class template requires template argument list C:\Program Files\Microsoft Visual Studio\2022\Enterprise\VC\Tools\MSVC\14.33.31629\include\memory(1493): note: see declaration of 'std::shared_ptr' D:\installed\x64-windows\include\dart/common/detail/Signal.hpp(182): error C2955: 'std::shared_ptr': use of class template requires template argument list C:\Program Files\Microsoft Visual Studio\2022\Enterprise\VC\Tools\MSVC\14.33.31629\include\memory(1493): note: see declaration of 'std::shared_ptr' ``` PASSING, REMOVE FROM FAIL LIST: luajit:arm64-windows (C:\a\2\s\scripts\azure-pipelines/../ci.baseline.txt). This was https://github.com/microsoft/vcpkg/pull/26360 REGRESSION: qtwebengine:arm64-windows failed with POST_BUILD_CHECKS_FAILED. If expected, add qtwebengine:arm64-windows=fail to C:\a\2\s\scripts\azure-pipelines/../ci.baseline.txt. This was previously blocked by x64-windows being skipped, so I'm just adding it to the baseline for now. --- scripts/azure-pipelines/azure-pipelines.yml | 2 +- scripts/azure-pipelines/linux/create-vmss.ps1 | 4 +++ .../azure-pipelines/linux/provision-image.sh | 7 +++--- .../azure-pipelines/windows/create-vmss.ps1 | 4 +++ scripts/ci.baseline.txt | 25 +++++++------------ 5 files changed, 22 insertions(+), 20 deletions(-) diff --git a/scripts/azure-pipelines/azure-pipelines.yml b/scripts/azure-pipelines/azure-pipelines.yml index 12e0354af7..d1db6ebf5b 100644 --- a/scripts/azure-pipelines/azure-pipelines.yml +++ b/scripts/azure-pipelines/azure-pipelines.yml @@ -2,7 +2,7 @@ # SPDX-License-Identifier: MIT # variables: - windows-pool: 'PrWin-2022-07-14' + windows-pool: 'PrWin-2022-08-10' linux-pool: 'PrLin-2022-07-14' osx-pool: 'PrOsx-2022-02-04' diff --git a/scripts/azure-pipelines/linux/create-vmss.ps1 b/scripts/azure-pipelines/linux/create-vmss.ps1 index cbbb9b5af8..54ed2142bb 100755 --- a/scripts/azure-pipelines/linux/create-vmss.ps1 +++ b/scripts/azure-pipelines/linux/create-vmss.ps1 @@ -98,6 +98,10 @@ $Vmss = Set-AzVmssStorageProfile ` -DiffDiskSetting Local ` -ImageReferenceId $Image.Id +$Vmss = Set-AzVmssBootDiagnostic ` + -VirtualMachineScaleSet $Vmss ` + -Enabled $true + New-AzVmss ` -ResourceGroupName $ResourceGroupName ` -Name $VmssName ` diff --git a/scripts/azure-pipelines/linux/provision-image.sh b/scripts/azure-pipelines/linux/provision-image.sh index 8c78f485f8..ce25aa10d7 100755 --- a/scripts/azure-pipelines/linux/provision-image.sh +++ b/scripts/azure-pipelines/linux/provision-image.sh @@ -66,14 +66,14 @@ APT_PACKAGES="$APT_PACKAGES libdbus-1-dev" # Additionally required by at-spi2-atk APT_PACKAGES="$APT_PACKAGES libxtst-dev" +# Additionally required by bond +APT_PACKAGES="$APT_PACKAGES haskell-stack" + # Additionally required/installed by Azure DevOps Scale Set Agents APT_PACKAGES="$APT_PACKAGES libkrb5-3 zlib1g libicu70" apt-get -y install $APT_PACKAGES -# Install the latest Haskell stack for bond -curl -sSL https://get.haskellstack.org/ | sh - # Start up cudnn update-nvidia-cudnn -d update-nvidia-cudnn -u @@ -89,6 +89,7 @@ apt-get install --no-install-recommends libnccl2 libnccl-dev # Install PowerShell wget -q https://packages.microsoft.com/config/ubuntu/20.04/packages-microsoft-prod.deb dpkg -i packages-microsoft-prod.deb +rm -f packages-microsoft-prod.deb apt-get update add-apt-repository universe apt-get install -y powershell diff --git a/scripts/azure-pipelines/windows/create-vmss.ps1 b/scripts/azure-pipelines/windows/create-vmss.ps1 index bf3586c84a..ea2a00a7f0 100644 --- a/scripts/azure-pipelines/windows/create-vmss.ps1 +++ b/scripts/azure-pipelines/windows/create-vmss.ps1 @@ -84,6 +84,10 @@ $Vmss = Set-AzVmssStorageProfile ` -DiffDiskSetting Local ` -ImageReferenceId $Image.Id +$Vmss = Set-AzVmssBootDiagnostic ` + -VirtualMachineScaleSet $Vmss ` + -Enabled $true + New-AzVmss ` -ResourceGroupName $ResourceGroupName ` -Name $VmssName ` diff --git a/scripts/ci.baseline.txt b/scripts/ci.baseline.txt index 92a5ac1c7a..d8db40c7c8 100644 --- a/scripts/ci.baseline.txt +++ b/scripts/ci.baseline.txt @@ -272,6 +272,8 @@ ftgl:arm-uwp=fail # https://github.com/GoogleCloudPlatform/functions-framework-cpp/issues/207 functions-framework-cpp:x64-uwp=fail +# VS 2022 Update 3 seems to have broken Gazebo: https://devdiv.visualstudio.com/DefaultCollection/DevDiv/_workitems/edit/1522474 +gazebo:x64-windows=fail gazebo:x64-linux=fail # gsoap does not offer stable public source downloads gsoap:x64-windows = skip @@ -323,6 +325,11 @@ gperftools:x64-uwp=fail gperftools:arm-uwp=fail graphicsmagick:arm-uwp=fail graphicsmagick:x64-uwp=fail +# graphicsmagick non-uwp trigger an ICE in VS 2022 17.3 https://devdiv.visualstudio.com/DefaultCollection/DevDiv/_workitems/edit/1557251 +graphicsmagick:x86-windows=fail +graphicsmagick:x64-windows=fail +graphicsmagick:x64-windows-static=fail +graphicsmagick:x64-windows-static-md=fail gstreamer:x64-osx=fail gstreamer:arm64-osx=fail gtk:x64-windows-static=fail @@ -881,6 +888,8 @@ qt5-canvas3d:x86-windows=skip qt5-wayland:x64-osx=fail qtwayland:x64-osx=fail qtwayland:arm64-osx=fail +# Post build checks fail +qtwebengine:arm64-windows=fail # Missing prerequisites for CI success qt5-webengine:x64-linux=fail qt5-webengine:x64-osx=fail @@ -890,8 +899,6 @@ qt5-webengine:x64-osx=fail # Succesful built requires protobuf to be installed after qt5-webengine not before. Otherwise the build picks up the wrong headers from inside vcpkg. qt5-webengine:x64-windows=skip qt5-webengine:x86-windows=skip -# VS2022 17.2 ICE https://developercommunity.visualstudio.com/t/Visual-Studio-2022-v1720-reports-fata/10039296 -qtwebengine:x64-windows=fail # Missing system libraries qt5-x11extras:x64-osx=fail qt5-x11extras:arm64-osx=fail @@ -980,10 +987,6 @@ rsasynccpp:x64-osx=fail rsm-binary-io:x64-linux=fail # Requires g++10 but CI compiler only has g++9 rsm-bsa:x64-linux=fail -# VS2022 17.2 ICE https://devdiv.visualstudio.com/DefaultCollection/DevDiv/_workitems/edit/1490389 -rsocket:x64-windows=fail -rsocket:x64-windows-static=fail -rsocket:x64-windows-static-md=fail rtlsdr:x64-uwp=fail rtlsdr:arm64-windows=fail rtlsdr:arm-uwp=fail @@ -1249,16 +1252,6 @@ zeroc-ice:arm64-windows=fail zeroc-ice:arm-uwp=fail zeroc-ice:x64-uwp=fail -# ANGLE triggers an intermittent ice in C1XX -# https://devdiv.visualstudio.com/DefaultCollection/DevDiv/_workitems/edit/1472813 -angle:x86-windows=fail -angle:x64-windows=fail -angle:x64-windows-static=fail -angle:x64-windows-static-md=fail -angle:x64-uwp=fail -angle:arm64-windows=fail -angle:arm-uwp=fail - cmake-user:arm-uwp=pass cmake-user:arm64-windows=pass cmake-user:x64-linux=pass