vldb镜像构建失败 #386

Repo-Zhuang · 2024-10-29T08:19:56Z

我在尝试构建vldb的测试镜像，都是无法成功，这似乎是连接问题，请问有什么办法解决吗

zhuang@zhuang-virtual-machine:~/workplace/scql$ sudo bash docker/build.sh -c -t vldb
+++ dirname docker/build.sh
++ cd docker
++ pwd
+ SCRIPT_DIR=/home/zhuang/workplace/scql/docker
++ cd /home/zhuang/workplace/scql/docker/..
++ pwd
+ WORK_DIR=/home/zhuang/workplace/scql
+ echo 'build image scql:vldb'
build image scql:vldb
+ MOUNT_OPTIONS=
+ true
+ '[' ubuntu == ubuntu ']'
+ MOUNT_OPTIONS='--mount type=volume,source=scql-ubuntu-buildcache,target=/root/.cache --mount type=volume,source=scql-ubuntu-go-buildcache,target=/usr/local/pkg/mod'
++ arch
+ MACHINE_TYPE=x86_64
+ HOST_PLATFORM=
+ '[' x86_64 == x86_64 ']'
+ HOST_PLATFORM=linux/amd64
+ '[' -z '' ']'
+ TARGET_PLATFORM=linux/amd64
+ BUILDER=secretflow/scql-ci:latest
+ '[' ubuntu == anolis ']'
++ docker run -it --rm --detach --mount type=bind,source=/home/zhuang/workplace/scql,target=/home/admin/dev/ -w /home/admin/dev --mount type=volume,source=scql-ubuntu-buildcache,target=/root/.cache --mount type=volume,source=scql-ubuntu-go-buildcache,target=/usr/local/pkg/mod secretflow/scql-ci:latest tail -f /dev/null
+ container_id=205d3b66619d00ea7eef3af9e445b860a88c05d0bfb87fcbaabbe1058a510365
+ trap 'docker stop 205d3b66619d00ea7eef3af9e445b860a88c05d0bfb87fcbaabbe1058a510365' EXIT
+ docker exec -it 205d3b66619d00ea7eef3af9e445b860a88c05d0bfb87fcbaabbe1058a510365 bash -c 'git config --global --add safe.directory /home/admin/dev'
+ docker exec -it 205d3b66619d00ea7eef3af9e445b860a88c05d0bfb87fcbaabbe1058a510365 bash -c 'cd /home/admin/dev && make binary'
rm -f bin/*
rm -f *.coverprofile
Found `go`
go: github.com/golang/mock/mockgen@v1.6.0: github.com/golang/mock/mockgen@v1.6.0: Get "https://proxy.golang.org/github.com/golang/mock/mockgen/@v/v1.6.0.info": dial tcp 142.250.69.209:443: connect: connection refused
make: *** [Makefile:85: GO-package] Error 1
+ docker stop 205d3b66619d00ea7eef3af9e445b860a88c05d0bfb87fcbaabbe1058a510365
205d3b66619d00ea7eef3af9e445b860a88c05d0bfb87fcbaabbe1058a510365

The text was updated successfully, but these errors were encountered:

wangzul · 2024-10-29T08:27:47Z

找到这一行代码bash -c 'cd /home/admin/dev && make binary'
修改为
bash -c 'export GOPROXY=https://goproxy.io,direct && cd /home/admin/dev && make binary' 后重新运行一次试试

Repo-Zhuang · 2024-10-29T08:39:28Z

谢谢，确实可以往下执行了，但是后续还是有3个connet的error

zhuang@zhuang-virtual-machine:~/workplace/scql$ sudo bash docker/build.sh -c -t vldb
+++ dirname docker/build.sh
++ cd docker
++ pwd
+ SCRIPT_DIR=/home/zhuang/workplace/scql/docker
++ cd /home/zhuang/workplace/scql/docker/..
++ pwd
+ WORK_DIR=/home/zhuang/workplace/scql
+ echo 'build image scql:vldb'
build image scql:vldb
+ MOUNT_OPTIONS=
+ true
+ '[' ubuntu == ubuntu ']'
+ MOUNT_OPTIONS='--mount type=volume,source=scql-ubuntu-buildcache,target=/root/.cache --mount type=volume,source=scql-ubuntu-go-buildcache,target=/usr/local/pkg/mod'
++ arch
+ MACHINE_TYPE=x86_64
+ HOST_PLATFORM=
+ '[' x86_64 == x86_64 ']'
+ HOST_PLATFORM=linux/amd64
+ '[' -z '' ']'
+ TARGET_PLATFORM=linux/amd64
+ BUILDER=secretflow/scql-ci:latest
+ '[' ubuntu == anolis ']'
++ docker run -it --rm --detach --mount type=bind,source=/home/zhuang/workplace/scql,target=/home/admin/dev/ -w /home/admin/dev --mount type=volume,source=scql-ubuntu-buildcache,target=/root/.cache --mount type=volume,source=scql-ubuntu-go-buildcache,target=/usr/local/pkg/mod secretflow/scql-ci:latest tail -f /dev/null
+ container_id=49f91fce323f1c620bb833ff887dbfd7d362ec67c91f33dae43eece3c1dfde17
+ trap 'docker stop 49f91fce323f1c620bb833ff887dbfd7d362ec67c91f33dae43eece3c1dfde17' EXIT
+ docker exec -it 49f91fce323f1c620bb833ff887dbfd7d362ec67c91f33dae43eece3c1dfde17 bash -c 'git config --global --add safe.directory /home/admin/dev'
+ docker exec -it 49f91fce323f1c620bb833ff887dbfd7d362ec67c91f33dae43eece3c1dfde17 bash -c 'export GOPROXY=https://goproxy.io,direct && cd /home/admin/dev && make binary'
rm -f bin/*
rm -f *.coverprofile
Found `go`
go fmt ./pkg/...
go vet -unsafeptr=false ./pkg/...
go generate ./pkg/...
go generate ./cmd/...
echo "Binary version: 0.8.0dev.20241029-08:36:51.131fd39"
Binary version: 0.8.0dev.20241029-08:36:51.131fd39
GOBIN=/home/admin/dev/bin go install -ldflags "-X main.version=0.8.0dev.20241029-08:36:51.131fd39" ./cmd/...
pip install numpy
Collecting numpy
  Using cached numpy-2.1.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (60 kB)
Using cached numpy-2.1.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (16.3 MB)
Installing collected packages: numpy
Successfully installed numpy-2.1.2
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
bazel build //engine/exe:scqlengine -c opt
Starting local Bazel server and connecting to it...
INFO: Repository spulib instantiated at:
  /home/admin/dev/WORKSPACE:19:10: in <toplevel>
  /home/admin/dev/bazel/repositories.bzl:19:16: in scql_deps
  /home/admin/dev/engine/bazel/engine_deps.bzl:31:21: in engine_deps
  /home/admin/dev/engine/bazel/engine_deps.bzl:48:10: in _secretflow_deps
  /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/bazel_tools/tools/build_defs/repo/utils.bzl:233:18: in maybe
Repository rule http_archive defined at:
  /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/bazel_tools/tools/build_defs/repo/http.bzl:372:31: in <toplevel>
WARNING: Download from https://github.com/secretflow/spu/archive/refs/tags/0.9.2dev20240711.tar.gz failed: class java.io.IOException connect timed out
ERROR: An error occurred during the fetch of repository 'spulib':
   Traceback (most recent call last):
        File "/root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/bazel_tools/tools/build_defs/repo/http.bzl", line 132, column 45, in _http_archive_impl
                download_info = ctx.download_and_extract(
Error in download_and_extract: java.io.IOException: Error downloading [https://github.com/secretflow/spu/archive/refs/tags/0.9.2dev20240711.tar.gz] to /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/spulib/temp2451789626662737419/0.9.2dev20240711.tar.gz: connect timed out
ERROR: /home/admin/dev/WORKSPACE:19:10: fetching http_archive rule //external:spulib: Traceback (most recent call last):
        File "/root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/bazel_tools/tools/build_defs/repo/http.bzl", line 132, column 45, in _http_archive_impl
                download_info = ctx.download_and_extract(
Error in download_and_extract: java.io.IOException: Error downloading [https://github.com/secretflow/spu/archive/refs/tags/0.9.2dev20240711.tar.gz] to /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/spulib/temp2451789626662737419/0.9.2dev20240711.tar.gz: connect timed out
ERROR: Error computing the main repository mapping: no such package '@spulib//bazel': java.io.IOException: Error downloading [https://github.com/secretflow/spu/archive/refs/tags/0.9.2dev20240711.tar.gz] to /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/spulib/temp2451789626662737419/0.9.2dev20240711.tar.gz: connect timed out
Loading: 
make: *** [Makefile:34: binary] Error 1
+ docker stop 49f91fce323f1c620bb833ff887dbfd7d362ec67c91f33dae43eece3c1dfde17

wangzul · 2024-10-29T08:47:47Z

找到这一行代码bash -c 'cd /home/admin/dev && make binary'
修改为
bash -c 'export GOPROXY=https://goproxy.io,direct && cd /home/admin/dev && make binary' 后重新运行一次试试

https://github.com/secretflow/spu/archive/refs/tags/0.9.2dev20240711.tar.gz

看起来是超时导致的
尝试手动拉取看一下能不能下下来wget https://github.com/secretflow/spu/archive/refs/tags/0.9.2dev20240711.tar.gz
如果拉的速度比较慢可以多次尝试在网络稳定的情况下构建

Repo-Zhuang · 2024-10-29T13:43:37Z

我ubuntu上的浏览器能访问和下载https://github.com/secretflow/spu/archive/refs/tags/0.9.2dev20240711.tar.gz，
但是终端上就wget不下来....
我现在已经下载好了，我需要把它解压到哪里呢

wangzul · 2024-10-30T02:08:54Z

找到这一行代码bash -c 'cd /home/admin/dev && make binary' 修改为 bash -c 'export GOPROXY=https://goproxy.io,direct && cd /home/admin/dev && make binary' 后重新运行一次试试

https://github.com/secretflow/spu/archive/refs/tags/0.9.2dev20240711.tar.gz

看起来是超时导致的尝试手动拉取看一下能不能下下来wget https://github.com/secretflow/spu/archive/refs/tags/0.9.2dev20240711.tar.gz 如果拉的速度比较慢可以多次尝试在网络稳定的情况下构建

尝试启动容器 docker start 49f91fce323f1c620bb833ff887dbfd7d362ec67c91f33dae43eece3c1dfde17 然后通过docker cp命令放到提示位置/root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/spulib/temp2451789626662737419/0.9.2dev20240711.tar.gz

jingshi-ant · 2024-10-30T02:25:54Z

网络问题的话，可以尝试使用-c选项，启用缓存（不用重复下载），并多次重试，看看是否有改善：bash docker/build.sh -c

Repo-Zhuang · 2024-10-30T08:29:49Z

你好，我尝试了很多次了，还是不行。。另外容器也启动不了，请问还有什么办法吗
zhuang@zhuang-virtual-machine:~/workplace/scql$ bash docker/build.sh -c -t vldb
+++ dirname docker/build.sh
++ cd docker
++ pwd

SCRIPT_DIR=/home/zhuang/workplace/scql/docker
++ cd /home/zhuang/workplace/scql/docker/..
++ pwd
WORK_DIR=/home/zhuang/workplace/scql
echo 'build image scql:vldb'
build image scql:vldb
MOUNT_OPTIONS=
true
'[' ubuntu == ubuntu ']'
MOUNT_OPTIONS='--mount type=volume,source=scql-ubuntu-buildcache,target=/root/.cache --mount type=volume,source=scql-ubuntu-go-buildcache,target=/usr/local/pkg/mod'
++ arch
MACHINE_TYPE=x86_64
HOST_PLATFORM=
'[' x86_64 == x86_64 ']'
HOST_PLATFORM=linux/amd64
'[' -z '' ']'
TARGET_PLATFORM=linux/amd64
BUILDER=secretflow/scql-ci:latest
'[' ubuntu == anolis ']'
++ docker run -it --rm --detach --mount type=bind,source=/home/zhuang/workplace/scql,target=/home/admin/dev/ -w /home/admin/dev --mount type=volume,source=scql-ubuntu-buildcache,target=/root/.cache --mount type=volume,source=scql-ubuntu-go-buildcache,target=/usr/local/pkg/mod secretflow/scql-ci:latest tail -f /dev/null
container_id=135bdc360c133bab5fce16e6155945b6dd7e3969e938ea8e006150f8ccf0248c
trap 'docker stop 135bdc360c133bab5fce16e6155945b6dd7e3969e938ea8e006150f8ccf0248c' EXIT
docker exec -it 135bdc360c133bab5fce16e6155945b6dd7e3969e938ea8e006150f8ccf0248c bash -c 'git config --global --add safe.directory /home/admin/dev'
docker exec -it 135bdc360c133bab5fce16e6155945b6dd7e3969e938ea8e006150f8ccf0248c bash -c 'export GOPROXY=https://goproxy.io,direct && cd /home/admin/dev && make binary'
rm -f bin/*
rm -f *.coverprofile
Found go
go fmt ./pkg/...
go vet -unsafeptr=false ./pkg/...
go generate ./pkg/...
go generate ./cmd/...
echo "Binary version: 0.8.0dev.20241030-08:25:21.131fd39"
Binary version: 0.8.0dev.20241030-08:25:21.131fd39
GOBIN=/home/admin/dev/bin go install -ldflags "-X main.version=0.8.0dev.20241030-08:25:21.131fd39" ./cmd/...
pip install numpy
Collecting numpy
Using cached numpy-2.1.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (60 kB)
Using cached numpy-2.1.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (16.3 MB)
Installing collected packages: numpy
Successfully installed numpy-2.1.2
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
bazel build //engine/exe:scqlengine -c opt
Starting local Bazel server and connecting to it...
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/xla/third_party/repo.bzl:132:14:
Warning: skipping import of repository 'llvm-raw' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/tsl/third_party/repo.bzl:132:14:
Warning: skipping import of repository 'com_google_absl' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/tsl/third_party/repo.bzl:132:14:
Warning: skipping import of repository 'pybind11_bazel' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/tsl/third_party/repo.bzl:132:14:
Warning: skipping import of repository 'com_google_protobuf' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/tsl/third_party/repo.bzl:132:14:
Warning: skipping import of repository 'com_google_googletest' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/tsl/third_party/repo.bzl:132:14:
Warning: skipping import of repository 'com_github_gflags_gflags' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/tsl/third_party/repo.bzl:132:14:
Warning: skipping import of repository 'com_github_grpc_grpc' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/tsl/third_party/repo.bzl:132:14:
Warning: skipping import of repository 'zlib' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/tsl/third_party/repo.bzl:132:14:
Warning: skipping import of repository 'nvtx_archive' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/tsl/third_party/repo.bzl:132:14:
Warning: skipping import of repository 'pybind11' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/tsl/third_party/repo.bzl:132:14:
Warning: skipping import of repository 'io_bazel_rules_go' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/tsl/third_party/repo.bzl:132:14:
Warning: skipping import of repository 'upb' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/xla/third_party/repo.bzl:132:14:
Warning: skipping import of repository 'jsoncpp_git' because it already exists.
INFO: Repository com_github_grpc_grpc instantiated at:
/home/admin/dev/WORKSPACE:40:9: in
/root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/psi/bazel/repositories.bzl:33:26: in psi_deps
/root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/psi/bazel/repositories.bzl:255:10: in _com_github_grpc_grpc
/root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/bazel_tools/tools/build_defs/repo/utils.bzl:233:18: in maybe
Repository rule http_archive defined at:
/root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/bazel_tools/tools/build_defs/repo/http.bzl:372:31: in
WARNING: Download from https://github.com/grpc/grpc/archive/refs/tags/v1.51.0.tar.gz failed: class java.io.IOException connect timed out
ERROR: An error occurred during the fetch of repository 'com_github_grpc_grpc':
Traceback (most recent call last):
File "/root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/bazel_tools/tools/build_defs/repo/http.bzl", line 132, column 45, in _http_archive_impl
download_info = ctx.download_and_extract(
Error in download_and_extract: java.io.IOException: Error downloading [https://github.com/grpc/grpc/archive/refs/tags/v1.51.0.tar.gz] to /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/com_github_grpc_grpc/temp14365323110428572330/v1.51.0.tar.gz: connect timed out
ERROR: /home/admin/dev/WORKSPACE:40:9: fetching http_archive rule //external:com_github_grpc_grpc: Traceback (most recent call last):
File "/root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/bazel_tools/tools/build_defs/repo/http.bzl", line 132, column 45, in _http_archive_impl
download_info = ctx.download_and_extract(
Error in download_and_extract: java.io.IOException: Error downloading [https://github.com/grpc/grpc/archive/refs/tags/v1.51.0.tar.gz] to /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/com_github_grpc_grpc/temp14365323110428572330/v1.51.0.tar.gz: connect timed out
ERROR: Error computing the main repository mapping: no such package '@com_github_grpc_grpc//bazel': java.io.IOException: Error downloading [https://github.com/grpc/grpc/archive/refs/tags/v1.51.0.tar.gz] to /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/com_github_grpc_grpc/temp14365323110428572330/v1.51.0.tar.gz: connect timed out
Loading:
make: *** [Makefile:34: binary] Error 1
docker stop 135bdc360c133bab5fce16e6155945b6dd7e3969e938ea8e006150f8ccf0248c
135bdc360c133bab5fce16e6155945b6dd7e3969e938ea8e006150f8ccf0248c
zhuang@zhuang-virtual-machine:~/workplace/scql$ docker start 135bdc360c133bab5fce16e6155945b6dd7e3969e938ea8e006150f8ccf0248c
Error response from daemon: No such container: 135bdc360c133bab5fce16e6155945b6dd7e3969e938ea8e006150f8ccf0248c
Error: failed to start containers: 135bdc360c133bab5fce16e6155945b6dd7e3969e938ea8e006150f8ccf0248c

wangzul · 2024-10-30T08:40:16Z

你好，我尝试了很多次了，还是不行。。另外容器也启动不了，请问还有什么办法吗 zhuang@zhuang-virtual-machine:~/workplace/scql$ bash docker/build.sh -c -t vldb +++ dirname docker/build.sh ++ cd docker ++ pwd

SCRIPT_DIR=/home/zhuang/workplace/scql/docker
++ cd /home/zhuang/workplace/scql/docker/..
++ pwd

WORK_DIR=/home/zhuang/workplace/scql

echo 'build image scql:vldb'
build image scql:vldb

MOUNT_OPTIONS=

true

'[' ubuntu == ubuntu ']'

MOUNT_OPTIONS='--mount type=volume,source=scql-ubuntu-buildcache,target=/root/.cache --mount type=volume,source=scql-ubuntu-go-buildcache,target=/usr/local/pkg/mod'
++ arch

MACHINE_TYPE=x86_64

HOST_PLATFORM=

'[' x86_64 == x86_64 ']'

HOST_PLATFORM=linux/amd64

'[' -z '' ']'

TARGET_PLATFORM=linux/amd64

BUILDER=secretflow/scql-ci:latest

'[' ubuntu == anolis ']'
++ docker run -it --rm --detach --mount type=bind,source=/home/zhuang/workplace/scql,target=/home/admin/dev/ -w /home/admin/dev --mount type=volume,source=scql-ubuntu-buildcache,target=/root/.cache --mount type=volume,source=scql-ubuntu-go-buildcache,target=/usr/local/pkg/mod secretflow/scql-ci:latest tail -f /dev/null

container_id=135bdc360c133bab5fce16e6155945b6dd7e3969e938ea8e006150f8ccf0248c

trap 'docker stop 135bdc360c133bab5fce16e6155945b6dd7e3969e938ea8e006150f8ccf0248c' EXIT

docker exec -it 135bdc360c133bab5fce16e6155945b6dd7e3969e938ea8e006150f8ccf0248c bash -c 'git config --global --add safe.directory /home/admin/dev'

docker exec -it 135bdc360c133bab5fce16e6155945b6dd7e3969e938ea8e006150f8ccf0248c bash -c 'export GOPROXY=https://goproxy.io,direct && cd /home/admin/dev && make binary'
rm -f bin/*
rm -f *.coverprofile
Found go
go fmt ./pkg/...
go vet -unsafeptr=false ./pkg/...
go generate ./pkg/...
go generate ./cmd/...
echo "Binary version: 0.8.0dev.20241030-08:25:21.131fd39"
Binary version: 0.8.0dev.20241030-08:25:21.131fd39
GOBIN=/home/admin/dev/bin go install -ldflags "-X main.version=0.8.0dev.20241030-08:25:21.131fd39" ./cmd/...
pip install numpy
Collecting numpy
Using cached numpy-2.1.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (60 kB)
Using cached numpy-2.1.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (16.3 MB)
Installing collected packages: numpy
Successfully installed numpy-2.1.2
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
bazel build //engine/exe:scqlengine -c opt
Starting local Bazel server and connecting to it...
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/xla/third_party/repo.bzl:132:14:
Warning: skipping import of repository 'llvm-raw' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/tsl/third_party/repo.bzl:132:14:
Warning: skipping import of repository 'com_google_absl' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/tsl/third_party/repo.bzl:132:14:
Warning: skipping import of repository 'pybind11_bazel' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/tsl/third_party/repo.bzl:132:14:
Warning: skipping import of repository 'com_google_protobuf' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/tsl/third_party/repo.bzl:132:14:
Warning: skipping import of repository 'com_google_googletest' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/tsl/third_party/repo.bzl:132:14:
Warning: skipping import of repository 'com_github_gflags_gflags' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/tsl/third_party/repo.bzl:132:14:
Warning: skipping import of repository 'com_github_grpc_grpc' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/tsl/third_party/repo.bzl:132:14:
Warning: skipping import of repository 'zlib' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/tsl/third_party/repo.bzl:132:14:
Warning: skipping import of repository 'nvtx_archive' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/tsl/third_party/repo.bzl:132:14:
Warning: skipping import of repository 'pybind11' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/tsl/third_party/repo.bzl:132:14:
Warning: skipping import of repository 'io_bazel_rules_go' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/tsl/third_party/repo.bzl:132:14:
Warning: skipping import of repository 'upb' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/xla/third_party/repo.bzl:132:14:
Warning: skipping import of repository 'jsoncpp_git' because it already exists.
INFO: Repository com_github_grpc_grpc instantiated at:
/home/admin/dev/WORKSPACE:40:9: in
/root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/psi/bazel/repositories.bzl:33:26: in psi_deps
/root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/psi/bazel/repositories.bzl:255:10: in _com_github_grpc_grpc
/root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/bazel_tools/tools/build_defs/repo/utils.bzl:233:18: in maybe
Repository rule http_archive defined at:
/root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/bazel_tools/tools/build_defs/repo/http.bzl:372:31: in
WARNING: Download from https://github.com/grpc/grpc/archive/refs/tags/v1.51.0.tar.gz failed: class java.io.IOException connect timed out
ERROR: An error occurred during the fetch of repository 'com_github_grpc_grpc':
Traceback (most recent call last):
File "/root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/bazel_tools/tools/build_defs/repo/http.bzl", line 132, column 45, in _http_archive_impl
download_info = ctx.download_and_extract(
Error in download_and_extract: java.io.IOException: Error downloading [https://github.com/grpc/grpc/archive/refs/tags/v1.51.0.tar.gz] to /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/com_github_grpc_grpc/temp14365323110428572330/v1.51.0.tar.gz: connect timed out
ERROR: /home/admin/dev/WORKSPACE:40:9: fetching http_archive rule //external:com_github_grpc_grpc: Traceback (most recent call last):
File "/root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/bazel_tools/tools/build_defs/repo/http.bzl", line 132, column 45, in _http_archive_impl
download_info = ctx.download_and_extract(
Error in download_and_extract: java.io.IOException: Error downloading [https://github.com/grpc/grpc/archive/refs/tags/v1.51.0.tar.gz] to /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/com_github_grpc_grpc/temp14365323110428572330/v1.51.0.tar.gz: connect timed out
ERROR: Error computing the main repository mapping: no such package '@com_github_grpc_grpc//bazel': java.io.IOException: Error downloading [https://github.com/grpc/grpc/archive/refs/tags/v1.51.0.tar.gz] to /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/com_github_grpc_grpc/temp14365323110428572330/v1.51.0.tar.gz: connect timed out
Loading:
make: *** [Makefile:34: binary] Error 1

docker stop 135bdc360c133bab5fce16e6155945b6dd7e3969e938ea8e006150f8ccf0248c
135bdc360c133bab5fce16e6155945b6dd7e3969e938ea8e006150f8ccf0248c
zhuang@zhuang-virtual-machine:~/workplace/scql$ docker start 135bdc360c133bab5fce16e6155945b6dd7e3969e938ea8e006150f8ccf0248c
Error response from daemon: No such container: 135bdc360c133bab5fce16e6155945b6dd7e3969e938ea8e006150f8ccf0248c
Error: failed to start containers: 135bdc360c133bab5fce16e6155945b6dd7e3969e938ea8e006150f8ccf0248c

网络问题暂时没有更好的办法。
启动容器是要做什么其他操作吗？

Repo-Zhuang · 2024-10-30T08:42:00Z

我想复现下https://github.com/secretflow/scql/tree/vldb2024/vldb 的工作

wangzul · 2024-10-30T08:58:37Z

我想复现下https://github.com/secretflow/scql/tree/vldb2024/vldb 的工作

container_id=SCQL-vidb
if docker ps -a --filter "name=$container_id" -q; then
#存在则重启容器防止容器处于stop状态
docker restart '$container_id'
else
#删除--rm
docker run -idt --name '$container_id' --detach
--mount type=bind,source="${WORK_DIR}",target=/home/admin/dev/
-w /home/admin/dev ${MOUNT_OPTIONS}
$BUILDER tail -f /dev/null
fi
#container_id=$(docker run -it --rm --detach \

--mount type=bind,source="${WORK_DIR}",target=/home/admin/dev/ \

-w /home/admin/dev ${MOUNT_OPTIONS} \

$BUILDER tail -f /dev/null)

#trap "docker stop ${container_id}" EXIT
替换尝试一下

Repo-Zhuang · 2024-10-30T09:51:18Z

你好，我修改了build.sh后能启动容器了,我现在是用docker cp 将这三个下载不了的包放到提示位置吗

zhuang@zhuang-virtual-machine:~/workplace/scql/docker$ bash build.sh -c -t vldb
+++ dirname build.sh
++ cd .
++ pwd
+ SCRIPT_DIR=/home/zhuang/workplace/scql/docker
++ cd /home/zhuang/workplace/scql/docker/..
++ pwd
+ WORK_DIR=/home/zhuang/workplace/scql
+ echo 'build image scql:vldb'
build image scql:vldb
+ MOUNT_OPTIONS=
+ true
+ '[' ubuntu == ubuntu ']'
+ MOUNT_OPTIONS='--mount type=volume,source=scql-ubuntu-buildcache,target=/root/.cache --mount type=volume,source=scql-ubuntu-go-buildcache,target=/usr/local/pkg/mod'
++ arch
+ MACHINE_TYPE=x86_64
+ HOST_PLATFORM=
+ '[' x86_64 == x86_64 ']'
+ HOST_PLATFORM=linux/amd64
+ '[' -z '' ']'
+ TARGET_PLATFORM=linux/amd64
+ BUILDER=secretflow/scql-ci:latest
+ '[' ubuntu == anolis ']'
+ container_id=SCQL-vldb
+ docker run -idt --name SCQL-vldb --detach --mount type=bind,source=/home/zhuang/workplace/scql,target=/home/admin/dev/ -w /home/admin/dev --mount type=volume,source=scql-ubuntu-buildcache,target=/root/.cache --mount type=volume,source=scql-ubuntu-go-buildcache,target=/usr/local/pkg/mod secretflow/scql-ci:latest tail -f /dev/null
9e90d1379840e3963d0b2853fc09b67445e135ed4a36b77665b7febbbfa11b23
+ docker exec -it SCQL-vldb bash -c 'git config --global --add safe.directory /home/admin/dev'
+ docker exec -it SCQL-vldb bash -c 'export GOPROXY=https://goproxy.io,direct && cd /home/admin/dev && make binary'
rm -f bin/*
rm -f *.coverprofile
Found `go`
go fmt ./pkg/...
go vet -unsafeptr=false ./pkg/...
go generate ./pkg/...
go generate ./cmd/...
echo "Binary version: 0.8.0dev.20241030-09:43:43.131fd39"
Binary version: 0.8.0dev.20241030-09:43:43.131fd39
GOBIN=/home/admin/dev/bin go install -ldflags "-X main.version=0.8.0dev.20241030-09:43:43.131fd39" ./cmd/...
pip install numpy
Collecting numpy
  Using cached numpy-2.1.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (60 kB)
Using cached numpy-2.1.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (16.3 MB)
Installing collected packages: numpy
Successfully installed numpy-2.1.2
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
bazel build //engine/exe:scqlengine -c opt
Starting local Bazel server and connecting to it...
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/xla/third_party/repo.bzl:132:14: 
Warning: skipping import of repository 'llvm-raw' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/tsl/third_party/repo.bzl:132:14: 
Warning: skipping import of repository 'com_google_absl' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/tsl/third_party/repo.bzl:132:14: 
Warning: skipping import of repository 'pybind11_bazel' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/tsl/third_party/repo.bzl:132:14: 
Warning: skipping import of repository 'com_google_protobuf' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/tsl/third_party/repo.bzl:132:14: 
Warning: skipping import of repository 'com_google_googletest' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/tsl/third_party/repo.bzl:132:14: 
Warning: skipping import of repository 'com_github_gflags_gflags' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/tsl/third_party/repo.bzl:132:14: 
Warning: skipping import of repository 'com_github_grpc_grpc' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/tsl/third_party/repo.bzl:132:14: 
Warning: skipping import of repository 'zlib' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/tsl/third_party/repo.bzl:132:14: 
Warning: skipping import of repository 'nvtx_archive' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/tsl/third_party/repo.bzl:132:14: 
Warning: skipping import of repository 'pybind11' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/tsl/third_party/repo.bzl:132:14: 
Warning: skipping import of repository 'io_bazel_rules_go' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/tsl/third_party/repo.bzl:132:14: 
Warning: skipping import of repository 'upb' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/xla/third_party/repo.bzl:132:14: 
Warning: skipping import of repository 'jsoncpp_git' because it already exists.
INFO: Repository com_github_grpc_grpc instantiated at:
  /home/admin/dev/WORKSPACE:40:9: in <toplevel>
  /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/psi/bazel/repositories.bzl:33:26: in psi_deps
  /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/psi/bazel/repositories.bzl:255:10: in _com_github_grpc_grpc
  /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/bazel_tools/tools/build_defs/repo/utils.bzl:233:18: in maybe
Repository rule http_archive defined at:
  /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/bazel_tools/tools/build_defs/repo/http.bzl:372:31: in <toplevel>
WARNING: Download from https://github.com/grpc/grpc/archive/refs/tags/v1.51.0.tar.gz failed: class java.io.IOException connect timed out
ERROR: An error occurred during the fetch of repository 'com_github_grpc_grpc':
   Traceback (most recent call last):
        File "/root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/bazel_tools/tools/build_defs/repo/http.bzl", line 132, column 45, in _http_archive_impl
                download_info = ctx.download_and_extract(
Error in download_and_extract: java.io.IOException: Error downloading [https://github.com/grpc/grpc/archive/refs/tags/v1.51.0.tar.gz] to /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/com_github_grpc_grpc/temp13737650969005721233/v1.51.0.tar.gz: connect timed out
ERROR: /home/admin/dev/WORKSPACE:40:9: fetching http_archive rule //external:com_github_grpc_grpc: Traceback (most recent call last):
        File "/root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/bazel_tools/tools/build_defs/repo/http.bzl", line 132, column 45, in _http_archive_impl
                download_info = ctx.download_and_extract(
Error in download_and_extract: java.io.IOException: Error downloading [https://github.com/grpc/grpc/archive/refs/tags/v1.51.0.tar.gz] to /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/com_github_grpc_grpc/temp13737650969005721233/v1.51.0.tar.gz: connect timed out
ERROR: Error computing the main repository mapping: no such package '@com_github_grpc_grpc//bazel': java.io.IOException: Error downloading [https://github.com/grpc/grpc/archive/refs/tags/v1.51.0.tar.gz] to /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/com_github_grpc_grpc/temp13737650969005721233/v1.51.0.tar.gz: connect timed out
Loading: 
make: *** [Makefile:34: binary] Error 1
zhuang@zhuang-virtual-machine:~/workplace/scql/docker$ docker ps
CONTAINER ID   IMAGE                       COMMAND                   CREATED              STATUS                          PORTS                                                  NAMES
9e90d1379840   secretflow/scql-ci:latest   "/bin/bash -lc tail …"   About a minute ago   Up About a minute                                                                      SCQL-vldb
d98106383f43   mysql                       "docker-entrypoint.s…"   2 hours ago          Up 2 hours                      0.0.0.0:3306->3306/tcp, :::3306->3306/tcp, 33060/tcp   p2p-tutorial-mysql-1
6f9358094161   secretflow/scql:latest      "/home/admin/bin/bro…"   2 hours ago          Restarting (1) 33 seconds ago                                                          p2p-tutorial-broker_alice-1
4c47d79e30e0   secretflow/scql:latest      "/home/admin/bin/bro…"   2 hours ago          Restarting (1) 4 seconds ago                                                           p2p-tutorial-broker_bob-1
8fa3b494efc1   secretflow/scql:latest      "/home/admin/bin/scq…"   21 hours ago         Up 2 hours                                                                             p2p-tutorial-engine_alice-1
b06d42443412   secretflow/scql:latest      "/home/admin/bin/scq…"   21 hours ago         Up 21 hours                                                                            p2p-tutorial-engine_bob-1

后续跟着教程执行到docker compose -p vldb up -d好像也是网络问题

docker compose -p vldb up -d
WARN[0000] /home/zhuang/workplace/scql/vldb/docker-compose/docker-compose.yml: the attribute `version` is obsolete, it will be ignored, please remove it to avoid potential confusion 
[+] Running 4/4
 ✘ engine_bob Error   Get "https://registry-1.docker.io/v2/": dial tcp 69.63.184.30:443: connect: connection refused                                                                                                                       20.3s 
 ✘ broker_alice Error context canceled                                                                                                                                                                                                     20.3s 
 ✘ broker_bob Error   context canceled                                                                                                                                                                                                     20.3s 
 ✘ engine_alice Error context canceled                                                                                                                                                                                                     20.3s 
Error response from daemon: Get "https://registry-1.docker.io/v2/": dial tcp 69.63.184.30:443: connect: connection refused

jingshi-ant · 2024-10-30T11:14:52Z

镜像没有build成功，是不能docker compose成功的，后续步骤依赖你build出的镜像。
建议多次尝试sudo bash docker/build.sh -c -t vldb到执行成功，如果网络不行导致无法成功，可以考虑换机器重试。

Repo-Zhuang · 2024-11-01T14:19:36Z

试了很多次还是不行。。如果只是想测试下shuffle和sort协议，还有其他的方式吗

zhuang@zhuang-virtual-machine:~/workplace/scql$ bash docker/build.sh -c -t vldb
+++ dirname docker/build.sh
++ cd docker
++ pwd
+ SCRIPT_DIR=/home/zhuang/workplace/scql/docker
++ cd /home/zhuang/workplace/scql/docker/..
++ pwd
+ WORK_DIR=/home/zhuang/workplace/scql
+ echo 'build image scql:vldb'
build image scql:vldb
+ MOUNT_OPTIONS=
+ true
+ '[' ubuntu == ubuntu ']'
+ MOUNT_OPTIONS='--mount type=volume,source=scql-ubuntu-buildcache,target=/root/.cache --mount type=volume,source=scql-ubuntu-go-buildcache,target=/usr/local/pkg/mod'
++ arch
+ MACHINE_TYPE=x86_64
+ HOST_PLATFORM=
+ '[' x86_64 == x86_64 ']'
+ HOST_PLATFORM=linux/amd64
+ '[' -z '' ']'
+ TARGET_PLATFORM=linux/amd64
+ BUILDER=secretflow/scql-ci:latest
+ '[' ubuntu == anolis ']'
++ docker run -it --rm --detach --mount type=bind,source=/home/zhuang/workplace/scql,target=/home/admin/dev/ -w /home/admin/dev --mount type=volume,source=scql-ubuntu-buildcache,target=/root/.cache --mount type=volume,source=scql-ubuntu-go-buildcache,target=/usr/local/pkg/mod secretflow/scql-ci:latest tail -f /dev/null
+ container_id=05c1dc550f948e979fd9354e0dd44baad55da5c0cf6d05b809787d70a24092ed
+ trap 'docker stop 05c1dc550f948e979fd9354e0dd44baad55da5c0cf6d05b809787d70a24092ed' EXIT
+ docker exec -it 05c1dc550f948e979fd9354e0dd44baad55da5c0cf6d05b809787d70a24092ed bash -c 'git config --global --add safe.directory /home/admin/dev'
+ docker exec -it 05c1dc550f948e979fd9354e0dd44baad55da5c0cf6d05b809787d70a24092ed bash -c 'export GOPROXY=https://goproxy.io,direct && cd /home/admin/dev && make binary'
rm -f bin/*
rm -f *.coverprofile
Found `go`
go fmt ./pkg/...
go vet -unsafeptr=false ./pkg/...
go generate ./pkg/...
go generate ./cmd/...
echo "Binary version: 0.8.0dev.20241101-13:44:44.131fd39"
Binary version: 0.8.0dev.20241101-13:44:44.131fd39
GOBIN=/home/admin/dev/bin go install -ldflags "-X main.version=0.8.0dev.20241101-13:44:44.131fd39" ./cmd/...
pip install numpy
Collecting numpy
  Using cached numpy-2.1.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (60 kB)
Using cached numpy-2.1.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (16.3 MB)
Installing collected packages: numpy
Successfully installed numpy-2.1.2
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
bazel build //engine/exe:scqlengine -c opt
Starting local Bazel server and connecting to it...
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/xla/third_party/repo.bzl:132:14: 
Warning: skipping import of repository 'llvm-raw' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/tsl/third_party/repo.bzl:132:14: 
Warning: skipping import of repository 'com_google_absl' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/tsl/third_party/repo.bzl:132:14: 
Warning: skipping import of repository 'pybind11_bazel' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/tsl/third_party/repo.bzl:132:14: 
Warning: skipping import of repository 'com_google_protobuf' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/tsl/third_party/repo.bzl:132:14: 
Warning: skipping import of repository 'com_google_googletest' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/tsl/third_party/repo.bzl:132:14: 
Warning: skipping import of repository 'com_github_gflags_gflags' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/tsl/third_party/repo.bzl:132:14: 
Warning: skipping import of repository 'com_github_grpc_grpc' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/tsl/third_party/repo.bzl:132:14: 
Warning: skipping import of repository 'zlib' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/tsl/third_party/repo.bzl:132:14: 
Warning: skipping import of repository 'nvtx_archive' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/tsl/third_party/repo.bzl:132:14: 
Warning: skipping import of repository 'pybind11' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/tsl/third_party/repo.bzl:132:14: 
Warning: skipping import of repository 'io_bazel_rules_go' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/tsl/third_party/repo.bzl:132:14: 
Warning: skipping import of repository 'upb' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/xla/third_party/repo.bzl:132:14: 
Warning: skipping import of repository 'jsoncpp_git' because it already exists.
INFO: Repository com_github_lz4_lz4 instantiated at:
  /home/admin/dev/WORKSPACE:19:10: in <toplevel>
  /home/admin/dev/bazel/repositories.bzl:19:16: in scql_deps
  /home/admin/dev/engine/bazel/engine_deps.bzl:30:24: in engine_deps
  /home/admin/dev/engine/bazel/engine_deps.bzl:221:10: in _com_github_lz4_lz4
  /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/bazel_tools/tools/build_defs/repo/utils.bzl:233:18: in maybe
Repository rule http_archive defined at:
  /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/bazel_tools/tools/build_defs/repo/http.bzl:372:31: in <toplevel>
WARNING: Download from https://codeload.github.com/lz4/lz4/tar.gz/refs/tags/v1.9.3 failed: class java.io.IOException connect timed out
ERROR: An error occurred during the fetch of repository 'com_github_lz4_lz4':
   Traceback (most recent call last):
        File "/root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/bazel_tools/tools/build_defs/repo/http.bzl", line 132, column 45, in _http_archive_impl
                download_info = ctx.download_and_extract(
Error in download_and_extract: java.io.IOException: Error downloading [https://codeload.github.com/lz4/lz4/tar.gz/refs/tags/v1.9.3] to /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/com_github_lz4_lz4/temp7981238054276312767/v1.9.3.tar.gz: connect timed out
ERROR: /home/admin/dev/WORKSPACE:19:10: fetching http_archive rule //external:com_github_lz4_lz4: Traceback (most recent call last):
        File "/root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/bazel_tools/tools/build_defs/repo/http.bzl", line 132, column 45, in _http_archive_impl
                download_info = ctx.download_and_extract(
Error in download_and_extract: java.io.IOException: Error downloading [https://codeload.github.com/lz4/lz4/tar.gz/refs/tags/v1.9.3] to /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/com_github_lz4_lz4/temp7981238054276312767/v1.9.3.tar.gz: connect timed out
INFO: Repository com_github_tencent_rapidjson instantiated at:
  /home/admin/dev/WORKSPACE:19:10: in <toplevel>
  /home/admin/dev/bazel/repositories.bzl:19:16: in scql_deps
  /home/admin/dev/engine/bazel/engine_deps.bzl:23:34: in engine_deps
  /home/admin/dev/engine/bazel/engine_deps.bzl:137:10: in _com_github_tencent_rapidjson
  /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/bazel_tools/tools/build_defs/repo/utils.bzl:233:18: in maybe
Repository rule http_archive defined at:
  /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/bazel_tools/tools/build_defs/repo/http.bzl:372:31: in <toplevel>
INFO: Repository com_github_greendow_hash_drbg instantiated at:
  /home/admin/dev/WORKSPACE:33:10: in <toplevel>
  /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/yacl/bazel/repositories.bzl:35:35: in yacl_deps
  /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/yacl/bazel/repositories.bzl:366:10: in _com_github_greendow_hash_drbg
  /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/bazel_tools/tools/build_defs/repo/utils.bzl:233:18: in maybe
Repository rule http_archive defined at:
  /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/bazel_tools/tools/build_defs/repo/http.bzl:372:31: in <toplevel>
INFO: Repository com_github_intel_ipp instantiated at:
  /home/admin/dev/WORKSPACE:40:9: in <toplevel>
  /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/psi/bazel/repositories.bzl:46:26: in psi_deps
  /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/psi/bazel/repositories.bzl:130:10: in _com_github_intel_ipp
  /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/bazel_tools/tools/build_defs/repo/utils.bzl:233:18: in maybe
Repository rule http_archive defined at:
  /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/bazel_tools/tools/build_defs/repo/http.bzl:372:31: in <toplevel>
ERROR: /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/org_apache_arrow/BUILD.bazel:110:11: @org_apache_arrow//:arrow depends on @com_github_lz4_lz4//:lz4 in repository @com_github_lz4_lz4 which failed to fetch. no such package '@com_github_lz4_lz4//': java.io.IOException: Error downloading [https://codeload.github.com/lz4/lz4/tar.gz/refs/tags/v1.9.3] to /root/.cache/bazel/_bazel_root/eceb46742416a02f6a0f8d92bc74468c/external/com_github_lz4_lz4/temp7981238054276312767/v1.9.3.tar.gz: connect timed out
ERROR: Analysis of target '//engine/exe:scqlengine' failed; build aborted: 
INFO: Elapsed time: 66.843s
INFO: 0 processes.
FAILED: Build did NOT complete successfully (153 packages loaded, 8644 targets configured)
    currently loading: @com_github_xtensor_xtensor// ... (5 packages)
make: *** [Makefile:34: binary] Error 1
+ docker stop 05c1dc550f948e979fd9354e0dd44baad55da5c0cf6d05b809787d70a24092ed
05c1dc550f948e979fd9354e0dd44baad55da5c0cf6d05b809787d70a24092ed

jingshi-ant · 2024-11-05T11:10:50Z

如果只关注测试shuffle、sort的性能，可以基于master分支自己构造数据从日志里观察耗时，或者在spu repo里完成测试。

Repo-Zhuang · 2024-11-05T11:48:08Z

抱歉，我对这个不太熟悉。你能大致告诉我怎么操作吗~
~

Repo-Zhuang closed this as completed Nov 7, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

vldb镜像构建失败 #386

vldb镜像构建失败 #386

Repo-Zhuang commented Oct 29, 2024

wangzul commented Oct 29, 2024

Repo-Zhuang commented Oct 29, 2024

wangzul commented Oct 29, 2024

Repo-Zhuang commented Oct 29, 2024 •

edited

Loading

wangzul commented Oct 30, 2024

jingshi-ant commented Oct 30, 2024

Repo-Zhuang commented Oct 30, 2024

wangzul commented Oct 30, 2024

Repo-Zhuang commented Oct 30, 2024 •

edited

Loading

wangzul commented Oct 30, 2024

Repo-Zhuang commented Oct 30, 2024 •

edited

Loading

jingshi-ant commented Oct 30, 2024

Repo-Zhuang commented Nov 1, 2024

jingshi-ant commented Nov 5, 2024

Repo-Zhuang commented Nov 5, 2024

vldb镜像构建失败 #386

vldb镜像构建失败 #386

Comments

Repo-Zhuang commented Oct 29, 2024

wangzul commented Oct 29, 2024

Repo-Zhuang commented Oct 29, 2024

wangzul commented Oct 29, 2024

Repo-Zhuang commented Oct 29, 2024 • edited Loading

wangzul commented Oct 30, 2024

jingshi-ant commented Oct 30, 2024

Repo-Zhuang commented Oct 30, 2024

wangzul commented Oct 30, 2024

Repo-Zhuang commented Oct 30, 2024 • edited Loading

wangzul commented Oct 30, 2024

--mount type=bind,source="${WORK_DIR}",target=/home/admin/dev/ \

-w /home/admin/dev ${MOUNT_OPTIONS} \

$BUILDER tail -f /dev/null)

Repo-Zhuang commented Oct 30, 2024 • edited Loading

jingshi-ant commented Oct 30, 2024

Repo-Zhuang commented Nov 1, 2024

jingshi-ant commented Nov 5, 2024

Repo-Zhuang commented Nov 5, 2024

Repo-Zhuang commented Oct 29, 2024 •

edited

Loading

Repo-Zhuang commented Oct 30, 2024 •

edited

Loading

Repo-Zhuang commented Oct 30, 2024 •

edited

Loading