添加链接
link之家
链接快照平台
  • 输入网页链接,自动生成快照
  • 标签化管理网页链接

本地环境中已经有太多的工作配置了(Python、Java、Maven、Docker 等等),为了不影响其他环境运行,我选择直接在 VSCode 中创建工作空间并配置好 AutoKeras(反正最后也是要在 VSCode 中进行开发的)。<br> 打开 VSCode 后先创建一个工作区,然后在终端运行以下代码:

python3 -m venv autokeras-env

这段代码会在工作区创建一个名为 autokeras-env 的工作环境,之后所有 autokeras 插件都在这个工作环境里面安装。接下来就要在终端中执行以下代码激活 autokeras-env 环境:

source autokeras-env/bin/activate

当终端上出现了以下输出后

MacBook-Pro:python yuanzhenhui$ python3 -m venv autokeras-env
MacBook-Pro:python yuanzhenhui$ source autokeras-env/bin/activate
(autokeras-env) MacBook-Pro:python yuanzhenhui$

就证明已经切换完毕了,接下来就可以去安装 autokeras 插件了。

pip install autokeras

在第一次安装的时候或许会出现这样的报错,如下图:

Collecting grpcio<2.0,>=1.24.3 Downloading grpcio-1.59.2.tar.gz (24.8 MB) |████████████████████████████████| 24.8 MB 2.1 MB/s ERROR: Command errored out with exit status 1: command: /Users/yuanzhenhui/Documents/code_space/git/processing/python/autokeras-env/bin/python3 -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/private/var/folders/74/mmb55nf927x36pb3bv43_zd40000gn/T/pip-install-rtnah99l/grpcio/setup.py'"'"'; __file__='"'"'/private/var/folders/74/mmb55nf927x36pb3bv43_zd40000gn/T/pip-install-rtnah99l/grpcio/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info --egg-base /private/var/folders/74/mmb55nf927x36pb3bv43_zd40000gn/T/pip-pip-egg-info-nbp93pfc cwd: /private/var/folders/74/mmb55nf927x36pb3bv43_zd40000gn/T/pip-install-rtnah99l/grpcio/ Complete output (9 lines): Traceback (most recent call last): File "<string>", line 1, in <module> File "/private/var/folders/74/mmb55nf927x36pb3bv43_zd40000gn/T/pip-install-rtnah99l/grpcio/setup.py", line 95, in <module> import commands File "/private/var/folders/74/mmb55nf927x36pb3bv43_zd40000gn/T/pip-install-rtnah99l/grpcio/src/python/grpcio/commands.py", line 31, in <module> import support File "/private/var/folders/74/mmb55nf927x36pb3bv43_zd40000gn/T/pip-install-rtnah99l/grpcio/src/python/grpcio/support.py", line 111, in <module> errors.CompileError: diagnose_compile_error, AttributeError: module 'setuptools.errors' has no attribute 'CompileError' ---------------------------------------- ERROR: Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output. WARNING: You are using pip version 20.2.1; however, version 23.3.1 is available. You should consider upgrading via the '/Users/yuanzhenhui/Documents/code_space/git/processing/python/autokeras-env/bin/python3 -m pip install --upgrade pip' command.

从上面的提示得知,若遇到这样的报错只需要重新安装一下 pip 应该就可以了。如下图;

(autokeras-env) MacBook-Pro:python yuanzhenhui$ python3 -m pip install --upgrade pip
Collecting pip
  Using cached pip-23.3.1-py3-none-any.whl (2.1 MB)
Installing collected packages: pip
  Attempting uninstall: pip
    Found existing installation: pip 20.2.1
    Uninstalling pip-20.2.1:
      Successfully uninstalled pip-20.2.1
Successfully installed pip-23.3.1

之后再重新执行 pip install autokeras

(autokeras-env) MacBook-Pro:python yuanzhenhui$ pip install autokeras
Collecting autokeras
  Using cached autokeras-1.1.0-py3-none-any.whl (148 kB)
Collecting packaging (from autokeras)
  Using cached packaging-23.2-py3-none-any.whl.metadata (3.2 kB)
Downloading tensorflow-2.13.1-cp38-cp38-macosx_10_15_x86_64.whl (216.2 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 216.2/216.2 MB 150.3 kB/s eta 0:00:00
Using cached packaging-23.2-py3-none-any.whl (53 kB)
Downloading pandas-2.0.3-cp38-cp38-macosx_10_9_x86_64.whl (11.7 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11.7/11.7 MB 124.0 kB/s eta 0:00:00
Using cached absl_py-2.0.0-py3-none-any.whl (130 kB)
Using cached flatbuffers-23.5.26-py2.py3-none-any.whl (26 kB)
Downloading grpcio-1.59.2-cp38-cp38-macosx_10_10_universal2.whl (9.6 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9.6/9.6 MB 251.9 kB/s eta 0:00:00
Downloading h5py-3.10.0-cp38-cp38-macosx_10_9_x86_64.whl (3.2 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.2/3.2 MB 2.8 MB/s eta 0:00:00
Downloading importlib_metadata-6.8.0-py3-none-any.whl (22 kB)
Downloading MarkupSafe-2.1.3-cp38-cp38-macosx_10_9_x86_64.whl (13 kB)
Downloading zipp-3.17.0-py3-none-any.whl (7.4 kB)
Installing collected packages: pytz, namex, libclang, kt-legacy, flatbuffers, dm-tree, zipp, wrapt, wheel, urllib3, tzdata, typing-extensions, termcolor, tensorflow-io-gcs-filesystem, tensorflow-estimator, tensorboard-data-server, six, regex, pygments, pyasn1, protobuf, packaging, oauthlib, numpy, mdurl, MarkupSafe, keras, idna, grpcio, gast, charset-normalizer, certifi, cachetools, absl-py, werkzeug, rsa, requests, python-dateutil, pyasn1-modules, opt-einsum, markdown-it-py, importlib-metadata, h5py, google-pasta, astunparse, rich, requests-oauthlib, pandas, markdown, google-auth, keras-core, google-auth-oauthlib, tensorboard, keras-tuner, keras-nlp, tensorflow, autokeras
Successfully installed MarkupSafe-2.1.3 absl-py-2.0.0 astunparse-1.6.3 autokeras-1.1.0 cachetools-5.3.2 certifi-2023.7.22 charset-normalizer-3.3.1 dm-tree-0.1.8 flatbuffers-23.5.26 gast-0.4.0 google-auth-2.23.3 google-auth-oauthlib-1.0.0 google-pasta-0.2.0 grpcio-1.59.2 h5py-3.10.0 idna-3.4 importlib-metadata-6.8.0 keras-2.13.1 keras-core-0.1.5 keras-nlp-0.6.1 keras-tuner-1.4.5 kt-legacy-1.0.5 libclang-16.0.6 markdown-3.5 markdown-it-py-3.0.0 mdurl-0.1.2 namex-0.0.7 numpy-1.24.3 oauthlib-3.2.2 opt-einsum-3.3.0 packaging-23.2 pandas-2.0.3 protobuf-4.24.4 pyasn1-0.5.0 pyasn1-modules-0.3.0 pygments-2.16.1 python-dateutil-2.8.2 pytz-2023.3.post1 regex-2023.10.3 requests-2.31.0 requests-oauthlib-1.3.1 rich-13.6.0 rsa-4.9 six-1.16.0 tensorboard-2.13.0 tensorboard-data-server-0.7.2 tensorflow-2.13.1 tensorflow-estimator-2.13.0 tensorflow-io-gcs-filesystem-0.34.0 termcolor-2.3.0 typing-extensions-4.5.0 tzdata-2023.3 urllib3-2.0.7 werkzeug-3.0.1 wheel-0.41.3 wrapt-1.15.0 zipp-3.17.0

之后我们可以通过以下命令查看已经安装的 keras 的版本来确定是否已经正常安装了

(autokeras-env) MacBook-Pro:autokeras-env yuanzhenhui$ python
Python 3.8.6 (v3.8.6:db455296be, Sep 23 2020, 13:31:39) 
[Clang 6.0 (clang-600.0.57)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> import keras
2023-11-01 10:26:26.153780: I tensorflow/core/platform/cpu_feature_guard.cc:182] This TensorFlow binary is optimized to use available CPU instructions in performance-critical operations.
To enable the following instructions: AVX2 FMA, in other operations, rebuild TensorFlow with the appropriate compiler flags.
>>> print(keras.__version__)
2.13.1

至此基础安装已完成。

Java kafka consumer 乱码 kafka consumer.poll

问题有个需求,需要频繁seek到指定partition的指定offset,然后poll,且只poll一次,目的是为了快速将指定offset的消息拉取出来。通常的poll写法是,将poll逻辑放在死循环里,第一次拉不到,第二次继续。如果offset上有消息,就一定能消费到:consumer.subscribe("topics"); while(true){ records = consume