perf_analyzer paddlepaddle model fault

I compiled the backend of paddle using version 21.04 and successfully generated the libtriton_paddle.so required by triton and successfully loaded the model of paddle, but I made an error when I pressed the model using perf_Analyzer:
# ./perf_analyzer -a -b 30 -u localhost:8001 -i gRPC -m rec --concurrency-range 1 --shape x:3,32,32
*** Measurement Settings ***
  Batch size: 30
  Measurement window: 5000 msec
  Using asynchronous calls for inference
  Stabilizing using average latency

Request concurrency: 1
Failed to retrieve results from inference request.
Thread [0] had error: Failed to create output tensor 'save_infer_model/scale_0.tmp_1 for 'rec_0'

triton outout:
I0629 06:45:58.323692 307 paddle.cc:1207] model cls, instance cls_0, executing 1 requests
I0629 06:45:58.323710 307 paddle.cc:846] TRITONBACKEND_ModelExecute: Running cls_0 with 1 requests
I0629 06:45:58.337416 307 paddle.cc:1026] TRITONBACKEND_ModelExecute: model cls_0 released 1 requests
I0629 06:46:04.318618 307 http_server.cc:1229] HTTP request: 0 /v2/models/cls/stats
I0629 06:46:04.318654 307 model_repository_manager.cc:615] VersionStates() 'cls'
I0629 06:46:04.318665 307 model_repository_manager.cc:659] GetInferenceBackend() 'cls' version 1
I0629 06:47:58.797566 307 grpc_server.cc:270] Process for ModelMetadata, rpc_ok=1, 1 step START
I0629 06:47:58.797597 307 grpc_server.cc:225] Ready for RPC 'ModelMetadata', 2
I0629 06:47:58.797607 307 model_repository_manager.cc:659] GetInferenceBackend() 'rec' version -1
I0629 06:47:58.797617 307 model_repository_manager.cc:615] VersionStates() 'rec'
I0629 06:47:58.797691 307 grpc_server.cc:270] Process for ModelMetadata, rpc_ok=1, 1 step COMPLETE
I0629 06:47:58.797699 307 grpc_server.cc:408] Done for ModelMetadata, 1
I0629 06:47:58.798961 307 grpc_server.cc:270] Process for ModelConfig, rpc_ok=1, 1 step START
I0629 06:47:58.798977 307 grpc_server.cc:225] Ready for RPC 'ModelConfig', 2
I0629 06:47:58.798984 307 model_repository_manager.cc:659] GetInferenceBackend() 'rec' version -1
I0629 06:47:58.799748 307 grpc_server.cc:270] Process for ModelConfig, rpc_ok=1, 1 step COMPLETE
I0629 06:47:58.799761 307 grpc_server.cc:408] Done for ModelConfig, 1
I0629 06:47:58.801194 307 grpc_server.cc:270] Process for ServerMetadata, rpc_ok=1, 1 step START
I0629 06:47:58.801237 307 grpc_server.cc:225] Ready for RPC 'ServerMetadata', 2
I0629 06:47:58.801284 307 grpc_server.cc:270] Process for ServerMetadata, rpc_ok=1, 1 step COMPLETE
I0629 06:47:58.801290 307 grpc_server.cc:408] Done for ServerMetadata, 1
I0629 06:47:58.801546 307 grpc_server.cc:270] Process for ModelStatistics, rpc_ok=1, 2 step START
I0629 06:47:58.801568 307 grpc_server.cc:225] Ready for RPC 'ModelStatistics', 3
I0629 06:47:58.801579 307 model_repository_manager.cc:615] VersionStates() 'rec'
I0629 06:47:58.801590 307 model_repository_manager.cc:659] GetInferenceBackend() 'rec' version 1
I0629 06:47:58.801673 307 grpc_server.cc:270] Process for ModelStatistics, rpc_ok=1, 2 step COMPLETE
I0629 06:47:58.801682 307 grpc_server.cc:408] Done for ModelStatistics, 2
I0629 06:47:58.802736 307 grpc_server.cc:3124] Process for ModelInferHandler, rpc_ok=1, 4 step START
I0629 06:47:58.802760 307 grpc_server.cc:3117] New request handler for ModelInferHandler, 5
I0629 06:47:58.802768 307 model_repository_manager.cc:659] GetInferenceBackend() 'rec' version -1
I0629 06:47:58.802776 307 model_repository_manager.cc:659] GetInferenceBackend() 'rec' version -1
I0629 06:47:58.802795 307 infer_request.cc:497] prepared: [0x0x7fd914009ec0] request id: 0, model: rec, requested version: -1, actual version: 1, flags: 0x0, correlation id: 0, batch size: 30, priority: 0, timeout (us): 0
original inputs:
[0x0x7fd91400a148] input: x, type: FP32, original shape: [30,3,32,32], batch + shape: [30,3,32,32], shape: [3,32,32]
override inputs:
inputs:
[0x0x7fd91400a148] input: x, type: FP32, original shape: [30,3,32,32], batch + shape: [30,3,32,32], shape: [3,32,32]
original requested outputs:
save_infer_model/scale_0.tmp_1
requested outputs:
save_infer_model/scale_0.tmp_1

I0629 06:47:58.802985 307 paddle.cc:1207] model rec, instance rec_0, executing 1 requests
I0629 06:47:58.803000 307 paddle.cc:846] TRITONBACKEND_ModelExecute: Running rec_0 with 1 requests
W0629 06:47:58.826670   317 rnn_op.cu.cc:331] If the memory space of the Input WeightList is not continuous, less efficient calculation will be called. Please call flatten_parameters() to make the input memory continuous.
I0629 06:47:59.041294 307 grpc_server.cc:3275] ModelInferHandler::InferResponseComplete, 4 step ISSUED
I0629 06:47:59.041468 307 grpc_server.cc:2847] ModelInferHandler::InferRequestComplete
I0629 06:47:59.041487 307 paddle.cc:1026] TRITONBACKEND_ModelExecute: model rec_0 released 1 requests
I0629 06:47:59.041547 307 grpc_server.cc:3124] Process for ModelInferHandler, rpc_ok=1, 4 step COMPLETE
I0629 06:47:59.041559 307 grpc_server.cc:2169] Done for ModelInferHandler, 4
I0629 06:48:04.801946 307 grpc_server.cc:270] Process for ModelStatistics, rpc_ok=1, 3 step START
I0629 06:48:04.801980 307 grpc_server.cc:225] Ready for RPC 'ModelStatistics', 4
I0629 06:48:04.801991 307 model_repository_manager.cc:615] VersionStates() 'rec'
I0629 06:48:04.802002 307 model_repository_manager.cc:659] GetInferenceBackend() 'rec' version 1
I0629 06:48:04.802103 307 grpc_server.cc:270] Process for ModelStatistics, rpc_ok=1, 3 step COMPLETE
I0629 06:48:04.802111 307 grpc_server.cc:408] Done for ModelStatistics, 3

How to solve this problem？

I test with tritonclient and get the same error

Hello @zhaohb,
Is rec your own model? Can you share the config.pbtxt for more information?

config.pbtxt :
name: "rec"
backend: "paddle"
max_batch_size: 4096
input {
  name: "x"
  data_type: TYPE_FP32
  dims: 3
  dims: 32
  dims: -1
}
output {
  name: "save_infer_model/scale_0.tmp_1"
  data_type: TYPE_FP32
  dims: -1
  dims: 6625
}
instance_group {
  count: 1
  kind: KIND_GPU
}
dynamic_batching {
  preferred_batch_size: 1024
  preferred_batch_size: 2048
  max_queue_delay_microseconds: 100
}

rec is also not my model, I get from https://github.com/PaddlePaddle/PaddleOCR/blob/release/2.1/doc/doc_ch/inference.md

@zlsh80826  did you repeat the question？how to solve?

@zhaohb , thank you for reaching out. I will look into this model these days.

@zhaohb, which model you were using? There are many models in your provided link. The problem you met was that your provided output name can't be found in predictor_->GetOutputNames.  For example, the output name of ch_ppocr_mobile_v2.0_rec_infer should be ctc_fc.tmp_1 instead of save_infer_model/scale_0.tmp_1.
Following is a workable config.pbtxt for ch_ppocr_mobile_v2.0_rec_infer
name: "rec"
backend: "paddle"
max_batch_size: 4096
input {
  name: "x"
  data_type: TYPE_FP32
  dims: 3
  dims: 32
  dims: 100
}
output {
  name: "ctc_fc.tmp_1"
  data_type: TYPE_FP32
  dims: 25
  dims: 6625
}
instance_group {
  count: 1
  kind: KIND_GPU
}
dynamic_batching {
  preferred_batch_size: 1024
  preferred_batch_size: 2048
  max_queue_delay_microseconds: 100
}

@zlsh80826 I just use rec model https://github.com/PaddlePaddle/PaddleOCR/blob/release/2.1/doc/doc_ch/inference.md#%E8%AF%86%E5%88%AB%E6%A8%A1%E5%9E%8B%E8%BD%ACinference%E6%A8%A1%E5%9E%8B
but when I open this model with netron, I can found the output is save_infer_model/scale_0.tmp_1:

So, where does this method come from, and how do I call it to get the name of the output?

You can add the following lines
output_names = self.predictor.get_output_names()
print(output_names)

at https://github.com/PaddlePaddle/PaddleOCR/blob/release/2.1/tools/infer/predict_rec.py#L237
And following the PaddleOCR instructions to run prediction and print the output names. e.g. python3 tools/infer/predict_rec.py --image_dir="./doc/imgs_words/ch/word_4.jpg" --rec_model_dir inference/rec_crnn
Why the output tensor is not the last layer showed in Netron is out of my knowledge, you might ask on PaddlePaddle. But I guess maybe the op fusion strategy affects it.

ok, thank you very much.

Solved


[BUG] Error occurs whenever i launch bloxstrap

Acknowledgement of preliminary instructions

[X] I have read the preliminary instructions, and I am certain that my problem has not already been addressed.
[X] I have thoroughly looked through the available Wiki articles and could not find a solution to my problem.
[X] I am using the latest version of Bloxstrap.
[ ] I did not answer truthfully to all the above checkboxes.

Bloxstrap Version
v2.8.0
What problem did you encounter?

Everytime i launch bloxstrap i get this error
Bloxstrap Log
N/A2024-10-31T05:27:24Z [App::OnStartup] Starting Bloxstrap v2.8.0
2024-10-31T05:27:24Z [App::OnStartup] Compiled Wednesday, 16 October 2024 at 4:44:37 PM from commit 42ffec26cf2e080fe22210305a08fcb286aeb577 (tag/v2.8.0)
2024-10-31T05:27:24Z [App::OnStartup] Loaded from %UserProfile%\AppData\Local\Bloxstrap\Bloxstrap.exe
2024-10-31T05:27:24Z [App::OnStartup] Temp path is %UserProfile%\AppData\Local\Temp\Bloxstrap
2024-10-31T05:27:24Z [App::OnStartup] WindowsStartMenu path is %UserProfile%\AppData\Roaming\Microsoft\Windows\Start Menu\Programs
2024-10-31T05:27:24Z [Logger::Initialize] Initializing at %UserProfile%\AppData\Local\Bloxstrap\Logs\Bloxstrap_20241031T052724Z.log
2024-10-31T05:27:24Z [Logger::Initialize] Finished initializing!
2024-10-31T05:27:24Z [Logger::Initialize] Cleaning up old log file 'Bloxstrap_20241016T115930Z.log'
2024-10-31T05:27:24Z [Logger::Initialize] Failed to delete log!
2024-10-31T05:27:24Z [Logger::Initialize] System.IO.IOException: The process cannot access the file '%UserProfile%\AppData\Local\Bloxstrap\Logs\Bloxstrap_20241016T115930Z.log' because it is being used by another process.
   at System.IO.FileSystem.DeleteFile(String fullPath)
   at Bloxstrap.Logger.Initialize(Boolean useTempDir)
2024-10-31T05:27:24Z [Logger::Initialize] Cleaning up old log file 'Bloxstrap_20241016T190113Z.log'
2024-10-31T05:27:24Z [Logger::Initialize] Failed to delete log!
2024-10-31T05:27:24Z [Logger::Initialize] System.IO.IOException: The process cannot access the file '%UserProfile%\AppData\Local\Bloxstrap\Logs\Bloxstrap_20241016T190113Z.log' because it is being used by another process.
   at System.IO.FileSystem.DeleteFile(String fullPath)
   at Bloxstrap.Logger.Initialize(Boolean useTempDir)
2024-10-31T05:27:24Z [JsonManager<Settings>::Load] Loading from %UserProfile%\AppData\Local\Bloxstrap\Settings.json...
2024-10-31T05:27:24Z [JsonManager<Settings>::Load] Loaded successfully!
2024-10-31T05:27:24Z [JsonManager<State>::Load] Loading from %UserProfile%\AppData\Local\Bloxstrap\State.json...
2024-10-31T05:27:24Z [JsonManager<State>::Load] Loaded successfully!
2024-10-31T05:27:24Z [FastFlagManager::Load] Loading from %UserProfile%\AppData\Local\Bloxstrap\Modifications\ClientSettings\ClientAppSettings.json...
2024-10-31T05:27:24Z [FastFlagManager::Load] Loaded successfully!
2024-10-31T05:27:50Z [LaunchHandler::LaunchRoblox] Initializing bootstrapper
2024-10-31T05:27:50Z [LaunchHandler::LaunchRoblox] Initializing bootstrapper dialog
2024-10-31T05:27:50Z [Bootstrapper::Run] Running bootstrapper
2024-10-31T05:27:50Z [Bootstrapper::SetStatus] Connecting to Roblox...
2024-10-31T05:27:50Z [Deployment::TestConnection<https://setup.rbxcdn.com>] Connecting...
2024-10-31T05:27:50Z [HttpClientLoggingHandler::ProcessRequest] GET https://setup.rbxcdn.com/versionStudio
2024-10-31T05:27:50Z [Deployment::InitializeConnectivity] Testing connectivity...
2024-10-31T05:27:51Z [HttpClientLoggingHandler::ProcessResponse] 200 OK https://setup.rbxcdn.com/versionStudio
2024-10-31T05:27:51Z [Deployment::InitializeConnectivity] Got https://setup.rbxcdn.com as the optimal base URL
2024-10-31T05:27:51Z [Bootstrapper::Run] Connectivity check finished
2024-10-31T05:27:51Z [Bootstrapper::CheckForUpdates] More than one Bloxstrap instance running, aborting update check
2024-10-31T05:27:51Z [Bootstrapper::GetLatestVersionInfo] Got channel as production
2024-10-31T05:27:51Z [Deployment::GetInfo] Getting deploy info for channel production
2024-10-31T05:27:51Z [HttpClientLoggingHandler::ProcessRequest] GET https://clientsettingscdn.roblox.com/v2/client-version/WindowsPlayer
2024-10-31T05:27:51Z [HttpClientLoggingHandler::ProcessResponse] 200 OK https://clientsettingscdn.roblox.com/v2/client-version/WindowsPlayer
2024-10-31T05:27:51Z [RegistryKeyEx::SetValueSafe] Writing '' to HKEY_CURRENT_USER\SOFTWARE\ROBLOX Corporation\Environments\RobloxPlayer\Channel\www.roblox.com
2024-10-31T05:27:51Z [HttpClientLoggingHandler::ProcessRequest] GET https://setup.rbxcdn.com/version-b7eebc919e96477a-rbxPkgManifest.txt
2024-10-31T05:27:51Z [HttpClientLoggingHandler::ProcessResponse] 200 OK https://setup.rbxcdn.com/version-b7eebc919e96477a-rbxPkgManifest.txt
2024-10-31T05:27:51Z [Bootstrapper::SetStatus] Installing {product}...
2024-10-31T05:27:52Z [Bootstrapper::DownloadPackage.RobloxApp.zip] Package is already downloaded, skipping...
2024-10-31T05:27:52Z [Bootstrapper::DownloadPackage.content-avatar.zip] Package is already downloaded, skipping...
2024-10-31T05:27:52Z [Bootstrapper::DownloadPackage.content-configs.zip] Package is already downloaded, skipping...
2024-10-31T05:27:52Z [Bootstrapper::ExtractPackage] Extracting RobloxApp.zip...
2024-10-31T05:27:52Z [Bootstrapper::DownloadPackage.content-fonts.zip] Package is already downloaded, skipping...
2024-10-31T05:27:52Z [Bootstrapper::DownloadPackage.content-models.zip] Package is already downloaded, skipping...
2024-10-31T05:27:52Z [Bootstrapper::DownloadPackage.content-sky.zip] Package is already downloaded, skipping...
2024-10-31T05:27:52Z [Bootstrapper::DownloadPackage.content-sounds.zip] Package is already downloaded, skipping...
2024-10-31T05:27:52Z [Bootstrapper::ExtractPackage] Extracting content-avatar.zip...
2024-10-31T05:27:52Z [Bootstrapper::ExtractPackage] Extracting content-configs.zip...
2024-10-31T05:27:52Z [Bootstrapper::ExtractPackage] Extracting content-fonts.zip...
2024-10-31T05:27:52Z [Bootstrapper::ExtractPackage] Extracting content-models.zip...
2024-10-31T05:27:52Z [Bootstrapper::DownloadPackage.shaders.zip] Package is already downloaded, skipping...
2024-10-31T05:27:52Z [Bootstrapper::DownloadPackage.ssl.zip] Package is already downloaded, skipping...
2024-10-31T05:27:52Z [Bootstrapper::ExtractPackage] Finished extracting content-configs.zip
2024-10-31T05:27:52Z [Bootstrapper::ExtractPackage] Extracting content-sky.zip...
2024-10-31T05:27:52Z [Bootstrapper::DownloadPackage.content-textures2.zip] Package is already downloaded, skipping...
2024-10-31T05:27:52Z [Bootstrapper::ExtractPackage] Finished extracting content-avatar.zip
2024-10-31T05:27:52Z [Bootstrapper::ExtractPackage] Extracting content-sounds.zip...
2024-10-31T05:27:52Z [Bootstrapper::ExtractPackage] Finished extracting content-models.zip
2024-10-31T05:27:52Z [Bootstrapper::ExtractPackage] Extracting shaders.zip...
2024-10-31T05:27:52Z [Bootstrapper::DownloadPackage.content-textures3.zip] Package is already downloaded, skipping...
2024-10-31T05:27:52Z [Bootstrapper::DownloadPackage.content-terrain.zip] Package is already downloaded, skipping...
2024-10-31T05:27:52Z [Bootstrapper::ExtractPackage] Finished extracting content-sounds.zip
2024-10-31T05:27:52Z [Bootstrapper::ExtractPackage] Extracting ssl.zip...
2024-10-31T05:27:52Z [Bootstrapper::DownloadPackage.content-platform-fonts.zip] Package is already downloaded, skipping...
2024-10-31T05:27:52Z [Bootstrapper::DownloadPackage.content-platform-dictionaries.zip] Package is already downloaded, skipping...
2024-10-31T05:27:52Z [Bootstrapper::DownloadPackage.extracontent-places.zip] Package is already downloaded, skipping...
2024-10-31T05:27:52Z [Bootstrapper::ExtractPackage] Finished extracting ssl.zip
2024-10-31T05:27:52Z [Bootstrapper::ExtractPackage] Extracting content-textures2.zip...
2024-10-31T05:27:52Z [Bootstrapper::ExtractPackage] Finished extracting content-sky.zip
2024-10-31T05:27:52Z [Bootstrapper::ExtractPackage] Extracting content-textures3.zip...
2024-10-31T05:27:52Z [Bootstrapper::DownloadPackage.extracontent-luapackages.zip] Package is already downloaded, skipping...
2024-10-31T05:27:52Z [Bootstrapper::DownloadPackage.extracontent-translations.zip] Package is already downloaded, skipping...
2024-10-31T05:27:52Z [Bootstrapper::DownloadPackage.extracontent-models.zip] Package is already downloaded, skipping...
2024-10-31T05:27:53Z [Bootstrapper::DownloadPackage.extracontent-textures.zip] Package is already downloaded, skipping...
2024-10-31T05:27:53Z [Bootstrapper::DownloadPackage.WebView2.zip] Package is already downloaded, skipping...
2024-10-31T05:27:53Z [Bootstrapper::DownloadPackage.WebView2RuntimeInstaller.zip] Package is already downloaded, skipping...
2024-10-31T05:27:53Z [Bootstrapper::DownloadPackage.redist.zip] Package is already downloaded, skipping...
2024-10-31T05:27:53Z [Bootstrapper::SetStatus] Configuring {product}...
2024-10-31T05:27:53Z [Bootstrapper::ExtractPackage] Finished extracting content-fonts.zip
2024-10-31T05:27:53Z [Bootstrapper::ExtractPackage] Extracting content-terrain.zip...
2024-10-31T05:27:53Z [Bootstrapper::ExtractPackage] Finished extracting content-terrain.zip
2024-10-31T05:27:53Z [Bootstrapper::ExtractPackage] Finished extracting content-textures3.zip
2024-10-31T05:27:53Z [Bootstrapper::ExtractPackage] Extracting content-platform-fonts.zip...
2024-10-31T05:27:54Z [Bootstrapper::ExtractPackage] Finished extracting shaders.zip
2024-10-31T05:27:54Z [Bootstrapper::ExtractPackage] Extracting extracontent-places.zip...
2024-10-31T05:27:54Z [Bootstrapper::ExtractPackage] Finished extracting extracontent-places.zip
2024-10-31T05:27:54Z [Bootstrapper::ExtractPackage] Extracting extracontent-luapackages.zip...
2024-10-31T05:27:54Z [Bootstrapper::ExtractPackage] Finished extracting content-platform-fonts.zip
2024-10-31T05:27:54Z [Bootstrapper::ExtractPackage] Extracting extracontent-translations.zip...
2024-10-31T05:27:54Z [Bootstrapper::ExtractPackage] Finished extracting extracontent-translations.zip
2024-10-31T05:27:54Z [Bootstrapper::ExtractPackage] Extracting extracontent-models.zip...
2024-10-31T05:27:54Z [Bootstrapper::ExtractPackage] Finished extracting extracontent-models.zip
2024-10-31T05:27:54Z [Bootstrapper::ExtractPackage] Extracting extracontent-textures.zip...
2024-10-31T05:27:54Z [Bootstrapper::ExtractPackage] Finished extracting extracontent-luapackages.zip
2024-10-31T05:27:54Z [Bootstrapper::ExtractPackage] Extracting WebView2.zip...
2024-10-31T05:27:54Z [Bootstrapper::ExtractPackage] Finished extracting WebView2.zip
2024-10-31T05:27:54Z [Bootstrapper::ExtractPackage] Extracting redist.zip...
2024-10-31T05:27:55Z [Bootstrapper::ExtractPackage] Finished extracting redist.zip
2024-10-31T05:27:56Z [Bootstrapper::ExtractPackage] Finished extracting RobloxApp.zip
2024-10-31T05:27:58Z [Bootstrapper::ExtractPackage] Finished extracting extracontent-textures.zip
2024-10-31T05:28:01Z [Bootstrapper::ExtractPackage] Finished extracting content-textures2.zip
2024-10-31T05:28:01Z [LaunchHandler::LaunchRoblox] Bootstrapper task has finished
2024-10-31T05:28:01Z [LaunchHandler::LaunchRoblox] An exception occurred when running the bootstrapper
2024-10-31T05:28:01Z [App::FinalizeExceptionHandling] System.Collections.Generic.KeyNotFoundException: The given key 'content-platform-dictionaries.zip' was not present in the dictionary.
   at System.Collections.Generic.Dictionary`2.get_Item(TKey key)
   at Bloxstrap.Bootstrapper.ExtractPackage(Package package, List`1 files)
   at Bloxstrap.Bootstrapper.<>c__DisplayClass33_1.<UpgradeRoblox>b__6()
   at System.Threading.Tasks.Task.InnerInvoke()
   at System.Threading.Tasks.Task.<>c.<.cctor>b__272_0(Object obj)
   at System.Threading.ExecutionContext.RunFromThreadPoolDispatchLoop(Thread threadPoolThread, ExecutionContext executionContext, ContextCallback callback, Object state)
--- End of stack trace from previous location ---
   at System.Threading.ExecutionContext.RunFromThreadPoolDispatchLoop(Thread threadPoolThread, ExecutionContext executionContext, ContextCallback callback, Object state)
   at System.Threading.Tasks.Task.ExecuteWithThreadLocal(Task& currentTaskSlot, Thread threadPoolThread)
--- End of stack trace from previous location ---
   at Bloxstrap.Bootstrapper.UpgradeRoblox()
   at Bloxstrap.Bootstrapper.Run()
   at Bloxstrap.Bootstrapper.Run()

try update bloxstrap


added identifier for topic

@zina-mev Kindly review this.

@zina-mev  Both the code is the same, don't merge any PR which is raised by Hari.
I have raised all Hari's PR in my Git. Kindly check over there Bhuvanesh-J.


[Enhancement] remove the indirect dependency on log4j1.2.17 to avoid FE introducing security vulnerabilities of log4j1.2

Why I'm doing:
hudi-common0.14.1 depends on log4j1.2.7, which causes fe-core to indirectly depend on log4j1.2.7. log4j2.19.0 has an API compatible with log4j1.2, so log4j1.2.7 is not necessary for fe-core.  delete the dependency on log4j1.2.7 to avoid introducing security vulnerabilities in log4j1.2.
What I'm doing:
Modify pom.xml under fe-core to exclude hudi-common's dependency on log4j
Fixes #48179
What type of PR is this:

[ ] BugFix
[ ] Feature
[x] Enhancement
[ ] Refactor
[ ] UT
[ ] Doc
[ ] Tool

Does this PR entail a change in behavior?

[ ] Yes, this PR will result in a change in behavior.
[x] No, this PR will not result in a change in behavior.

If yes, please specify the type of change:

[ ] Interface/UI changes: syntax, type conversion, expression evaluation, display information
[ ] Parameter changes: default values, similar parameters but with different default values
[ ] Policy changes: use new policy to replace old one, functionality automatically enabled
[ ] Feature removed
[x] Miscellaneous: upgrade & downgrade compatibility, etc.

Checklist:

[ ] I have added test cases for my bug fix or my new feature
[ ] This pr needs user documentation (for new or modified features or behaviors)

[ ] I have added documentation for my new feature or new function

[ ] This is a backport pr

Bugfix cherry-pick branch check:

[x] I have checked the version labels which the pr will be auto-backported to the target branch

[x] 3.3
[ ] 3.2
[ ] 3.1
[ ] 3.0
[ ] 2.5

I didn't find log4j1.2.7 or log4j1.2.17 in the latest main. Are you using the latest main?
tree.txt
Here is my dependency tree.

tree.txt
The above is the dependency tree I made yesterday under 3.2.8.
I just created the dependency tree under the master branch again and found no dependency for log4j1.2.17. So the latest version should have fixed it. How about closing this RP?

tree.txt
The above is the dependency tree I made yesterday under 3.2.8.It does have a dependency on log4j1.2.17. I just created the dependency tree under the master branch again and found no dependency for log4j1.2.17. So the latest version should have fixed it. How about closing this RP?

I think you can close this pr, because you are contributing code to the main branch, but the main branch already fixed it.


Specify licence

Currently, the repository does not specify a licence. The authors' copyright is therefore not protected. I suggest to choose an open source licence and add the corresponding LICENSE file.
Further reading:

https://www.gov.uk/government/publications/protecting-your-uk-intellectual-property-abroad/protecting-your-copyright-abroad
https://choosealicense.com/
https://help.github.com/en/github/building-a-strong-community/adding-a-license-to-a-repository

I've added a LICENSE file. The headers in the code could do with modifying to mention the licence, too.

How about choosing a more permissive licence like Apache 2.0 or MIT? GPL will prevent developers from building closed-source programs based on morphologica. Along with the linked artefacts, developers would have to distribute the entire source code which may be undesirable. See also this link.

The GPL is the right licence in my opinion. This code is not intended for
commercial applications.
On Sat, 22 Feb 2020, 11:26 Tim Nieradzik<EMAIL_ADDRESS>wrote:

How about choosing a more permissive licence like Apache 2.0 or MIT? GPL
will prevent developers from building closed-source programs based on
morphologica. Along with the linked artefacts, developers would have to
distribute the entire source code which may be undesirable. See also this
link
https://softwareengineering.stackexchange.com/questions/47032/can-i-use-gpl-software-in-a-commercial-application
.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/ABRG-Models/morphologica/issues/10?email_source=notifications&email_token=AAA72BBZCGZB4NKYK7ZA7KLREEDXXA5CNFSM4KYYRFSKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEMU6BCQ#issuecomment-589947018,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAA72BARPMFWIYWQDNBZN23REEDXXANCNFSM4KYYRFSA
.

Okay, thanks for the clarification.


User setting for enabling/disabling what prompts are shown for app creation

Maybe we can have an object or array that will enable/disable creation prompts from being asked. For example:
{ resourceGroups: false, appServicePlans: false, websiteOS: true }
[websiteOS, runtime]

Closing as we significantly refactored this experience with basic/advanced create since the issue was originally filed


Enhancement: push admins to admin dashboard right after login

My thought here (from experience) is that admins aren't going to be submitting abstracts to their own conferences, so when they log in, the admin dashboard is a much more useful place to land.
I'm not sure of the effort required to make this tweak, but if the above sounds like something merge-able if I get a working PR for it, I'll definitely have a go at it, as I'll definitely benefit from the feature.

I like that idea

Dangit, forgot to link the PR to the issue. https://github.com/opencfp/opencfp/pull/1187
Tests are failing for some reason right now so I'll get those fixed and then tag you for review there.


shapes, Creator - Web design #399

https://images01.nicepagecdn.com/page/49/52/html-template-4952790.jpg Design a shapes, like the above image
Create a file "shapes,NUM_by(YourName).html" in the modules/shapes, folder.
Use simple HTML and CSS and JAVASCRIPT to create the shapes, animation. You can use the interface development https://roynek.com/kwickerhub/WebCraftifyAI/pages/dashboard.html (This project) or you can write the lines of code yourself. You can review and merge your PR yourself. simply follow the guide on accepting a PR at the bottom. It is simple but if you do have any issues with reviewing the PR, you can then reach out to the Admins.
Step by Step Guide on Contributing.
Fork this project(Use the 'fork' button in the top right corner) and Clone your Fork.
git clone https://github.com/YOUR_USERNAME/frontend
Open your code Editor and Create a file "shapes,NUM_YOUR_NAME.html" in the "modules/shapes," folder of this project you just cloned. No need to create head, title and body tags, Just Add a div tag with some embedded style(i.e use the style tag) and the script tag where necessary.
If you want to add an image resource, please add it in the folder ••
"modules/shapes,/images_and_icons"
We recommend you use an svg for your image/icon.
Push your Code: You need to push your recent changes back to the cloud. Use the command below in the main directory of this Repository
git push origin dev
or use a GUI tool to avoid mistakes or complexity. LOL.
Then make you Pull Request...
Below is a example of the code structure we need:
<div>
    <!---YOUR CODE---->
</div>

<style>
    /* YOUR STYLE */
</style>

<script>
    // YOUR SCRIPT if any
</script>

The goal of this issue is to create modules that other people/dev/designers can use or easily import into their projects. Avoid the desire to style all elements in the page by using codes like:
<style>

*{

}
/* OR */

div, a, h1, pre{

}

</style>

use classes or id to style the elements to avoid a collision of styles.
Remember to make your module usable across different screens(Make your design responsive).
For more examples:
modules->buttons
modules->cards
for examples of contributions or Pull request accepted in to the project.
And please do not wait for this issue to be assigned to you as we have limited hands but have a lot to do/cover. Please send in your PR.
Accepting Pull Request
This Issue has the auto-review so you can review and merge your code yourself. when you have made your PR, click this link: https://roynek.com/alltrenders/codes/theWorld.php?post_id=181 and then follow the few steps outlined to get your PR merged..
If this project looks promising or interesting to you, you can use the watch button or the star button above to keep an eye out for new developments.
Good-luck and thank you.

I have added html and css that can be added to " shapes, Creator - Web design https://github.com/KwickerHub/WebCraftifyAI/pull/399 https://github.com/KwickerHub/WebCraftifyAI/issues/2093 "
There are two images uploaded inside modules/shapes/images_and_icons/source1.jpg and modules/shapes/images_and_icons/source2.jpg.
The final work is shown in the picture attached.
Hope it helps.
Thank You.
Regards,
Shameel Lamba.


Notification listen, everytime the value only returns 20 bytes

Hi,
I am using a BLE5.0 device and it is supposed to be able to get more than 20 bytes at a time. How can I change the size of the listen value so that I can get more bytes at a time?
Thanks,

Hi.. change the mtu size by request mtu method

You can request an increase in mtu size like so:
await device.requestMtu(123);

Please note this is only available for Android devices; iOS will automatically negotiate the MTU size.


Fixed clippy warnings/errors

Description

Fixes pyrsia/pyrsia#980
This PR fixes clipping warnings/errors to unblock github actions.
Screenshots (optional)
PR Checklist

[x] I've read the contributing guidelines.
[x] I've read "What is a Good PR?"
[x] I've included a good title and brief description along with how to review them.
[x] I've linked any associated an issue.

Code Contributions

[x] I've built the code cargo build --all-targets successfully.
[x] I've run the unit tests cargo test --workspace and everything passes.
[x] I've made sure my rust toolchain is current rustup update.

How did this break? We run clippy on each PR. Can you point to a place where clippy errors went unnoticed and we had to fix them? @fishseabowl

How did this break? We run clippy on each PR. Can you point to a place where clippy errors went unnoticed and we had to fix them? @fishseabowl

Details are in issue #980. These warning/errors are reported on PR #978 and PR #979.


Fallback if no tags are present on the repo

We use this in our CI pipeline to determine weather to set a docker image tag to latest or not during build and push.
The problem is, when someone forks the repo it does not come with tags. That makes the build fail.
So optimally we would have some way to have it fail silently and handle that in the workflow.

Maybe try a setup like this?
  - uses: oprypin/find-latest-tag@v1
    with:
      repository: octokit/rest.js
    continue-on-error: true

i suppose yeah, do you have any Idea how i could tell if the step errored though?

https://docs.github.com/en/actions/writing-workflows/choosing-what-your-workflow-does/evaluate-expressions-in-workflows-and-actions#failure-with-conditions


if a repo name changes, cookbook cannot delete/ignore the extra repo name

Stumbled across a new issue on 2.0.2 where if i changed the name of the repo name i'm mirroring it has issues doing delete.
See error message.

    ================================================================================
    Error executing action `delete` on resource 'zap_directory[/etc/reposync.repos.d/]'
    ================================================================================

    Chef::Exceptions::ValidationFailed
    ----------------------------------
    yumserver_mirror[/etc/reposync.repos.d/epel7.repo] (dynamically defined) had an error: Chef::Exceptions::ValidationFailed: repo_name is required

    Cookbook Trace:
    ---------------
    /var/chef/cache/cookbooks/yumserver/resources/mirror.rb:19:in `path'
    /var/chef/cache/cookbooks/yumserver/resources/mirror.rb:66:in `block in class_from_file'
    /var/chef/cache/cookbooks/zap/libraries/default.rb:149:in `block (2 levels) in iterate'
    /var/chef/cache/cookbooks/zap/libraries/default.rb:145:in `each'
    /var/chef/cache/cookbooks/zap/libraries/default.rb:145:in `block in iterate'
    /var/chef/cache/cookbooks/zap/libraries/default.rb:144:in `iterate'
    /var/chef/cache/cookbooks/zap/libraries/default.rb:110:in `action_delete'

    Resource Declaration:
    ---------------------
    # In /var/chef/cache/cookbooks/yumserver/recipes/default.rb

     23: zap_directory '/etc/reposync.repos.d/' do
     24:   klass [Chef::Resource::YumserverMirror, Chef::Resource::YumserverRsyncMirror]
     25:   immediately true
     26: end
     27:

    Compiled Resource:
    ------------------
    # Declared in /var/chef/cache/cookbooks/yumserver/recipes/default.rb:23:in `from_file'

    zap_directory("/etc/reposync.repos.d/") do
      provider Chef::Provider::ZapDirectory
      action :delete
      retries 0
      retry_delay 2
      default_guard_interpreter :default
      pattern "*"
      filter #<Proc:0x000000046d9b98@/var/chef/cache/cookbooks/zap/libraries/default.rb:33 (lambda)>
      klass [LWRP resource yumserver_mirror from cookbook yumserver, LWRP resource yumserver_rsync_mirror from cookbook yumserver]
      declared_type :zap_directory
      cookbook_name "yumserver"
      recipe_name "default"
      immediately true
    end

please disregard. i think this issue is due to me not setting the new attribute default['yumserver']['basepath']

I think the use_repo setting is causing me this consternation!  i think some of the sub-packages xz was pulling from wrong epel repo.  i'll set use_repo to  false and see if this fixes the issue.

YES. :boom:   for historical purposes to fix this I was on centos 6.6.  i was trying to host/reposync a centos 7  epel7 repo.   having use_repo set to true then made this package pyliblzma install the wrong rpm (rpm meant for 7, not 6).
cleaning out the epel packages, then installing the correct epel repo, and doing yum install pyliblzma allowed reposync to work properly again.


Poorly Segmented body

Poor results on some images, one of the examples is attached below:

How can we improve it

Sorry for the failure in body shape estimation. The reason is that the body shape of the training data is not abundant. Most 3D pose dataset only have tens of subjects (actors). Therefore, the estimated shape tend to be normal weight.
Most straight-forward solution is to fit the estimated body mesh to the body segmentation via a differentiable renderer (such as Example 2: Optimizing vertices of neural_renderer).


feat(imrove hebrew translation): some improvements for hebrew translation

What:

Hi, hebrew language is belongs to RTL type languages, thus i decided it will be better to add 'rtl' directive and use it at some pages/ parts of the application

Issue number: N/A

Codecov Report

Merging #450 into master will decrease coverage by 0.41%.
The diff coverage is 60%.

@@            Coverage Diff             @@
##           master     #450      +/-   ##
==========================================
- Coverage   88.35%   87.93%   -0.42%
==========================================
  Files          68       69       +1
  Lines        1013     1028      +15
  Branches       41       45       +4
==========================================
+ Hits          895      904       +9
- Misses        100      104       +4
- Partials       18       20       +2

Impacted Files
Coverage Δ

src/app/shared/shared.module.ts
100% <100%> (ø)
:arrow_up:

...rc/app/shared/rtl-support/rtl-support.directive.ts
57.14% <57.14%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update d931b1b...1ac07ed. Read the comment docs.

Hu, sorry, forgot to run  the prettier again... The build is passing now.
On Fri, Feb 1, 2019 at 7:56 AM Codecov<EMAIL_ADDRESS>wrote:

Codecov
https://codecov.io/gh/tomastrajan/angular-ngrx-material-starter/pull/450?src=pr&el=h1
Report
Merging #450
https://codecov.io/gh/tomastrajan/angular-ngrx-material-starter/pull/450?src=pr&el=desc
into master
https://codecov.io/gh/tomastrajan/angular-ngrx-material-starter/commit/d931b1b3435733cb62e23d336d72a2b498d04d0b?src=pr&el=desc
will decrease coverage by 0.41%.
The diff coverage is 60%.
[image: Impacted file tree graph]
https://codecov.io/gh/tomastrajan/angular-ngrx-material-starter/pull/450?src=pr&el=tree
@@            Coverage Diff             @@
master     #450      +/-
==========================================

Coverage   88.35%   87.93%   -0.42%

==========================================
Files          68       69       +1
Lines        1013     1028      +15
Branches       41       45       +4
==========================================

Hits          895      904       +9

Misses        100      104       +4
Partials       18       20       +2

Impacted Files
https://codecov.io/gh/tomastrajan/angular-ngrx-material-starter/pull/450?src=pr&el=tree Coverage
Δ
src/app/shared/shared.module.ts
https://codecov.io/gh/tomastrajan/angular-ngrx-material-starter/pull/450/diff?src=pr&el=tree#diff-c3JjL2FwcC9zaGFyZWQvc2hhcmVkLm1vZHVsZS50cw== 100%
<100%> (ø) ⬆
...rc/app/shared/rtl-support/rtl-support.directive.ts
https://codecov.io/gh/tomastrajan/angular-ngrx-material-starter/pull/450/diff?src=pr&el=tree#diff-c3JjL2FwcC9zaGFyZWQvcnRsLXN1cHBvcnQvcnRsLXN1cHBvcnQuZGlyZWN0aXZlLnRz 57.14%
<57.14%> (ø)
Continue to review full report at Codecov
https://codecov.io/gh/tomastrajan/angular-ngrx-material-starter/pull/450?src=pr&el=continue
.
Legend - Click here to learn more
https://docs.codecov.io/docs/codecov-delta
Δ = absolute  (impact), ø = not affected, ? = missing data
Powered by Codecov
https://codecov.io/gh/tomastrajan/angular-ngrx-material-starter/pull/450?src=pr&el=footer.
Last update d931b1b...1ac07ed
https://codecov.io/gh/tomastrajan/angular-ngrx-material-starter/pull/450?src=pr&el=lastupdated.
Read the comment docs https://docs.codecov.io/docs/pull-request-comments
.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/tomastrajan/angular-ngrx-material-starter/pull/450#issuecomment-459615610,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ABRmHp_tnU-8IJ0P-4WdvJAlIU0flljBks5vI9chgaJpZM4ac-d7
.

--
http://gs500coder.blogspot.com

Hi Tomas!
Forgot to run prettier again...
Now the build is passing
On Thu, Jan 31, 2019 at 9:47 PM Tomas Trajan<EMAIL_ADDRESS>wrote:

@shootermv https://github.com/shootermv thanks! Can you please have a
look on failing build?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/tomastrajan/angular-ngrx-material-starter/pull/450#issuecomment-459480856,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ABRmHnd0p5b9-7r0BCsfz9GSBJwR39U5ks5vI0hngaJpZM4ac-d7
.

@shootermv thanks!


What tolerance should I use for scipy.optimize.minimize?

Is there a good way of knowing how much tolerance I need?

@AhmedCode99 I think it is automatically detected by the  algorithm that we have used for the optimization. For example, in our case, wee have used BFGS algorithm, which minimize potential of the cubical structure in 32 steps.


Site is moved to governance.vega.xyz (and governance.fairground.wtf .... all environments)

The Chore
Should do this when Alpha mainnet is launched
What we need to achieve and who for
Tasks

[ ] Site is available at governance.vega.xyz
[ ] The site at token.vega redirects to governance.vega.xyz/token
[ ] Site name is changed to "Vega Governance"
[ ] All variations of URLs
[ ] Redirects from token.vega.xyz URLs to the relevant governance.vega.xyz URLs

Additional details / background info
Epic https://github.com/vegaprotocol/frontend-monorepo/issues/2070

Duplicates #2425


doc: tests: Add test description and requirement IDs in timer

Add requirement IDs for traceability.
Add references to APIs being tested in timer component.
Signed-off-by: Praful Swarnakar<EMAIL_ADDRESS>

Codecov Report

Merging #8766 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master    #8766   +/-   ##
=======================================
  Coverage   52.36%   52.36%
=======================================
  Files         195      195
  Lines       24713    24713
  Branches     5136     5136
=======================================
  Hits        12940    12940
  Misses       9699     9699
  Partials     2074     2074

Impacted Files
Coverage Δ

include/kernel.h
95.31% <ø> (ø)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 41dd662...467c332. Read the comment docs.

@spoorthik
Somehow committed files permission were changed, good that CI could report it. Fixed now.

@nashif: Addressed all the review comments. Kindly check.


Remove tokio_tungstenite from Cargo.toml

          Maybe we can get rid of `tokio_tungstenite` as well (can be done in a separate PR)?

Originally posted by @elmattic in https://github.com/ChainSafe/forest/issues/4008#issuecomment-1969227658

We could maybe use WsClientBuilder instead. See example:
https://github.com/paritytech/jsonrpsee/blob/master/examples/examples/ws.rs


[SPARK-21946][TEST]: fix flaky test: "alter table: rename cached table" in InMemoryCatalogedDDLSuite

What changes were proposed in this pull request?
This PR fixes flaky test InMemoryCatalogedDDLSuite "alter table: rename cached table".
Since this test validates distributed DataFrame, the result should be checked by using checkAnswer. The original version used df.collect().Seq method that does not guaranty an order of each element of the result.
How was this patch tested?
Use existing test case

Test build #81539 has started for PR 19159 at commit 7a47891.

LGTM pending Jenkins.

Test build #81539 has finished for PR 19159 at commit 7a47891.

This patch fails due to an unknown error code, -9.
This patch merges cleanly.
This patch adds no public classes.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/81539/
Test FAILed.

Merged build finished. Test FAILed.

Retest this please.

Test build #81543 has started for PR 19159 at commit 7a47891.

Test build #81543 has finished for PR 19159 at commit 7a47891.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/81543/
Test PASSed.

Thanks! Merged to master/2.2


Success with Alpine Sys LVM Install

I was able to do a "sys" install of Alpine linux using iohyve 0.7.9 with the loader set to grub-bhyve and the os set to custom. The following grub.conf got me to boot the iso correctly:
set root=(cd0,msdos1)
linux /boot/vmlinuz-hardened modules=loop,squashfs,sd-mod,usb-storage quiet nomodeset
initrd /boot/initramfs-hardened
boot

One note about this is that it appears you must do the "set root=" part. I first tried to prepend the (cdX,msdosY) of your Alpine installer ISO and boot, but I got script errors that seemed to prevent me from doing a sys install with LVM enabled. I'm new to both Alpine and Bhyve/Iohyve, but I suspect this is an Alpine quirk.
After doing a sys install with LVM enabled, I was able to boot to the new install with the following grub.conf:
set root=(hd0,msdos1)
linux /vmlinuz-hardened root=/dev/vg0/lv_root modules=sd-mod,usb-storage,ext4 nomodeset quiet rootfstype=ext4
initrd /initramfs-hardened
boot

Thanks for all your work on iohyve. 😃

First off, thanks for the kind words!
Fantastic work! If you don't mind, I'll take this "recipe" and add Alpine to the list of supported OS's.
Thanks for taking the time to let us know about a working solution!

Did you make any changes to the device.map file?
More info can be found here.

Sorry this took me so long...
I didn't have to many any changes to the device.map file, but the first
thing that I tried was setting loader to grub-bhyve and os to alpine and
running iohyve install which I believe created an initial device.map for
me. After I saw it was just dumping me in the grub console (no menus), I
started playing around with setting the os to custom and trying to figure
out good grub console commands to boot the installer. So basically my
device.map file is hd0 and cd0 pointing at the zvol and install iso,
respectively.
On Tue, Jul 18, 2017 at 9:54 PM, Trent<EMAIL_ADDRESS>wrote:

Did you make any changes to the device.map file?
More info can be found here
https://github.com/pr1ntf/iohyve#use-your-own-custom-grubcfg-and-devicemap-files
.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/pr1ntf/iohyve/issues/285#issuecomment-316249407, or mute
the thread
https://github.com/notifications/unsubscribe-auth/ABNY84XTAXTBK2N6ozUkfjqbaVv7MBKzks5sPWHVgaJpZM4OZZTt
.


Support Cake 1.0 RC

Version 2.0.1 of Cake.Recipe doesn't run with Cake 1.0 RC.
Stacktrace:
Error: System.AggregateException: One or more errors occurred. ---> System.NullReferenceException: Object reference not set to an instance of an object.
   at Submission#0.GetConfiguration(ICakeContext context)
   at Submission#0.BuildParameters.SetParameters(ICakeContext context, BuildSystem buildSystem, DirectoryPath sourceDirectoryPath, String title, FilePath solutionFilePath, DirectoryPath solutionDirectoryPath, DirectoryPath rootDirectoryPath, DirectoryPath testDirectoryPath, String testFilePattern, String integrationTestScriptPath, String resharperSettingsFileName, String repositoryOwner, String repositoryName, String appVeyorAccountName, String appVeyorProjectSlug, Boolean shouldPostToGitter, Boolean shouldPostToSlack, Boolean shouldPostToTwitter, Boolean shouldPostToMicrosoftTeams, Boolean shouldSendEmail, Boolean shouldDownloadMilestoneReleaseNotes, Boolean shouldDownloadFullReleaseNotes, Boolean shouldNotifyBetaReleases, Boolean shouldDeleteCachedFiles, Boolean shouldUseDeterministicBuilds, FilePath milestoneReleaseNotesFilePath, FilePath fullReleaseNotesFilePath, Boolean shouldRunChocolatey, Boolean shouldPublishGitHub, Boolean shouldGenerateDocumentation, Boolean shouldDocumentSourceFiles, Boolean shouldRunDupFinder, Boolean shouldRunInspectCode, Boolean shouldRunCoveralls, Boolean shouldRunCodecov, Boolean shouldRunDotNetCorePack, Boolean shouldBuildNugetSourcePackage, Boolean shouldRunIntegrationTests, Boolean shouldCalculateVersion, Nullable`1 shouldUseTargetFrameworkPath, Nullable`1 transifexEnabled, TransifexMode transifexPullMode, Int32 transifexPullPercentage, String gitterMessage, String microsoftTeamsMessage, String twitterMessage, DirectoryPath wyamRootDirectoryPath, DirectoryPath wyamPublishDirectoryPath, FilePath wyamConfigurationFile, String wyamRecipe, String wyamTheme, String wyamSourceFiles, String webHost, String webLinkRoot, String webBaseEditUrl, FilePath nuspecFilePath, Boolean isPublicRepository, FilePath nugetConfig, ICollection`1 nuGetSources, Boolean treatWarningsAsErrors, String masterBranchName, String developBranchName, String emailRecipient, String emailSenderName, String emailSenderAddress, DirectoryPath restorePackagesDirectory, List`1 packageSourceDatas, PlatformFamily preferredBuildAgentOperatingSystem, BuildProviderType preferredBuildProviderType)
   at Submission#0.<<Initialize>>d__0.MoveNext()
--- End of stack trace from previous location where exception was thrown ---

Issue is at https://github.com/cake-contrib/Cake.Recipe/blob/736e9a9baa0398e105b005559e8fc25c2896d401/Cake.Recipe/Content/configuration.cake#L4 which is no longer a dictionary

Closing this one in favor of #762 (Support for Cake 1.0 RTM)


Cannot get transporter to work with local ReThinkDB and Postres

Bug report
I am attempting to run everything locally just to prove all my tools work. I have local ReThinkDB and Postgres instances running and I have tested I can connect to them.
When I run transporter with my pipeline (below), "test" seems to work fine (I think? I'm not sure what it's supposed to do or print out exactly. Doesn't look like an error anyway):
$ transporter test -log.level "debug" local-pipeline.js
Transporter:
 - Source:         source                                   rethinkdb       .*
  - Sink:          sink                                     postgres        .*

But "run" executes for 5-10 seconds and then errors out with:
$ transporter run -log.level "debug" local-pipeline.js
INFO[0000] boot map[sink:postgres source:rethinkdb]      ts=1503350106844506490
INFO[0000] existing messages in commitlog, checking writer offsets...  name=source newestOffset=12 oldestOffset=0 path=source type=rethinkdb
INFO[0000] offsetMap: map[]                              name=sink path=source type=rethinkdb
INFO[0000] searching segments                            num_segments=1 offset=-1
INFO[0000] waiting for all children to resume...         name=source path=source type=rethinkdb
INFO[0000] adaptor Resuming...                           name=sink path="source/sink" type=postgres
INFO[0000] adaptor Listening...                          name=sink path="source/sink" type=postgres
INFO[0000] still resuming...                             log_offset=11 name=sink offset=1 path="source/sink" percent_complete=9.090909090909092 type=postgres
INFO[0000] still resuming...                             log_offset=11 name=sink offset=2 path="source/sink" percent_complete=18.181818181818183 type=postgres
INFO[0000] still resuming...                             log_offset=11 name=sink offset=3 path="source/sink" percent_complete=27.27272727272727 type=postgres
INFO[0000] still resuming...                             log_offset=11 name=sink offset=4 path="source/sink" percent_complete=36.36363636363637 type=postgres
INFO[0000] still resuming...                             log_offset=11 name=sink offset=5 path="source/sink" percent_complete=45.45454545454545 type=postgres
INFO[0000] still resuming...                             log_offset=11 name=sink offset=6 path="source/sink" percent_complete=54.54545454545454 type=postgres
INFO[0000] still resuming...                             log_offset=11 name=sink offset=7 path="source/sink" percent_complete=63.63636363636363 type=postgres
INFO[0000] still resuming...                             log_offset=11 name=sink offset=8 path="source/sink" percent_complete=72.72727272727273 type=postgres
INFO[0000] still resuming...                             log_offset=11 name=sink offset=9 path="source/sink" percent_complete=81.81818181818183 type=postgres
INFO[0000] still resuming...                             log_offset=11 name=sink offset=10 path="source/sink" percent_complete=90.9090909090909 type=postgres
INFO[0000] still resuming...                             log_offset=11 name=sink offset=11 path="source/sink" percent_complete=100 type=postgres
INFO[0000] adaptor Stopping...                           name=source path=source type=rethinkdb
INFO[0000] adaptor Listen closed...                      name=sink path="source/sink" type=postgres
INFO[0005] metrics source records: 0                     path=source ts=1503350111844509763
INFO[0005] metrics source/sink records: 0                path="source/sink" ts=1503350111844514521
INFO[0010] metrics source records: 0                     path=source ts=1503350116846960978
INFO[0010] metrics source/sink records: 0                path="source/sink" ts=1503350116846965936
ERRO[0010] timeout reached waiting for Out channels to clear  path=source
INFO[0010] adaptor Stopped                               name=source path=source type=rethinkdb
INFO[0010] adaptor Stopping...                           name=sink path="source/sink" type=postgres
INFO[0010] adaptor Stopped                               name=sink path="source/sink" type=postgres
INFO[0010] metrics source records: 0                     path=source ts=1503350116881053539
INFO[0010] metrics source/sink records: 0                path="source/sink" ts=1503350116881055658
INFO[0010] exit map[source:rethinkdb sink:postgres]      ts=1503350116881056052
dial tcp [::1]:5439: getsockopt: connection refused
INFO[0010] waitForConfirms stopped                       name=sink path="source/sink" type=postgres

Relevant pipeline.js:
var source = rethinkdb({
  uri: "rethink://<IP_ADDRESS>:28015/test",
  timeout: "60s",
  "debug": true,
  tail: true
})

var sink = postgres({
  uri: "postgres://localhost:5439/dev?user=postgres&sslmode=disable",
  timeout: "60s",
  sslmode: false,
  debug: true,
  tail: false,
  // "replication_slot": "slot"
})

t.Config({log_dir:"~/data/transporter"})
.Source("source", source, "/.*/")
.Save("sink", sink, "/.*/")

System info:
Mac 10.12.6
Darwin Geoffs-MacBook-Pro.local 16.7.0 Darwin Kernel Version 16.7.0: Thu Jun 15 17:36:27 PDT 2017; root:xnu-3789.70.16~2/RELEASE_X86_64 x86_64

Transporter version 0.4.0
OS (see above)
DB version(s) Postgres=9.6.4, ReThinkDB=2.3.4

Reproducible Steps:

Install local postgres, create db "dev"
Install local ReThinkDB, create db "test"
Install transporter, run pipeline above.

What did you expect to happened?
I expected it to begin syncing.
What actually happened?

The "test" output isn't clear about whether connections are succeeding or not.
The "run" output errors out and I don't know what the error means.

@codepope @jipperinbham

@GeoffreyPlitt I was able to reproduce locally and it using the a stock postgresql, the default port is 5432. Here's the pipeline.js I used:
var source = rethinkdb({
  uri: "rethink://<IP_ADDRESS>:28015/test",
  timeout: "60s",
  tail: true
})

var sink = postgres({
  uri: "postgres://postgres:postgres@localhost:5432/dev?sslmode=disable",
  timeout: "60s",
})

t.Source("source", source).Save("sink", sink)

You also need to create the database and associated tables in the Pg database prior to running transporter as it currently does not do schema management.

Thanks!


cilium v1.14.3, kubernetes v1.28.2 Endpoint unreachability for only one node

Is there an existing issue for this?

[X] I have searched the existing issues

What happened?
I have 2 EKS clusters setup in two different regions, and they are VPC peered.
Both clusters have 2 nodes each, running cilium v1.14.3, kubernetes v1.28.2.
CoreDNS pods are running, restarted them - did not help.
clustermesh status and cilium status on both clusters seem perfectly alright.
On cluster1, all 4 endpoints are reachable. But on cluster2 only 3 endpoints are reachable. The unreachable endpoint is from one of the two nodes in other region (1 node endpoint from other region  is reachable).
I had tried this with cilium v1.14.2 on kubernetes v1.28, v1.27.
cilium v1.14.3 on kubernetes v1.27, v1.28.
cluster2
Cluster health:                                                3/4 reachable   (2023-11-04T23:13:37Z)
  Name                                                         IP              Node        Endpoints
  clus2/ip-10-0-1-114.eu-west-2.compute.internal (localhost)   <IP_ADDRESS>      reachable   reachable
  clus2/ip-10-0-2-8.eu-west-2.compute.internal                 <IP_ADDRESS>        reachable   reachable
  clustr1/ip-10-1-129-173.eu-west-1.compute.internal           <IP_ADDRESS>    reachable   reachable
  clustr1/ip-10-1-159-37.eu-west-1.compute.internal            <IP_ADDRESS>     reachable   unreachable

cluster1
Cluster health:                                                    4/4 reachable   (2023-11-04T23:13:55Z)
  Name                                                             IP              Node        Endpoints
  clustr1/ip-10-1-129-173.eu-west-1.compute.internal (localhost)   <IP_ADDRESS>    reachable   reachable
  clus2/ip-10-0-1-114.eu-west-2.compute.internal                   <IP_ADDRESS>      reachable   reachable
  clus2/ip-10-0-2-8.eu-west-2.compute.internal                     <IP_ADDRESS>        reachable   reachable
  clustr1/ip-10-1-159-37.eu-west-1.compute.internal                <IP_ADDRESS>     reachable   reachable

cilium-health status on cluster2 cilium agent:
# cilium-health status
Probe time:   2023-11-04T23:25:37Z
Nodes:
  clus2/ip-10-0-1-114.eu-west-2.compute.internal (localhost):
    Host connectivity to <IP_ADDRESS>:
      ICMP to stack:   OK, RTT=272.479µs
      HTTP to agent:   OK, RTT=134.233µs
    Endpoint connectivity to <IP_ADDRESS>:
      ICMP to stack:   OK, RTT=301.788µs
      HTTP to agent:   OK, RTT=277.739µs
  clus2/ip-10-0-2-8.eu-west-2.compute.internal:
    Host connectivity to <IP_ADDRESS>:
      ICMP to stack:   OK, RTT=1.044299ms
      HTTP to agent:   OK, RTT=1.026904ms
    Endpoint connectivity to <IP_ADDRESS>:
      ICMP to stack:   OK, RTT=1.053062ms
      HTTP to agent:   OK, RTT=992.025µs
  clustr1/ip-10-1-129-173.eu-west-1.compute.internal:
    Host connectivity to <IP_ADDRESS>:
      ICMP to stack:   OK, RTT=13.268929ms
      HTTP to agent:   OK, RTT=12.361398ms
    Endpoint connectivity to <IP_ADDRESS>:
      ICMP to stack:   OK, RTT=10.573817ms
      HTTP to agent:   OK, RTT=11.697483ms
  clustr1/ip-10-1-159-37.eu-west-1.compute.internal:
    Host connectivity to <IP_ADDRESS>:
      ICMP to stack:   OK, RTT=10.896389ms
      HTTP to agent:   OK, RTT=11.620258ms
    Endpoint connectivity to <IP_ADDRESS>:
      ICMP to stack:   Connection timed out
      HTTP to agent:   Get "http://<IP_ADDRESS>:4240/hello": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

Cilium Version
1.14.3
Kernel Version
aarch64 aarch64 aarch64 GNU/Linux
Kubernetes Version
1.28.2
Sysdump
cluster2 sysdump
cilium-sysdump-20231104-232847.zip
cluster1 sysdump
cilium-sysdump-20231104-233044.zip
Relevant log output
No response
Anything else?
 subsys=klog
level=info msg="successfully acquired lease kube-system/cilium-l2announce-cilium-test-echo-same-node" subsys=klog
level=info msg="attempting to acquire leader lease kube-system/cilium-l2announce-cilium-test-echo-other-node..." subsys=klog
level=info msg="successfully acquired lease kube-system/cilium-l2announce-cilium-test-echo-other-node" subsys=klog
level=info msg="regenerating all endpoints" reason="one or more identities created or deleted" subsys=endpoint-manager
level=info msg="regenerating all endpoints" reason="one or more identities created or deleted" subsys=endpoint-manager
level=info msg="regenerating all endpoints" reason="one or more identities created or deleted" subsys=endpoint-manager
level=info msg="regenerating all endpoints" reason= subsys=endpoint-manager
level=warning msg="Unable to install direct node route {Ifindex: 0 Dst: <IP_ADDRESS>/24 Src: <nil> Gw: <IP_ADDRESS> Flags: [] Table: 0 Realm: 0}" error="route to destination <IP_ADDRESS> contains gateway <IP_ADDRESS>, must be directly reachable" subsys=linux-datapath
level=warning msg="Unable to install direct node route {Ifindex: 0 Dst: <IP_ADDRESS>/24 Src: <nil> Gw: <IP_ADDRESS> Flags: [] Table: 0 Realm: 0}" error="route to destination <IP_ADDRESS> contains gateway <IP_ADDRESS>, must be directly reachable" subsys=linux-datapath
level=warning msg="Unable to install direct node route {Ifindex: 0 Dst: <IP_ADDRESS>/24 Src: <nil> Gw: <IP_ADDRESS> Flags: [] Table: 0 Realm: 0}" error="route to destination <IP_ADDRESS> contains gateway <IP_ADDRESS>, must be directly reachable" subsys=linux-datapath
level=warning msg="Unable to install direct node route {Ifindex: 0 Dst: <IP_ADDRESS>/24 Src: <nil> Gw: <IP_ADDRESS> Flags: [] Table: 0 Realm: 0}" error="route to destination <IP_ADDRESS> contains gateway <IP_ADDRESS>, must be directly reachable" subsys=linux-datapath
level=warning msg="Unable to install direct node route {Ifindex: 0 Dst: <IP_ADDRESS>/24 Src: <nil> Gw: <IP_ADDRESS> Flags: [] Table: 0 Realm: 0}" error="route to destination <IP_ADDRESS> contains gateway <IP_ADDRESS>, must be directly reachable" subsys=linux-datapath
level=warning msg="Unable to install direct node route {Ifindex: 0 Dst: <IP_ADDRESS>/24 Src: <nil> Gw: <IP_ADDRESS> Flags: [] Table: 0 Realm: 0}" error="route to destination <IP_ADDRESS> contains gateway <IP_ADDRESS>, must be directly reachable" subsys=linux-datapath

Connectivity test
cilium connectivity test
ℹ  Monitor aggregation detected, will skip some flow validation steps
✨ [default] Creating namespace cilium-test for connectivity check...
✨ [default] Deploying echo-same-node service...
✨ [default] Deploying DNS test server configmap...
✨ [default] Deploying same-node deployment...
✨ [default] Deploying client deployment...
✨ [default] Deploying client2 deployment...
✨ [default] Deploying echo-other-node service...
✨ [default] Deploying other-node deployment...
✨ [host-netns] Deploying default daemonset...
✨ [host-netns-non-cilium] Deploying default daemonset...
ℹ  Skipping tests that require a node Without Cilium
⌛ [default] Waiting for deployment cilium-test/client to become ready...
⌛ [default] Waiting for deployment cilium-test/client2 to become ready...
⌛ [default] Waiting for deployment cilium-test/echo-same-node to become ready...
⌛ [default] Waiting for deployment cilium-test/echo-other-node to become ready...
⌛ [default] Waiting for CiliumEndpoint for pod cilium-test/client-78f9dffc84-ntwrv to appear...
⌛ [default] Waiting for CiliumEndpoint for pod cilium-test/client2-59b578d4bb-74zlm to appear...
⌛ [default] Waiting for pod cilium-test/client-78f9dffc84-ntwrv to reach DNS server on cilium-test/echo-same-node-7c4889767f-dvlpl pod...
⌛ [default] Waiting for pod cilium-test/client2-59b578d4bb-74zlm to reach DNS server on cilium-test/echo-same-node-7c4889767f-dvlpl pod...
⌛ [default] Waiting for pod cilium-test/client-78f9dffc84-ntwrv to reach DNS server on cilium-test/echo-other-node-79bdc8d8df-jtqh5 pod...
connectivity test failed: timeout reached waiting for lookup for localhost from pod cilium-test/client-78f9dffc84-ntwrv to server on pod cilium-test/echo-other-node-79bdc8d8df-jtqh5 to succeed (last error: context deadline exceeded)

@dalekurt , whats the output of cilium-health status from cilium agent pod ?

@Rammurthy5 This is the output from a cilium pod
# cilium-health status
Probe time:   2023-11-13T17:42:12Z
Nodes:
  home-cluster/worker-1 (localhost):
    Host connectivity to <IP_ADDRESS>:
      ICMP to stack:   OK, RTT=299.734µs
      HTTP to agent:   OK, RTT=341.395µs
    Endpoint connectivity to <IP_ADDRESS>:
      ICMP to stack:   OK, RTT=269.358µs
      HTTP to agent:   OK, RTT=316.849µs
  home-cluster/control-plane:
    Host connectivity to <IP_ADDRESS>:
      ICMP to stack:   OK, RTT=598.958µs
      HTTP to agent:   OK, RTT=1.880238ms
    Endpoint connectivity to <IP_ADDRESS>:
      ICMP to stack:   Connection timed out
      HTTP to agent:   Get "http://<IP_ADDRESS>:4240/hello": dial tcp <IP_ADDRESS>:4240: connect: network is unreachable
  home-cluster/worker-2:
    Host connectivity to <IP_ADDRESS>:
      ICMP to stack:   OK, RTT=716.995µs
      HTTP to agent:   OK, RTT=1.968185ms
    Endpoint connectivity to <IP_ADDRESS>:
      ICMP to stack:   Connection timed out
      HTTP to agent:   Get "http://<IP_ADDRESS>:4240/hello": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
  home-cluster/worker-3:
    Host connectivity to <IP_ADDRESS>:
      ICMP to stack:   OK, RTT=721.465µs
      HTTP to agent:   OK, RTT=2.327739ms
    Endpoint connectivity to <IP_ADDRESS>:
      ICMP to stack:   Connection timed out
      HTTP to agent:   Get "http://<IP_ADDRESS>:4240/hello": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
      ```

helm install cilium cilium/cilium --kube-context $CONTEXT1
--namespace kube-system
--set eni.enabled=true
--set ipam.mode=eni
--set egressMasqueradeInterfaces=eth0
--set kubeProxyReplacement=strict
--set tunnel=disabled
--set k8sServiceHost=${API_SERVER_IP}
--set k8sServicePort=${API_SERVER_PORT}
--set cluster.name=clustr1
--set cluster.id=1
--set encryption.enabled=true
--set encryption.type=wireguard
--set l7Proxy=false

Not sure if this is 100% of your issue, but kubeProxyReplacement=strict should be kubeProxyReplacement=true in 1.14.3. I noticed my cilium pods kept crashing until I fixed this.
https://github.com/cilium/cilium/blob/71908e7cd610e516461e92cf817e6cd9b3ada0f6/install/kubernetes/cilium/values.yaml.tmpl#L1712

Hey @Rammurthy5, it seems that you hit https://github.com/cilium/cilium/issues/25804. TL;DR; you need to cleanup stale AWS iptables chains on your nodes: https://github.com/cilium/cilium/blob/b2ff0771cdfa8d35e8e0e923b9e39083e0c8197f/Documentation/installation/k8s-install-helm.rst?plain=1#L210-L217
@dalekurt According to the logs, you configured Cilium in direct routing mode using autoDirectNodeRoutes, but some of the nodes are not directly reachable:

level=warning msg="Unable to install direct node route {Ifindex: 0 Dst: <IP_ADDRESS>/24 Src:  Gw: <IP_ADDRESS> Flags: [] Table: 0 Realm: 0}" error="route to destination <IP_ADDRESS> contains gateway <IP_ADDRESS>, must be directly reachable" subsys=linux-datapath

This is not possible. The error is also not related to clustermesh (and the original report), as all nodes in the health status report belong to the same cluster.
I'm closing this issue as https://github.com/cilium/cilium/issues/25804 has been fixed (https://github.com/cilium/cilium/pull/29448 is also following up on another related issue).


the verification message of some input-boxes of i18n is not accurate.

At present, all pages are like this, for example:

what is the proposal with this issue ?

When I switch languages, the verification message of the input box can be changed synchronously


[BUG] depth image is corrupted

Im trying to visualize the depth information of the oak-d camera but there nothing. Also i would like to understand its shape.
is get (720 ,1280,2), why is there two channels in the depth information?
Minimal Reproducible Example
Append the MRE to the bug report, instructions here
roslaunch depthai_examples stereo_inertial_publisher.launch
Attach system log

Additional context
ros : melodic

Hello. How are you interpreting it. and what are you trying to interpret it ?
it is (720, 1280) of type uint16 since depth is in mm here. And lower the values the blacker the image looks. it means the depth is closer and hard to see it that way. Please check the point cloud visualization that comes with it.

when i checked it said the depth type was uint8 and the shape was (720,1280). Here how i read it
since i cant used cv_bridge, this is how i decode the depth image from topic : /stereo_inertial_publisher/stereo/depth
depth_image = np.frombuffer(depth_msg.data, dtype=np.uint8).reshape(depth_msg.height, depth_msg.width, -1)

ok so i changed the type to unit16 and it is now only 1channel


Change from today to overdue doesn't show items due today

Latest changelog says alias for today was changed to overdue. Overdue does not list items due today and 'today' is no longer a valid command.

I've included an alias command really just to serve as an example of what they can do.  I changed the command from the today command to the overdue command since I thought it was easier to understand what the filter is doing.
The overdue command is supposed to show tasks that are past due (so it's purposefully not showing tasks due today).
If you want the previous today command you can add the following to your personal config file (~/.rtm.json):
"aliases": [
    {
      "name": "today",
      "description": "Display tasks with a priority, due or completed today, or overdue",
      "command": "lsp",
      "args": "(not priority:none and status:incomplete) or completed:today or (dueBefore:tomorrow and status:incomplete)"
    }
  ]


It is actually called at <= Dispatch Level

@tedhudek
Assuming the yaml is correct, can you promote this?


Add expiration time for allow list items

In many cases there's not much that you can do for the vulnerability at the time it is alerted. However, maybe the fix is being worked on but not released. For this purpose it would make sense to have expiry times for ignored vulnerabilities so that the developer remembers to check it again after a while. For the reference, better-npm-audit support such functionality via expiry field: https://github.com/jeemok/better-npm-audit#using-nsprc-file-to-manage-exceptions

This would also be useful in cases where a policy dictates different time windows for different levels of advisory (e.g. 7 days for low vulnerabilities, 24 hours for critical etc). Without this addition, the only option is to either immediately action the fix, or to add the advisory to the ignored list, where it can easily be forgotten.


How you implement Smart warming up function ?

How you implement Smart warming up function ?

It is located here:
https://github.com/Erriez/ErriezMHZ19B/blob/8a163d57d587b53571ba1f2a1083de460a505afd/src/ErriezMHZ19B.cpp#L96
A combination of minimum time after power-on and exit warming-up on a CO2 value change.

Trying to write it on my own, but there is something with data. And I must reset Processor to get true data, actually don't understand how to avoid it

Did you run the example https://github.com/Erriez/ErriezMHZ19B/tree/master/examples/ErriezMHZ19BGettingStarted ?

Yes, I use your example, with uncommented  "MHZ19B_SMART_WARMING_UP" it works fine


best practice for snapshot_every_n_steps

Hello,
Thank you for your awesome implementation of StatefulDataloader.
I have a question about snapshot_every_n_steps. It seems there is not much detailed explanation about this argument.

Will frequent snapshots (i.e., snapshot_every_n_steps=1) cause a data loading burden?
What is the best practice for setting this value? Is it related to checkpointing frequency?

cc @andrewkho

Hi @ShoufaChen thanks for the issue, we should update the documentation to explain this better.
To answer your questions: it depends mainly on the size and composition of your state. If you're storing eg an int representing index or file-offset, then it shouldn't be an issue. If your state is very large, involving eg buffers of data for shuffling, then the overhead of creating a checkpoint and passing it through multiprocessing queue may slow down training, this variable lets you decrease the frequency of checkpointing. If eg you know you're checkpointing every 1000 steps, you can set this value to 1000.

@andrewkho Hi, wondering if this arg will affects the final state loading? For example, if snapshot_every_n_steps=4, what will happen if I want to load_state_dict or save state_dict at the 5th step?
Does that me I should always need to make the steps for ckpting divisible by snapshot_every_n_steps?
Thank you.

@yzhangcs you can still request a checkpoint/state_dict at any time, the dataloader will load the last snapshot and "fast forward" the required steps to get to the correct point. In your example, dataloader would load the state from step 4, then throw away one batch before continuing at step 5. Hope this helps!
@divyanshk lets double check if our docs can be improved

@andrewkho I see! Thank you for ur quick response. But then I’m curious why not directly save the last snapshot once needed. From what u said, can I assume that larger is better for this value?

@andrewkho thank you for the nice response!
That is a very clever tradeoff

@andrewkho It would be better if adding explanations of “fast forward” into docs for anyone curious about it


Sound issue

Hi again,
I have tried this on my PC. I had some better luck but the i cant get the voice to work.
I followed all your steps.

But it still don't work. Do you have any suggestions?

Try setting the mic as the default communications device rather than the default device. It should let you right click and set both.
does it say anything in terminal? Or do you have a thick accent? The name is pronounced my-els

haha, nah my accent is just fine. I had a lot of issues with Miles on PC. I got it to work twice but as soon as miles responded the program crashed. And after a restart it started complaining for the modules.
Server started on http://localhost:3000
API keys are set, starting server and backend...
Server is already running on port 3000
Python Error: C:\Miles-env\M.I.L.E.S\Miles-V2\main.py:1: DeprecationWarning: 'cgi' is deprecated and slated for removal in Python 3.13
from cgi import print_directory
Python Error: Traceback (most recent call last):
File "C:\Miles-env\M.I.L.E.S\Miles-V2\main.py", line 7, in
import openai
ModuleNotFoundError: No module named 'openai'
Python script exited with code: 1
But even on my Mac, I had some problems with ffmpeg or avconv error but got that solved. Still Miles is not responding. And i check the sound settings in midi too. Its very strange.

Do you have a lot of noise in your room? Sometimes, things like air conditioning can permanently cause miles to be stuck in a state of listening. Sometimes it can also prevent the wake word from being used. For dependancies, you might just have to create a new venv and reinstall each module one by one, it’s what I have to do sometimes.

I managed to get it working on the Mac, No, no sound in the room at all. But you were right, Miles was stuck. I never figured out why, but a reboot solved it.
Thank you for the assistance.


Move away from using Prelude / glob imports

Problem
Based on much feedback from @EdJoPaTo across multiple PRs, as well as seeking external feedback on users.rust-lang.org, reddit, our forum and discord servers, it's time to fix up how we use the prelude.

https://users.rust-lang.org/t/to-use-prelude-or-to-not-to-use-prelude-that-is-the-question/110855
https://www.reddit.com/r/rust/comments/1cle18j/to_prelude_or_to_not_to_prelude/
https://discord.com/channels/1070692720437383208/1070692720437383211/1236238741001994340
https://forum.ratatui.rs/t/help-us-understand-prelude-usage/33

The overwhelming response gave me the impression at least in code that is used for teaching / communicating that the prelude causes more harm than good. This was counter to my prior understanding of this.
Solution

[ ] Summarize the responses more fully (perhaps write a blog post about this)
[x] Fixup the common vocabulary (https://github.com/ratatui-org/ratatui/pull/1149)
[x] Remove prelude from examples/*.rs (https://github.com/ratatui-org/ratatui/pull/1152)
[ ] Remove the prelude from visible portions of examples in rustdocs
[ ] Remove the prelude from tutorial code on the website

Alternatives

Additional context

Added https://github.com/ratatui/ratatui-website/issues/750 for the website side of this


There exists a bug

If you join party room
The IP sometimes get different IP, but in the same room
Therefore can't join together

@Lo0519 Is your client the latest version?
Lu0519<EMAIL_ADDRESS>於 2015年7月21日週二 下午12:53 寫道：

If you join party room
The IP sometimes get different IP, but in the same room
Therefore can't join together
—
Reply to this email directly or view it on GitHub
https://github.com/dimotsai/agar-mini-map/issues/15.

Yes, the latest.
It seldom occurs, not so frequently.
But, there's one major bug:
In the middle part of the map, the information will be shown, and it's sometimes doesn't even exist one there.

@Lu0519 會不會是某些人的 Client 不是最新的，lag 的問題希望可以開另外一篇 issue，感謝你的回報。

不會哦，因為是我雙開，所以才覺得怪怪的 (只出現過一次，要出現也不是很容易)

我以為我修掉這個問題了，如果有重現 bug 的方法會比較容易找到問題在哪
Lu0519<EMAIL_ADDRESS>於 2015年7月21日週二 下午8:13 寫道：

不會哦，因為是我雙開，所以才覺得怪怪的 (只出現過一次，要出現也不是很容易)
—
Reply to this email directly or view it on GitHub
https://github.com/dimotsai/agar-mini-map/issues/15#issuecomment-123286518
.

IP位置：目前不明，我在測試看看
中間球球：幾乎每場都會有這問題

不存在的球應該是疊到不同伺服器資料
Lu0519<EMAIL_ADDRESS>於 2015年7月21日週二 下午8:18 寫道：

IP位置：目前不明，我在測試看看
中間球球：幾乎每場都會有這問題
—
Reply to this email directly or view it on GitHub
https://github.com/dimotsai/agar-mini-map/issues/15#issuecomment-123287317
.

IP位置，可能問題：
自己自己 (<IP_ADDRESS>)，別人在連，會有這種現象

@Lu0519 https://gitter.im/dimotsai/agar-mini-map 即時討論，希望可以一同測試

It seems that one server may host multiple game rooms at the same time

Yes servers host multiple games at same time. Try to find correct one, minimap is working well...

@eve8 Is there any way to determine whether we are in the same game or not?

There is no way, unless you manually go to their location and if they are really there or not. Btw I don't know what they were thinking to host multiple servers on same IP. That's weird..

Sometimes it uses hostnames and sometimes ip
I guess this could be the problem - i just refresh the browser window and everything works.

i've noticed that if you sign in with a linked facebook or google account, the client will make a secure websocket connection to wss://web-live-v3-0.agario.miniclippt.com/ws
this leads the script into thinking this is the connection passing gameplay data, when it actually is just for account data (hence the wsS)
in my experience and in others, this seems to be the culprit. I started working on a fix for this and so far have just added a conditional to check for wss vs ws. if the url is secure, it will send the insecure address to the server instead.


Update extension description to indicate its use with peer2peer test app...

... instead of generic "my app"

The extension was added for general use, not only peer2peer but at the moment it seems to be the only app in this github repo using so it's probably okay.

Ted, do you agree with my comment? If so please close this ;)

Ah, sorry I missed your replies. Keeping the existing text as-is is fine with me.


autodetect if skip frames is supported for input type

implemented via https://github.com/vladmandic/human/commit/5e90ab0d519844bcf07e2b2338bf32ae93e058c3


inferno alias doesn't work when creating new project

Description
When running brunch new -s inferno I get a warning that brunch couldn't interpret 'inferno' as a hosted git url
Expected behaviour
it should be able to clone the skeleton
Actual behaviour
cloning the repo fails.
$ brunch new -s inferno
13 Jan 17:52:47 - warn: Couldn't interpret 'inferno' as a hosted git url
13 Jan 17:52:47 - log: Cloning git repo "inferno" to "/Users/rafaelkallis/.brunch/skeletons/792883c4eebc3b69fa15b94e87456cf2c566c202"...
13 Jan 17:52:47 - error: Error: Git clone error: fatal: repository 'inferno' does not exist

Environment

Brunch: 2.9.1
Node: 6.9.1
NPM: 4.1.2
Operating system: macOS 10.12.2

Published a new version of skeletons which fixes that.


Add Android library project

Makes it possible (and easy) to use ZXing C++ with any Android app.
Android components are distributed as so-called Android Archives (AAR) which are basically JARs with Android resources. This commit adds a library project that bundles the native libraries and the necessary (JNI) wrapper in a generic form.
The resulting AAR file can easily be dropped in any Android app and makes ZXing C++ immediately useable without having to clone and build the ZXing C++ core libraries and JNI wrapper in the context of another app.
To check the fitness of the library, there's a sample/demo app beside the library project. This app, and the library, is based on the sources in wrappers/android.
However, the JNI wrapper of this library differs from wrappers/android to make it usable for Android's legacy camera API, Camera2 as well as CameraX. The returned result (object) now contains all available data (including binary data and meta stuff). And there are functions for barcode generation too.
The sample app was migrated from Kotlin synthetics to simple findViewById()s because Kotlin synthetics are deprecated (in favor of view binding, which I didn't use because I think a sample should be as simple and basic as possible).
There's also an (untested!) JitPack integration to automatically publish this library on jitpack.io as soon as there's a Release on GitHub for version "v1.2.1" (see "afterEvaluate" in zxingcpp/build.gradle). JitPack should build this library as soon as it is requested - I'm just unsure if JitPack will find the (correct) build.gradle because it's in wrappers/aar and not in the root folder. Unfortunately, there's no way to test this apart from trying it.
I've tried to stick to the coding style and conventions of the root project as much as possible. If there's anything you don't like, please let me know and I will fix it.

Thank you for your contribution!
I agree with your changes for going with automatic binding and making it work with other camera API.
The ability to export image as text or SVG is interesting.
And I have no complains about the coding style.
My only concern is now there are 2 wrappers for Android with some code duplication. It's maybe good idea to to merge them together? @axxel may have some opinions?

I have not looked at the code, yet, but also don't like the code duplication aspect of it. I'll gladly take a closer look later this week (maybe today) and come up with a suggestion on how I would personally prefer to proceed. Grüße nach N aus B ;)

Danke und schöne Grüße zurück 😉
I just noted that it's probably wrong to just put Result.rawBytes() (from the C++ side) into Result.rawBytes (on the JVM), as I do in the PR. Result.rawBytes() contains the raw data before decoding - but what an Android app needs is the decoded data in an unconverted form. Before String conversion, which may corrupt binary data in UTF32 to UTF16 conversion.
As it's now, it's unreliable to read barcodes with binary content (DataMatrix, QR Codes in binary mode) from Android because Result will contain potentially corrupted data in Result.text and undecoded, obscure data in Result.rawBytes.
My "fix" would be to put wstring Result.text() into a (JVM) ByteArray and give this as rawBytes to Android. If you like that approach, would you prefer another commit in this PR or an extra PR for this change? Or would you prefer an additional member in the (JVM) Result for the decoded ByteArray?
As for the duplication aspect, I just didn't want to be too invasive and make grave changes to the existing wrapper.

Thanks for your effort and intention to contribute! I'm not an Android guy and appreciate input from people who know the best practices in this regard. As I understand, your PR has a couple separate intentions, like

making the library more accessible by providing a binary bundle as the primary goal
fixing some deprecation warnings in the example app
supporting a deprecated camera API
enable some form of barcode generation support

All of that seems generally reasonable to me. That said, I'm strongly opinionated against the introduction of those in basically a copy of the existing wrapper. If you feel like spending the extra time is worth it for you, I'd like to propose the following way forward: you come up with a new PR that only deals with the first goal and does that as a change of the existing wrapper. After that worked out, we proceed from there.

Well, I was hoping to replace the existing wrapper with this solution, but I understand that it might be a bit much for just one PR. There are a lot of changes and some of them must seem unrelated or opinionated to you.
And I just realized that I kind of messed up the description of this PR 🙈 Because it's already possible to build an AAR (e.g. a binary bundle) with the existing wrapper (just run $ ./gradlew :zxingcpp:assembleRelease). Strictly speaking there's nothing that needs to change for the goal of providing a binary bundle that can be used in other apps.
What is missing, and what I can make another PR for if you want, is the automatic distribution of that binary bundle over jitpack.io (would be just a few lines in wrappers/android/zxingcpp/build.gradle, essentially this block).
But - the resulting binary bundle would have a few disadvantages:

It's package name would be com.example.zxingcpp, what's not a good name for a production library.
It's not minified and cannot be minified (in a project that makes use of this library) because it's missing the proper configuration (specifically this).
It depends on CameraX. CameraX is just a support library that's based on the Camera2 API. So an implementor would have to use CameraX too, even if the app works with the Camera2 API.
It requires minSdkVersion 26, what excludes many devices today. Especially outside the western hemisphere.

If you want, I can fix any of these things in the new PR too. Just as you choose. However, removing the CameraX requirement would bring us a good step closer to this PR 😉 These are probably the biggest problems for Android developers that may keep them from using this as a ready-to-use binary bundle. At least these are the reasons I can't use it.
What I should have described better is that this solution not only provides a binary bundle, but also adds (almost) all features to make it a convenient replacement for the Java version of ZXing. This includes barcode generation, but also the extended result and especially the ability to use it with whatever camera API and Android version there is.
So, instead of having everyone solve the same problems again and again, I thought it would be a good idea to improve the existing wrapper to be a full-fledged replacement for the (slow and stagnant) Java version of ZXing. This is why there's so much in this PR. Sorry for the mess and for not being clearer.
Please tell me what from the above things you want to have in the new PR and I will make one.

Thanks for the detailed feedback and analysis. I suggest we start with a prioritization of "low hanging fruit" / importance.

package name: you chose "com.nubook.android.zxingcpp". why "android"? Maybe we could use the opportunity and try to get a little closer to #44 by using a more generic name than 'nubook'. Upstream is apparently called "com.google.zxing" which seems weird to me, now that I think about it. Any suggestions?
not sure what minification flag you are specifically talking about but sounds like a no-brainer
CameraX: I got the impression that this is the way to go according to Google when releasing anything new related to camera stuff. I'd very much like to offer a dead-simple and 'natural feeling' API and ImageProxy seemed to me to be the right level of abstraction (requiring the user to know that she has to pick the first of several color planes to make this work is too low level in my opinion).
minSdkVersion: what would be a reasonable value in your opinion and why?

In general: if you can separate your changes as nicely as you did in your description, please separate them into individual commits in any future PR. :)

package name: you chose "com.nubook.android.zxingcpp". why "android"?

The "android" part is kind of a best practice to clearly separate this package from a plain Java package. This is useful when working with other Java (only) libraries. One can see at first glance, that this package belongs to and requires Android.
Since the wrapper requires the Android SDK, I put it under "com.nubook.android.zxingcpp". But the "android" part is completely optional. If you don't like it, I will remove it.

Upstream is apparently called "com.google.zxing" which seems weird to me, now that I think about it. Any suggestions?

"com.google.zxing" is the original package name of the Java implementation. I wouldn't choose it because it potentially collides with the Java implementation (although I can't think of a sane reason why someone would want the Java and the C++ version in the same project, apart from comparing performance, of course).
I chose "com.nubook.android.zxing" because of the GitHub account where this fork lives. Of course, it can be anything, but traditionally Java packages are based on domain names (of the author of this package). And because of the GitHub account, the dependency path for JitPack will be com.github.nu-book:zxing-cpp:x.x.x anyway. But if you don't want to include "com.nubook", any other domain that can be associated with this project would be perfectly fine too.
In principle, even just "zxingcpp" would do (instead of "com.nubook.android.zxingcpp"), but it sure would stand out a bit 😉

not sure what minification flag you are specifically talking about but sounds like a no-brainer

I was talking about this flag, and the corresponding proguard/r8 configuration.
Minification is important on Android to minimize download size and to enable optimizations.

CameraX: I got the impression that this is the way to go according to Google when releasing anything new related to camera stuff. I'd very much like to offer a dead-simple and 'natural feeling' API and ImageProxy seemed to me to be the right level of abstraction (requiring the user to know that she has to pick the first of several color planes to make this work is too low level in my opinion).

Yes, I can totally understand why you had this impression. Google tries very hard to make CameraX the new default. But unfortunately, it's not that simple. I really wish it was 😉
Google provides CameraX to help make camera app development easier. And it's true that Google recommends starting new apps with CameraX. But it's important to understand that it is just a convenience library on top of the Camera2 API that makes a lot of common tasks a lot easier. Of course, this comes at the cost of having another dependency, which can be a burden, if the Camera2 API is enough for a certain application. If I don't need it, why would I want to make my app larger, more complex and more error-prone?
So in my opinion this comes down to giving users of this library the freedom to choose whatever fits their situation.
This is also why I added support for the legacy Camera API. Technically there is no reason why this library shouldn't work with the legacy Camera API too, and in apps with a minSDKs before 21. There are many devices out there that are implementing the new Camera2 API just in LEGACY, what means it's basically the legacy Camera API behind the Camera2 API. The performance of these implemenations can be much worse than using the legacy API directly, unfortunately. So it's complicated, and there can be perfectly good reasons to not use Camera2 or CameraX.

minSdkVersion: what would be a reasonable value in your opinion and why?

Google currently recommends API 21 (Android 5.0 Lollipop) and claims this would address ~98% of devices (you can see this when you're creating a new project in Android Studio). This percentage is based on devices that connect to Google Play, what isn't the case in some parts of the world, so this should be taken with a grain of salt.
Generally it's a good idea to go as low as possible and only increase the minSDK when required. Especially for a library, of course. Following this idea, we can go as low as API 9 as soon as we remove the CameraX requirement (where this PR is, see here. Of course, this PR can also be used with CameraX).
Again, this is about freedom of choice. The lower the minSDK, the fewer the hurdles.

In general: if you can separate your changes as nicely as you did in your description, please separate them into individual commits in any future PR. :)

Yes, absolutely, I should've done so from the start 🙈

package name: I was not suggesting the use of com.google.zxing if at all, my suggestion would have been com.google.zxingcpp but that seems pretentious to me. I would have thought maybe org.zxing.zxingcpp would potentially be acceptable. I see that neither zxing.com nor zxing-cpp.com is used by anyone. What about com.zxingcpp then?
minification: go for it
minsdk/CameraX: I would suggest to go for 21 then, keep the read(ImageProxy) API (meaning CameraX, which is indeed less complex and less error-prone which is the whole reason for existence :)) but maybe also add the ByteArray version, so non Camera2 devices can be used natively (if I got that correctly?).

After that, your completion of the Result struct seems to be a good next step. I suggest we keep that for a separate PR though.

I think com.zxingcpp is fine 👍
And of course, I can keep read(ImageProxy) as you like. Which means that we can't go any lower than minSdk 21 anyway, because the library will remain to have a CameraX dependency (ImageProxy is part of CameraX).
But please let me make this clear one last time: This means the Android library, the binary bundle, can only ever be used in apps that have a minSdk of at least 21 and that are willing and able to include CameraX as well (no matter if they use it or not). These requirements are not strictly necessary, but a compromise to make the library easier to use (because there's no need to manually pick a plane). No hard feelings, just so we are clear about that point 😉
If that is fine with you, I will make a new PR tomorrow.
The ByteArray function was for the legacy camera API where the camera frame is delivered as a ByteArray in onPreviewFrame. In Camera2 we get an Image.

Yes, that is what I understood and would like to merge. Thanks for your understanding.
Before you start with your PR(s): a little rant about my current state of mind regarding the 'ideal' PR ;). For a set of independent changes (like the ones discussed here), I'd prefer to see them as individual commits inside a PR. A problem might occur if a change is requested, because piling up 'fix' commits in this PR causes noise. I know there is a relatively easy way to replace the last commit in a PR (git commit --amend and then git push -f). If you know a way to swap out any individual commit, then please let me know ;). Anyway, the best approach resulting from that would be a 'rolling' review where any potentially controversial commit comes last in the PR, might be changed after review and only then pushed the next commit. The other option is simply to push individual PRs but that produces other noise (lots of merge commits). Maybe this is over-complicating things, but you seem like the type of person who would be capable and willing to participate in this 'ideal PR' crafting ;).

Yes, I understand that completely, and I care about the git history very much too 😉
Which is why I will compose my PR(s) just as you like them, so they fit into the history of this project seamlessly. For example, and because I already started, here's the branch I created for the new PR we agreed on:
https://github.com/kurzdigital/zxing-cpp/commits/improve_android_wrapper
It just contains two (hopefully) good commits regarding the package name and the minification. Would it be okay to make one PR from that branch? Or would you rather like two PRs?
Personally, I prefer an alternative approach to merge commits and force pushes. I'm always squashing PRs into one nice commit, what makes the actual commits in a PR (branch) irrelevant. Of course, that only works well if a PR contains just one topic/feature. If this is not the case, I break it up in separate topics/features and merge these in separate commits instead of the PR as a whole.
So I handle PRs exactly like the well known feature/branch workflow with squash commits. The idea (of squashing commits) is to have exactly one meaningful, well written commit for each feature and loose all the irrelevant noise that accrued during development. Ideally, this connects all relevant changes (for a given feature) in just one commit. The results is a clean history (without merge commits), with commits you can easily work with later on (cherry-pick, revert, bisect, etc).
But that's just what works for me. And of course, this may seem a little odd for someone making that huge PR 😉 I really should've included all the work commits that were necessary to get to this result to make the changes clear and easy to follow. But since I commit a lot in feature branches, I was afraid it would be too messy, and that you are probably only interested in a high level description.
Well, anyway, another interesting way to manage PRs would be to use an interactive rebase (git rebase -i). This would allow to reorder, fix and merge commits in the PR branch before merging the PR. But of course, this would mean a force push, too.

That branch you started looks very good. Thanks. I suggest you also add a commit with the minSdkVersion downgrade to 21. That should be a very small change as well, right?
About squashing: That certainly works for the one-PR-per-one-fix/improvement approach, which is completely adequate for a single bug fix or the like and also easy to use from a maintainer side with the github squash-and-merge feature. One advantage of still merging instead of squashing (from my side) is that the network view provides a visual representation of where the changes came from.
About interactive rebasing: that seems to be the gold standard, at least for people who know how to use it: make individual commits, append commits with fixes after review and then squash the fix commits into the respective original commits until there is a 'clean' series of commits that can all stand on their own and could have been merged separately. If you want to try that, you can pile up more commits in your branch and we'll see how it goes. I have no personal experience with the interactive rebase feature of git.

Oh, right, I forgot to lower the minSdk 🙈 Sorry. But now it's in and I've opened a PR from that branch:
https://github.com/nu-book/zxing-cpp/pull/310

One advantage of still merging instead of squashing (from my side) is that the network view provides a visual representation of where the changes came from.
Squash merging a PR keeps the original author for the new, squashed commit. So you would still see this there. This is what a squashed PR looks like when merged, for example:
https://github.com/markusfisch/BinaryEye/commit/9e395d19288be8ef763c328e9d45e1d30b262944

If you want to try that, you can pile up more commits in your branch and we'll see how it goes.
I'd love to!

Oh, right, I forgot to lower the minSdk see_no_evil Sorry. But now it's in and I've opened a PR from that branch: #310

I could merge that as is but... (see below)

Squash merging a PR keeps the original author for the new, squashed commit.

I know. I've gone that way before to not have all those merge commits but I changed my mind to make the origin of the commits visible in the network graph. It's purely cosmetic and github centric but it felt to me like paying more respect to the authors.

I'd love to!

Ok, then I will wait with the merging of your new PR until further notice and let you add more features. What about the extension of the Result struct? The barcode writer stuff is something that I'd like to discuss separately before putting more work into this direction.
I started to look into View Binding as the recommended replacement of the deprecated kotlin-extension in the demo app, just to let you know.

Okay, I'll close this PR then and go over to the new one.


Agent can only be injected once per host

The current implementation uses a Chef recipe to install, e.g., a Java agent. The recipe has to be turned into an LWRP, as a recipe can only be applied once (whereas LWRPs can be applied multiple times).
Examples or LWRPs in this project can be found here:

https://github.com/Dynatrace/Dynatrace-Chef/tree/master/resources
https://github.com/Dynatrace/Dynatrace-Chef/tree/master/providers

Fixed by creating a dynatrace_java_agent LWRP resource (see resources/java_agent.rb).