Is it possible to publish not all channels, but selective channels between two PCs?

    Hi all!

I am using Apollo pre6
I am running Apollo on two parallel PCs according to this instruction.
But I notice the following peculiarity. The frequency of published channels by computer # 1 does not match the frequency of this channel on computer # 2. For example, if the frequency of the channel "/ apollo / sensor / lidar128 / compensator / PointCloud2" on PC1 is 10 Hz, then the frequency on PC2 can be 6 Hz. I also noticed a feature that big data channels slow down the work of another PC.
So I have a question.
Is it possible to publish not all channels, but selective channels between two PCs?
Originally posted by @AlexandrZabolotny in https://github.com/ApolloAuto/apollo/issues/7995#issuecomment-892779799

Actually if you don't subscribe to the message, it won't send. Big messages do take up bandwidth, but I don't think it should be as slow as you say.
For example, if your network cable is 100M Byte/s, then to achieve 10Hz, you need to limit the data to 10M

same experience here,  pc1 normal frenquency, pc2 sometimes can show 0 hz in few seconds around same channel. very confusing


Feature Request: "rawmsg" field in splunk (sc4s_syslog_rawmsg or just sc4s_rawmsg)

I really appreciate the option of RAWMSG as documented on the troubleshooting resources (https://splunk-connect-for-syslog.readthedocs.io/en/master/troubleshooting/troubleshoot_resources/).
The problem is to have that come across to Splunk, you have to change the format to JSON.  When you are running in production and have production alerts and suddenly 1% of your traffic is having parsing issues, its a hard sell to say you need to change the format coming into Splunk.  At the same time, writing it to a separate file is hard because you're looking for a needle in a haystack and that needle can be spread over a number of servers; if only we had a data aggregation system with good searching. So we could bring that data into Splunk separately, but what about logging an additional field like sc4s_syslog_rawmsg.  This would allow validation and troubleshooting.
The obvious downside is it would increase the size of a message having bandwidth and storage considerations, so it would be nice to be able to enable on a log path by log path basis.  I think having a global option would be beneficial as some places may decide the cost is worth it if it means they have an easier time troubleshooting.  For example, when something suddenly breaks, it would be nice to compare the on the wire protocol and know if it was somethign in syslog-ng and/or Splunk (which _raw should help differentiate between the two) or if it was something upstream that caused the issue.
This could also be interesting as it would make it easier for end users to supply the developers with raw data that could then be could be used for regression testing etc.
Yes, I am asking to increase overhead, but my hope is the value of helping mature data processing and being able to more quickly address issues will justify that cost.

this is one of the broader problems of tracing vs logging we have been thinking about one possible choice would be a duplicate something like sc4s:trace that would not alter the normal log path but could go into a short retention index for diag use turned on and off as needed what do you think?

v2 now has more effecient use of rawmsg. All non  RFC5424 events will retain rawmsg


text_type is not defined in the documentation

Hi onyxfish,
I was following the tutorial of agate until I got a NameError because of the undefined variable text_type in the section Computing new columns with the line of code:
In [117]: full_names = exonerations.compute([
    ('full_name', agate.Formula(text_type, lambda row: '%(first_name)s %(last_name)s' % row))
])
---------------------------------------------------------------------------
NameError                                 Traceback (most recent call last)
<ipython-input-117-0432888c1ca8> in <module>()
      1 full_names = exonerations.compute([
----> 2     ('full_name', agate.Formula(text_type, lambda row: '%(first_name)s %(last_name)s' % row))
      3 ])

NameError: name 'text_type' is not defined

I guess something like:
text_type = agate.text.Text()

is missing.

Good catch! Yes, when I wrote the docs to use the type guesser I neglected to change this. The correct (simpler) line would be:
full_names = exonerations.compute([
    ('full_name', agate.Formula(agate.Text(), lambda row: '%(first_name)s %(last_name)s' % row))
])


[Parse] Set missing contextual keyword token kind for async

Resolves rdar://93080331.

@swift-ci please test

@swift-ci please test

@DougGregor since you specifically changed some of these in https://github.com/apple/swift/pull/33333

@swift-ci please test macOS platform

apple/swift-syntax#444
@swift-ci please test macOS platform


Upgrade to go1.9

Bumped golang to 1.9
Bumped go-swagger to 0.12.0
Update go-openapi and bpf.sha with golang 1.9

Not sure if relevant, but shouldn't this line also be changed: https://github.com/cilium/cilium/blob/master/contrib/packaging/docker/build_dockerfile.sh#L38

Not sure if relevant, but shouldn't this line also be changed: https://github.com/cilium/cilium/blob/master/contrib/packaging/docker/build_dockerfile.sh#L38 ?

It is, fixed!


Write simple but working macro assembler

.fjm => .fj
Test it by hand and smallish 'programs'

Done!

Done!


Rate-Limit only for GET-Requests

Limit only for get requests so cloudflare challenge gets answered timely (#2614)
Motivation for changes:
Long timeout seems to reset the cloudflare challenge
Detailed changes:

Rate limiting only for get-requests so cloudflare gets the answer directly after the challenge

Thanks for contributing!


Documents on implementing their own algorithm on this framework

This sounds like a great feature for v0.2 release. Any roadmap for the same?
What can I do to help in resolving the issue? I am reading your AAAI'15 ALBL paper, and this would be a great way to learn ALBL.

I am not entirely sure how to write this document yet XD.
My original thought is something like a tutorial to guide users through filling the holes of the interface. https://github.com/ntucllab/libact/blob/master/libact/base/interfaces.py


chore(deps): update dependency @types/jest to v26.0.6 [skip ci]

This PR contains the following updates:

Package
Type
Update
Change

@types/jest
devDependencies
patch
26.0.5 -> 26.0.6

Renovate configuration
📅 Schedule: "before 1am" in timezone Europe/Vienna.
🚦 Automerge: Enabled.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
🔕 Ignore: Close this PR and you won't be reminded about this update again.

[ ] If you want to rebase/retry this PR, check this box

This PR has been generated by Renovate Bot.

:tada: This PR is included in version 2.3.3 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Audio memory

Codecov Report
Patch coverage: 21.81% and project coverage change: -1.52 :warning:

Comparison is base (89db2dc) 56.56% compared to head (8998806) 55.04%.

:mega: This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more
Additional details and impacted files
@@            Coverage Diff             @@
##             main     #176      +/-   ##
==========================================
- Coverage   56.56%   55.04%   -1.52%
==========================================
  Files          36       37       +1
  Lines        2408     2518     +110
==========================================
+ Hits         1362     1386      +24
- Misses       1046     1132      +86

Impacted Files
Coverage Δ

emu/src/memory/sound.rs
19.62% <19.62%> (ø)

emu/src/memory/internal_memory.rs
96.51% <100.00%> (+0.12%)
:arrow_up:

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


Add Missing test case: present match (porting to v1.32.x)

The required "Portability Tests Windows [Build Only] (internal CI) " is failing due to tool changes over time and windows and mac do not have the help of docker to preserve tool versions.
This is not a problem on linux and therefore "Portability Tests Linux [Build Only] (internal CI)" is successful.

The required "Portability Tests Windows [Build Only] (internal CI) " is failing due to tool changes over time and windows and mac do not have the help of docker to preserve tool versions.
This is not a problem on linux and therefore "Portability Tests Linux [Build Only] (internal CI)" is successful.

There are some failures; however they are unrelated to the fix. The failures are one of the two categories:
MacOs tools updated
Windows tools updated

There are some failures; however they are unrelated to the fix. The failures are one of the two categories:
MacOs tools updated
Windows tools updated

I'll go ahead and force merge since some required tests are failing but not related to this PR.

I'll go ahead and force merge since some required tests are failing but not related to this PR.


Use hosts:contains instead of hosts

Usage of "xe patch-list host=" would cause installed patches to not be seen as installed in a pool environment. Changing to "xe patch-list hosts:contains=" gives the correct behavior.

Hopefully someone can validate if this now resolves #28 ?

Accidentally closed the merge ;D
Hopefully someone can validate if this now resolves #28 ? Have merged now anyway; looks pretty sensible.

Will work on this


Upgrade to django 3.2

Pre-Flight checklist

[x] Testing

[x] Code is tested
[x] Changes have been manually tested

What are the relevant tickets?
fixes #101
What's this PR do?
Upgrade to django 3.2
How should this be manually tested?
Just check that everything is still functional and up

Codecov Report

Merging #196 (a719e70) into main (e836e11) will increase coverage by 6.59%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##             main     #196      +/-   ##
==========================================
+ Coverage   90.54%   97.14%   +6.59%
==========================================
  Files         216      124      -92
  Lines        6253     2805    -3448
  Branches      306        0     -306
==========================================
- Hits         5662     2725    -2937
+ Misses        505       80     -425
+ Partials       86        0      -86

Impacted Files
Coverage Δ

authentication/api.py

cms/constants.py

authentication/urls.py

courses/apps.py

openedx/admin.py

openedx/__init__.py

cms/management/commands/configure_wagtail.py

openedx/views.py

courses/serializers.py

courses/api.py

... and 81 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update e836e11...a719e70. Read the comment docs.

I was able to get my eyes on a warning regarding the default auto field for our models which came from Django 3.2 migration.
Although it's a warning, I think we should fix it by defining DEFAULT_AUTO_FIELD in our settings to resolve the it. Attaching the reference below:

@arslanashraf7 thank's for pointing it out. It didn't go through my eyes that's why got skipped.

The build is failing because of missing migrations in robots and social_django for which I have create a couple of open source PR's
https://github.com/python-social-auth/social-app-django/pull/354
https://github.com/jazzband/django-robots/pull/112

@arslanashraf7 that's ready for review again.


Fix API breakage on Header.Unmarshal

Return (int, error) and not just error

@stv0g @aler9 This was the plan I believe? After this lands I can start tagging v1 off of master branch again.

@Sean-Der the change that you want to restore was part of the backward-incompatible PR #119, that was included in v1.7.0 and that i intentionally left out in my previous PR. Prior v1.7.0, signature of Header.Unmarshal was
https://github.com/pion/rtp/blob/4997f5536911192ea66dd8f47eae54934e9a1537/packet.go#L81
after v1.7.0, signature is
https://github.com/pion/rtp/blob/ccb8b11cd0efb85bef256e50a5b6b4c4ac74058a/packet.go#L78
Therefore, this PR restores compatibility with v1.7.x but breaks compatibility with v1.6.5. Probably it's better to merge it since version v1.7.x has surely more users than v1.6.x.

@aler9 thanks for the explanation. What a mess :(
I will get some tooling setup to make sure this doesn’t happen again.


BigInput branch testing and integration

We have found amazing benefit/robustness to scaling 'hyper plane cutting algorithms" over wide sparse noisy data, demonstrated this over scale up in sample and dimensionality (we are now at a solution space around 2.037... x10^90 and want to keep pushing).  We followed this from the human genome side of things and initially using the COFFIN framework outside of shogun.
Vicktor, being the rad dude he is began helping with this noble cause to expand the index int to 128 etc, allowing for VERY LARGE training samples.... kicked this initiative in gear (thank you).
https://github.com/shogun-toolbox/shogun/tree/feature/BigInput
Thanks brilliant shogun dev team for your focus on what actually moves data/research forward.

Thanks for the feedback :)
So what is this issue about, getting things merged?
@vigsterkr seems like there is only one commit in there?


FR: Sequencing sections Text Prompt

Can we introduce a prompt mechanic that will allow us to feed a "time sequential" theme/feel that would look/act like this:
general prompt text [Section 1 prompt {x}(a) [section 2 prompt {y} (b)] [section 3 prompt {z}(c)]... return to general prompt
Where the different sections are sequential in the time of the composition. Where something like Bohemian Rhapsody would be
Queen rock song 85 bpm [a cappella, harmonies {30}] [piano with vocals {120}] [piano with vocal {120}] [guitar solo {30}] [rock opera with vocals {45}] [105 bpm guitar with vocals {45}]

where the values inside the {} are seconds or some specific measure of time

but if they are in parentheses instead it is a percentage of time

and if no values are specified for a particular bracket then those unspecified are evenly divided against what was already specified

I suspect continuity could be maintained by looping in original generated audio as a Melody to base the remaining off of? With some audio overlap built in to better weave the sounds together.

amazing idea

already exists, have fun: https://github.com/GrandaddyShmax/audiocraft_plus/tree/plus
in the gradio interface you'll find the explanation on how the multiprompt works.
there is also a huggingface version but you'll need to clone the space and use GPU: https://huggingface.co/spaces/GrandaddyShmax/MusicGen_Plus
as well there is a colab: https://colab.research.google.com/github/camenduru/MusicGen-colab/blob/main/MusicGen_ClownOfMadness_plus_colab.ipynb


Support vulcanizing a HTML import

This is a feature request. Files to illustrate the suggestion: https://dl.dropboxusercontent.com/u/15217362/vulcimport.zip
Sometimes it's useful to vulcanize a HTML import instead of the main HTML document. For example if index.html imports main.html, which looks like this:

If you vulcanize main.html instead of index.html you end up with something like this:
<meta charset="UTF-8">

Since I vulcanized an import, the html, head, meta and body tags (and sometimes the hidden div element) are unnecessary. It should output something that also looks like a HTML import. This is useful with custom loaders, or if you want to partially vulcanize something. Perhaps it could be an option, e.g. --as-import?

I think this is essentially handled in the way polymer-bundler bundles fragments and explicitly attempts to strip out the generated html, head and body elements which result from the parse5 AST.  Marking as closed.


Support custom button content for options menu

Fix margins on option menu so it applys with any menu position
Remove redundant ChecNavigation component
Part of CHEC-1466 to add new navigation

I've got a PR for dashboard ready to go once I can tag this.


Revert "[11.x] No need to redeclare variables"

Reverts laravel/framework#53887

You guys are fast! Thank you!


Add Skipper + kube-ingress-aws-controller

We should add documentation and deployment manifests for the kube-ingress-aws-controller + Skipper + External DNS combination to this repo. The setup is described on http://kubernetes-on-aws.readthedocs.io/en/latest/admin-guide/kubernetes-in-production.html#ingress

@hjacobs sure. Please open a PR adding the ingress controller reference in https://github.com/kubernetes/ingress/blob/master/docs/catalog.md and you can add the examples creating a directory with the name of the controller like https://github.com/kubernetes/ingress/tree/master/examples/affinity/cookie/nginx

@hjacobs please reopen if you have any question

@aledbf thanks, we will do that.


KNOX-1757. Increasing test timeout from 1 second to 3 seconds

What changes were proposed in this pull request?
org.apache.knox.gateway.deploy.DeploymentFactoryTest.test_validateNoAppsWithDuplicateUrlsInTopology() failed periodically due to the given 1 second timeout was not enough (at least locally in my computer); I was not able to reproduce this by increasing the timeout to 3 seconds.
Note: this PR is created for review only; the patch - if approved - will be attached to KNOX-1757.
How was this patch tested?
Executing JUnit tests:
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 23:10 min
[INFO] Finished at: 2019-02-05T14:29:18+01:00
[INFO] Final Memory: 346M/1874M
[INFO] ------------------------------------------------------------------------

@risdenk @lmccay could you please review? Thanks!

@smolnar82 - can you add a link to this PR in the JIRA? We don't have automatic linked currently.
Also as a side note, the commit message is typically "KNOX-### - message". Can fix this on merge but just for reference going forward.

I did it just after I submitted the PR.

For the commit message: I keep in mind (we had AMBARI-XXX. Message"; I have to switch :) )


Consistent Canvas State after render() - 2

Same as #4322 , just works.

Dont forget to mention @cawoodm in release notes


Post meeting fixes

@wackerow note: there's more uses of Mainnet in some env template files (e.g. .env.mainnet).

@wackerow looks like this is ready for review now? LMK if there's any remaining todos surfaced from our call this morning.

The only thing I can think of is the WalletConnect component, which doesn't update automatically if you go from insufficient funds to enough funds. User still has the option to go back then forward again in the workflow to get it to kick in. Everything else should be ready for review.

@wackerow nice! Will take a look tomorrow. I just pushed a WIP implementation to address that WalletConnect issue: #369


test on travis using 3.8 release not dev branch

Now that 3.8 is out we should no longer need to use the dev branch

Fixed a few deprecation warnings too. There are 2 more that could be fixed but those are on instruments that will be moved to qcodes_contrib_drivers


neovim lsp error "...complete.rs:387:49:\nbyte index 40 is out of bounds of `   find_package(glog QUIET.."

Thank you very much for writing such a nice plugin, but there is something wrong with me, lsplog are  as follows
[START][2024-01-17 17:53:54] LSP logging initiated
[ERROR][2024-01-17 17:53:54] .../vim/lsp/rpc.lua:734	"rpc"	"/home/tioeare/.local/share/nvim/mason/bin/neocmakelsp"	"stderr"	"thread 'main' panicked at /home/tioeare/.cargo/registry/src/index.crates.io-6f17d22bba15001f/neocmakelsp-0.6.17/src/complete.rs:387:49:\nbyte index 40 is out of bounds of `  find_package(glog QUIET`\nnote: run with `RUST_BACKTRACE=1` environment variable to display a backtrace\n"

https://github.com/Decodetalkers/neocmakelsp/assets/89766446/c0b47814-0026-44ec-9fa2-35da3a3dd531
As you can see in video, when the cursor is placed on line 7 at the beginning, neocmakelsp can work normally for cmp or hover, etc. When the cursor is placed on line 29, and insert mode, neocmakelsp will get an error like log above and abort, however if put cursor on line 29 but just in normal mode, neocmakelsp works fine, this error is only caused when entering insert mode on line 29
I hope you can tell me how to solve the problem, thank you!

Can you provide the cmakefile to me?

Ok, I see, I will release a hot fix then

@Decodetalkers this is a ROS package
cmake_minimum_required(VERSION 3.10)
project(intensity_feature_tracker)

set(CMAKE_BUILD_TYPE "Release")
set(CMAKE_CXX_FLAGS "-std=c++17")
set(CMAKE_CXX_FLAGS_RELEASE " -O3 -Wall -g -pthread -DROSCONSOLE_MIN_SEVERITY=5")

find_package(
    catkin REQUIRED
    COMPONENTS geometry_msgs
               nav_msgs
               cv_bridge
               roscpp
               roslib
               sensor_msgs
               std_msgs
               pcl_conversions
               tf
               tf2
               tf2_ros
               message_filters
)
find_package(OpenMP REQUIRED)
find_package(PCL REQUIRED)
find_package(OpenCV REQUIRED)
find_package(Eigen3 REQUIRED)
find_package(GTSAM REQUIRED QUIET)
find_package(Ceres REQUIRED)

catkin_package(
    INCLUDE_DIRS
    include
    CATKIN_DEPENDS
    roscpp
    roslib
    message_runtime
    geometry_msgs
    nav_msgs
    std_msgs
    DEPENDS
    PCL
    EIGEN3
    INCLUDE_DIRS
)
set(DBoW3_INCLUDE_DIRS "/usr/local/include")
set(DBoW3_LIBS "/usr/local/lib/libDBoW3.so")

include_directories(
    SYSTEM
    include
    ${catkin_INCLUDE_DIRS}
    ${PCL_INCLUDE_DIRS}
    ${OpenCV_INCLUDE_DIRS}
    ${GTSAM_INCLUDE_DIR}
    ${CERES_INCLUDE_DIRS}
)
link_directories(include ${PCL_LIBRARY_DIRS} ${OpenCV_LIBRARY_DIRS} ${GTSAM_LIBRARY_DIRS})

file(
    GLOB
    source_files
    src/intensity_feature_tracker_node.cpp
    src/intensity_feature_tracker.cpp
    src/loop_closure_handler.cpp
    src/Scancontext.cpp
    src/parameters.h
)

add_executable(${PROJECT_NAME}_node ${source_files})
target_compile_options(${PROJECT_NAME}_node PRIVATE ${OpenMP_CXX_FLAGS})
target_link_libraries(
    ${PROJECT_NAME}_node
    ${CERES_LIBRARIES}
    ${catkin_LIBRARIES}
    ${PCL_LIBRARIES}
    ${OpenCV_LIBRARIES}
    ${OpenMP_CXX_FLAGS}
    ${DBoW3_LIBS}
    Eigen3::Eigen
    gtsam
)

file(
    GLOB
    map_source_files
    src/mapOptimizationNode.cpp
    src/mapOptimization.cpp
    src/image_handler.h
    src/ikd-Tree/ikd_Tree.cpp
    ikd-Tree/ikd_Tree.h
    src/parameters.h
)
add_executable(${PROJECT_NAME}_mapping_node ${map_source_files})
target_compile_options(${PROJECT_NAME}_mapping_node PRIVATE ${OpenMP_CXX_FLAGS})
target_link_libraries(
    ${PROJECT_NAME}_mapping_node
    ${catkin_LIBRARIES}
    ${PCL_LIBRARIES}
    ${OpenCV_LIBRARIES}
    ${OpenMP_CXX_FLAGS}
    Eigen3::Eigen
    gtsam
    ${CERES_LIBRARIES}
    ${OpenMP_LIBS}
)

add_executable(
    ascanRegistration src/scanRegistration.cpp src/intensity_feature_tracker.cpp src/loop_closure_handler.cpp
                      src/Scancontext.cpp src/parameters.h
)
target_compile_options(ascanRegistration PRIVATE ${OpenMP_CXX_FLAGS})
target_link_libraries(
    ascanRegistration
    ${catkin_LIBRARIES}
    ${CERES_LIBRARIES}
    ${PCL_LIBRARIES}
    ${OpenCV_LIBRARIES}
    ${OpenMP_CXX_FLAGS}
    Eigen3::Eigen
    ${DBoW3_LIBS}
    gtsam
)

add_executable(alaserMapping_node src/laserMapping.cpp)
target_link_libraries(alaserMapping_node ${catkin_LIBRARIES} ${PCL_LIBRARIES} ${CERES_LIBRARIES})

add_executable(alaserOdometry_node src/laserOdometry.cpp)
target_link_libraries(alaserOdometry_node ${catkin_LIBRARIES} ${PCL_LIBRARIES} ${CERES_LIBRARIES})

add_executable(odomHandler_node src/odom_handler_node.cpp)
target_link_libraries(odomHandler_node ${catkin_LIBRARIES})

Can you test the target on master branch? though I think now it is fine

Ok, I make a release first, I think it will be fine

Ok, I make a release first, I think it will be fine

Yes, it works. Thanks a lot!


React Native Library .so files are not fortified

Description
Hi ,
When we analyze our build during decompilation there we could some react native libraries .so files are not compiled with D_FORTIFY_SOURCE=2.Fortify is a security feature to protect against incorrect use of standard functions - i.e. to protect against bad code implementation.
Steps to reproduce
The command we use for checking Library compiled without binary protection is checksec --dir=lib/ after unzipping the APK file in Kali Linux.
React Native Version
0.73.0
Affected Platforms
Runtime - Android
Output of npx react-native info
System:
  OS: macOS 14.5
  CPU: (8) arm64 Apple M3
  Memory: 75.69 MB / 24.00 GB
  Shell:
    version: "5.9"
    path: /bin/zsh
Binaries:
  Node:
    version: 22.3.0
    path: /private/var/folders/2y/kgbq31jn1dj6f9pm89d82lyc0000gn/T/xfs-1f504fc8/node
  Yarn:
    version: 3.6.4
    path: /private/var/folders/2y/kgbq31jn1dj6f9pm89d82lyc0000gn/T/xfs-1f504fc8/yarn
  npm:
    version: 10.8.1
    path: /opt/homebrew/bin/npm
  Watchman:
    version: 2<IP_ADDRESS>
    path: /opt/homebrew/bin/watchman
Managers:
  CocoaPods:
    version: 1.15.2
    path: /opt/homebrew/bin/pod
SDKs:
  iOS SDK:
    Platforms:
      - DriverKit 23.2
      - iOS 17.2
      - macOS 14.2
      - tvOS 17.2
      - visionOS 1.0
      - watchOS 10.2
  Android SDK: Not Found
IDEs:
  Android Studio: 2024.1 AI-241.15989.150.2411.11948838
  Xcode:
    version: 15.2/15C500b
    path: /usr/bin/xcodebuild
Languages:
  Java:
    version: 17.0.11
    path: /usr/bin/javac
  Ruby:
    version: 2.6.10
    path: /usr/bin/ruby
npmPackages:
  "@react-native-community/cli": Not Found
  react:
    installed: 18.2.0
    wanted: 18.2.0
  react-native:
    installed: 0.73.5
    wanted: 0.73.5
  react-native-macos: Not Found
npmGlobalPackages:
  "*react-native*": Not Found
Android:
  hermesEnabled: true
  newArchEnabled: false
iOS:
  hermesEnabled: false
  newArchEnabled: false

Stacktrace or Logs
Ref: https://owasp.org/www-project-mobile-top-10/2014-risks/m10-lack-of-binary-protections
https://www.appknox.com/blog/understanding-owasp-top-10-mobile-lack-of-binary-protections

Reproducer
https://github.com/slimm609/checksec.sh
Screenshots and Videos

Duplicates https://github.com/facebook/react-native/issues/36870
Please see my comment here:
https://github.com/facebook/react-native/issues/36870#issuecomment-1714007068
Also please test against 0.76 RC1 as we implemented native library merging so now you will have to check only libreactnative.so.


Introduce a symbol for type defs

Currently, we don't create a separate symbol for type defs in the compiler. We use the resolved type's type symbol itself during symbol enter. Because of this, we can't add meta info about the type def to the symbol in some cases like the following:
type Foo int;

Fixing this is a prerequisite for #27461

Related issues: #26283, #26284, #27190, #27461

Now we have a separate symbol for this.


[WIP] Added normal tuple type structure and parser

related:  #34

[x] add ast struct of normal type tuple

[x] NormalTuple use paren: Option<Token, Token>

[x] add parser with parentheses
[ ] add parser without parentheses
add type checking (Do you think this should not be included?)

Since Args has paren: Option<Token, Token> (which has information about the parentheses), NormalTuple should simply wrap it.
And type checking would probably require a new mechanism, so no need to implement it. I will do it.

For parsing tuples, we can modify try_reduce_call_or_acc to try_reduce_call_or_acc_or_tuple.
This is because, for example, when reading the identifier f, there are only three possible grammars at this point.

f is an Accessor
f is a callee
f is the first element of a tuple

In other words, immediately after reducing f, Parser calls  opt_reduce_args, but before this, it should be checked if there is a , and if so, Parser should move on to reducing the tuple.

Perhaps those are the pieces of information I wanted to know.
If I cannot achieve tuple without parentheses, is it possible to create it as a separate Issue and create the PR again?

Ok, but perhaps parentheses are not essential to tuples. A tuple without parentheses is actually the standard form.
If you write 1, 2, it is a standard tuple, (1, 2) is just a tuple with parentheses. It is exactly the same as (1+1) and so on.

Thank you @GreasySlug !


[FLINK-12284,FLINK-12637][Network,Metrics]Fix the incorrect inputBufferUsage metric in credit-based network mode

What is the purpose of the change
This PR is to fix the bug in the calculation of  inputBufferUsage. It does't now take the exclusive buffer which is assigned from global buffer pool into account.
Brief change log
(for example:)

The TaskInfo is stored in the blob store on job creation time as a persistent artifact
Deployments RPC transmits only the blob storage reference
TaskManagers retrieve the TaskInfo from the blob cache

Verifying this change
(Please pick either of the following options)
This change is a trivial rework / code cleanup without any test coverage.
(or)
This change is already covered by existing tests, such as (please describe tests).
(or)
This change added tests and can be verified as follows:
(example:)

Added integration tests for end-to-end deployment with large payloads (100MB)
Extended integration test for recovery after master (JobManager) failure
Added test that validates that TaskInfo is transferred only once across recoveries
Manually verified the change by running a 4 node cluser with 2 JobManagers and 4 TaskManagers, a stateful streaming program, and killing one JobManager and two TaskManagers during the execution, verifying that recovery happens correctly.

Does this pull request potentially affect one of the following parts:

Dependencies (does it add or upgrade a dependency): (yes / no)
The public API, i.e., is any changed class annotated with @Public(Evolving): (yes / no)
The serializers: (yes / no / don't know)
The runtime per-record code paths (performance sensitive): (yes / no / don't know)
Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Yarn/Mesos, ZooKeeper: (yes / no / don't know)
The S3 file system connector: (yes / no / don't know)

Documentation

Does this pull request introduce a new feature? (yes / no)
If yes, how is the feature documented? (not applicable / docs / JavaDocs / not documented)

Hi @zhijiangW could you help take a look on this PR when you are free, thanks.

Thanks @zhijiangW for sharing your thoughts on this issue.
Although the semantics  of inputBufferUsage means the buffer occupied by RemoteChannel which may fill with data or not as you mentioned in credit-based mode in the moment,  But I think this PR  taking the exclusive buffer into account, which will make the semantics of this more close to the original intention.
I'am also ok to stay the same until the time of introducing new network related metrics. I think we are short of more detail metric about credit-based network model too.
Thanks for remind of the PR title format, I will pay more attention to this.:)

@pnowojski What do you think of this issue?

The current inputBufferUsage is only reflecting the usage of floating buffers, and it could give an indicator whether the setting of floating-buffers-per-gate is enough for performance tuning.

I agree, there is a value of the current semantic.
I would even build upon that. If you want to detect bottleneck, current semantic of tracking just floating buffers is perfect for that. If current operator (reading from this input) is causing a bottleneck it well can be that only a single one input channel is back-pressured. At the moment we could detect this situation with "all floating buffers are exhausted/used".

We could always assume if the exclusive buffers are enough for one channel, it will not request floating buffers. In other words, if we see the floating buffers are used, that means the exclusive buffers should also be used.

This is not true for even slight data skew.
I think that there is a value of tracking separately floating and exclusive buffers.
Maybe we should make inPoolUsage track floating + exclusive buffers (it would make it consistent with non credit based mode), while we could add inFloatingPoolUsage metric with current semantic? What do you think?

Hi @pnowojski , what is the reason for the second point ?

This is not true for even slight data skew

And +1 for adding the inFloatingPoolUsage specialized for detecting bottleneck.

Thanks for the confirmation and good suggestions. @pnowojski

In other words, if we see the floating buffers are used, that means the exclusive buffers should also be used.
This is not true for even slight data skew

Maybe my previous expression is not very clear. If floating buffers are used, I only mean the exclusive buffers for one/some RemoteInputChannels are also expected to be used eventually, but not indicate the exclusive buffers for all the channels are used.
For example, if the producer's backlog is 1, we would always request another 1 floating buffer even though the 2 exclusive buffers for this channel are available atm. Because we want to feedback some overhead credits beforehand in order not to block the network transport after producing more backlog soon. So it is not strong consistent for exclusive buffers used in time, might be eventual consistent within our expectation. If the backlog is becoming 0 from 1, the previous requested floating buffer would also be released by this channel if the 2 exclusive buffers are still available. So from the aspect of one input channel, it would not occupy extra floating buffers if its available exclusive buffers are enough.
I also agree with the above suggestions for distinguishing the total inPoolUsage and floatingInPoolUsage, or we could only retain exclusiveInPoolUsage and floatingInPoolUsage for credit-based mode.

Hi, @zhijiangW thanks for your detail explanation, I make a conclusion below
Non-credit-based mode:

InPoolUsage

Credit-based mode:

exclusiveInPoolUsage  exclusiveBufferUsed/exclusiveBufferTotal(all initial credit)
floatingInPoolUsage   floatingBufferUsed/floatingBufferTotal
InPoolUsage  combine with exclusiveInPoolUsage and floatingInPoolUsage

I think this looks better to distinguish the buffer usage between floating and exclusive in credit-based mode and also give a view of the overall perspective with inPoolUsage metric.  WDYT @pnowojski @zhijiangW

@Aitozi
I think your proposal makes sense. Having 3 metrics for credit based flow control sounds as the best, the most explicit solution for me.

Maybe my previous expression is not very clear. If floating buffers are used, I only mean the exclusive buffers for one/some RemoteInputChannels are also expected to be used eventually, but not indicate the exclusive buffers for all the channels are used.

👍

Hi @pnowojski , what is the reason for the second point ?

Which second point do you mean @Aitozi ?

OK, I will open another issue additionally to track and will update this PR accordingly, thanks.

Have added the three metric for the credit based mode, please take a look when you are free @zhijiangW @pnowojski

Thanks for the updates @Aitozi ! I left some inline comments.

Hi @zhijiangW @pnowojski I have addressed your comments. About the inPoolUsage name, I use the name for both two mode to be consist with previous style. And i squash the commit history solving the conflicts, please help review when you are free, I will continue to solve another PR after this one has been approved to avoid conflicts.

Sorry for the late response @pnowojski , I will solve the comments you mentioned.

Hi @pnowojski , I have adjust the test case according to your suggestion, please take a look when you have time, Thanks.

ping @pnowojski @zhijiangW

Thanks @pnowojski for you advice, I have addressed some of them, please have a look again 😄

Thanks for the updates @Aitozi !
The abstract seems better now and I left some comments mainly for formatting and deduplications in tests.

Thanks @zhijiangW for your careful review. About this comment

covering the drainBuffer with three asserts together if possible

I think it's not so good, because the second and the third assert depend on the previous drainBuffer action means if add the assert in the drainBuffer, drainBuffer will be a function with state
Other comments has all been resolved, please have a look again, very thanks :)

ping @zhijiangW @pnowojski , could you take a look again, thanks :)

I will solve the conflicts.

@Aitozi thanks for addressing my comments.
Could you rebase again for solving the conflicts, then I could  double reviewing it.

In addition, you might need to execute the command "mvn package -Dgenerate-config-docs -DskipTests -pl flink-docs -am -nsu" to generate the updated html files.

Hi, @zhijiangW I have solve the conflicts and generate the html, could you help review this again , thanks :)

In addition, one PR should not connect to two jira tickets in general. So I think you might need to close one jira and adjust this PR to only one jira.

In addition, one PR should not connect to two jira tickets in general. So I think you might need to close one jira and adjust this PR to only one jira.

I wouldn't be so strict about having couple of jira tickets in one PR, especially if they depend on one another. However as a rule of thumb one commit shouldn't be addressing two jira tickets, since probably it means that either:

commit is fixing two separate things
Jira tickets are duplicated

As far as I recall this is inline with our coding style guideline. Of course it's better to have separate things fixed in independent PRs.
Here I think it's the case that "Jira tickets are duplicated". In my opinion Add metrics for floatingBufferUsage and exclusiveBufferUsage for credit based mode is a solution for InputBufferPoolUsage is incorrect in credit-based network control flow. So I would close the newer ticket as duplicate of the older one.

ok, I will fix this tonight

Hi @zhijiangW , I've addressed your comments , please take a look again, thanks.

Thanks for addressing my comments @Aitozi .
I only have some new comments for tests before merging. In addition I think you should adjust the PR and commit titles for covering only one jira.

Ping @zhijiangW

Thanks for the updates @Aitozi ! I left some other comments for tests.

Very thanks for @zhijiangW 's carefully review, please take a look again, hoping this is the last look :)

Thanks for the patience and addressing my comments @Aitozi !
I think you might miss one previous comment for using tuple2 instead of tuple3. After fixing this I have no other concerns. 👍 LGTM!

Ping @pnowojski

Thanks for the fix @Aitozi and your patience with our reviews (especially that the scope of this ticket has grown significantly from your initial version). Merging as I can see that on your private travis this is already green.


Windows 10 x64 the program gives an error while writing

v1.0.0-beta.12
Windows 10 x64
Yes, here are the logs:

tracker.js:10 Error: Child process exitted with error code: 1
    at ChildProcess.child.on (C:\Program Files (x86)\Etcher\resources\app.asar\lib\src\child-writer\index.js:114:38)
    at emitTwo (events.js:106:13)
    at ChildProcess.emit (events.js:191:7)
    at maybeClose (internal/child_process.js:850:16)
    at Process.ChildProcess._handle.onexit (internal/child_process.js:215:5) undefineda.(anonymous function) @ tracker.js:10(anonymous function) @ C:\Program Files (x86)\Etcher\resources\app.asar\node_modules\angular\angular.js:13708(anonymous function) @ C:\Program Files (x86)\Etcher\resources\app.asar\node_modules\angular\angular.js:10347(anonymous function) @ C:\Program Files (x86)\Etcher\resources\app.asar\lib\gui\modules\analytics.js:85processQueue @ C:\Program Files (x86)\Etcher\resources\app.asar\node_modules\angular\angular.js:16178(anonymous function) @ C:\Program Files (x86)\Etcher\resources\app.asar\node_modules\angular\angular.js:16186$eval @ C:\Program Files (x86)\Etcher\resources\app.asar\node_modules\angular\angular.js:17444$digest @ C:\Program Files (x86)\Etcher\resources\app.asar\node_modules\angular\angular.js:17257(anonymous function) @ C:\Program Files (x86)\Etcher\resources\app.asar\node_modules\angular\angular.js:17483completeOutstandingRequest @ C:\Program Files (x86)\Etcher\resources\app.asar\node_modules\angular\angular.js:5955(anonymous function) @ C:\Program Files (x86)\Etcher\resources\app.asar\node_modules\angular\angular.js:6234d.util.hasFunction.f.(anonymous function) @ tracker.js:3

When attempts to write, there are two following errors (They appear at random, no patterns):

Hi @Zeirison ,
Thanks a lot for reporting. I've sent a fix for the Invalid results errorCode: 1 issue. We're still investigating the previous one, but couldn't find the root cause yet.
For some more information:

https://github.com/resin-io/etcher/issues/552
https://github.com/resin-io/etcher/issues/571

After the following PRs, looks like all Windows 7 issues are gone:

https://github.com/resin-io/etcher/pull/616
https://github.com/resin-io-modules/etcher-image-write/pull/46
https://github.com/resin-io-modules/etcher-image-write/pull/48

I can confirm on Windows 7 that checking out an Etcher reference which contains the above merged PRs makes the issues disappear, and going back in history makes the issues visible again. For that reason, I'll be closing this issue.
Please re-open if you still hit this issue once the a Etcher version is released.
Thanks a lot!


Electron export test #3376

Closes #3376

Only windown electron failed on this one, pretty sure that's a known issue. Merging.

whoa cool!


Replace images in testing folder with ones that are more obviously licensed

Hi @georgeajit ,
In reviewing our codebases, legal has found some data that should be replaced in any active develop branch.  These are images used in functional testing. Since they are on github, we'd prefer to replace them with images that are explicitly freely available to use.  Since they are just for testing, I assured Zak that it would be pretty straightforward to find new images that are not controversial.
To avoid false alarms in the future, a README in your test data folder that says all images are available for use -- that would help legal too.  Please let me know if you have questions.  Zak would like to see this done relatively quickly.
Here are the images flagged by the scan:
https://github.com/marklogic/java-client-api/blob/develop/test-complete/src/test/java/com/marklogic/client/functionaltest/data/JenoptikLogo.jpg
https://github.com/marklogic/java-client-api/blob/develop/test-complete/src/test/java/com/marklogic/client/functionaltest/data/Jenoptik_Logo.jpg
https://github.com/marklogic/java-client-api/blob/develop/test-complete/src/test/java/com/marklogic/client/functionaltest/data/Pandakarlino.jpg
https://github.com/marklogic/java-client-api/blob/develop/test-complete/src/test/java/com/marklogic/client/functionaltest/data/Sega-4MB.jpg
There are two other images in that folder which were not flagged by legal -- binary.jpg and Simple_ScanTe.jpg ..

binary.jpg and Simple_ScanTe.jpg should similarly be removed. Let me know if you have any questions.

@zakwhite
Can this be done in next couple of weeks? We have a release on 09-11-2017 and do not want to have false alarms on test failures.

@georgeajit, yes that timeline is acceptable. Thanks for checking.

Hi Ajit,
I replaced below binary image file with our MarkLogic logo file and ran all dependent java tests which worked fine. I have made all changes to git repository and request to please take a look and review the same.
Pandakarlino.jpg: TestBulkWriteMetadata1.java
JenoptikLogo.jpg: TestCRUDModulesDb.java
Jenoptik_Logo.jpg : Not used anywhere in java-client api tests
Sega-4MB.jpg: BinaryDocumentTest.java
Simple_ScanTe.png: TestMetadata.java, TestMetadataXML.java, TestRollbackTransaction.java
binary.jpg: UrisToWriterListenerFuncTest.java, TestCRUDModulesDb.java, TestLinkResultDocuments.java
Let me know for any clarification/concern.
Thanks
Kshitiz


App version

Is there a way to get the current app version from within the app?
I couldn't find it and want to check which version I'm on.
It would also be useful for bug reports.

Done in https://github.com/boltcard/bolt-card-pos/releases/tag/v0.0.5


Fixing regex for retry.yml and vdi

Removing forward slash (/) from the end of *.vdi and *.retry.yml file match in .gitignore.

I'm ended up making a long list of fixes and improvements. I will merge everything together.


Improve docstrings to enable PEP8 501

This PR improves docstrings to enable PEP8 501.
cc @yongzx (I have done a backward sweep :) as you did a forward sweep on the pytest.ini)

@fchollet, Updated.


Feature Request: Add BokkyPooBahsDateTimeLibrary

This is a longish-shot because the lib is moderately niche, but just to stir the pot and get some ideas out there, a snippet I use that's not on NPM and hasn't been updated in a while and is probably unoptimized is BokkyPooBahsDateTimeLibrary.
Use-case example: The CryptoPhunk Auction Flywheel buys NFTs on-demand. The Flywheel uses its ETH balance to buy, but it can't use the entire balance in one week. Instead there is a weekly allowance.
I used BokkyPooBahsDateTimeLibrary to create a getStartOfWeek function that works out this logic.
You could imagine this being used in other throttling-type situations, e.g., preventing someone from making 10 DAO proposals in one sitting.
Actually maybe this is a pretty useful library after all...

Hmm... the library looks small enough.
May consider.

@Atarpara You wanna work on this?


[type: bug] fix responseTimeout can not config in yaml.

// Describe your PR here; eg. Fixes #issueNo

Make sure that:

[x] You have read the contribution guidelines.
[x] You submit test cases (unit or integration tests) that back your changes.
[x] Your local test passed mvn clean install -Dmaven.javadoc.skip=true.

Codecov Report

Merging #2688 (acbb6f3) into master (e1543e4) will decrease coverage by 0.32%.
The diff coverage is 0.00%.

@@             Coverage Diff              @@
##             master    #2688      +/-   ##
============================================
- Coverage     59.94%   59.61%   -0.33%
- Complexity     4349     4350       +1
============================================
  Files           679      679
  Lines         19466    19464       -2
  Branches       1725     1724       -1
============================================
- Hits          11668    11603      -65
- Misses         6834     6891      +57
- Partials        964      970       +6

Impacted Files
Coverage Δ

...plugin/httpclient/config/HttpClientProperties.java
0.00% <0.00%> (ø)

...ache/shenyu/plugin/grpc/cache/GrpcClientCache.java
68.75% <0.00%> (-31.25%)
:arrow_down:

...n/alibaba/dubbo/cache/AlibabaDubboConfigCache.java
43.75% <0.00%> (-31.25%)
:arrow_down:

...gin/apache/dubbo/cache/ApacheDubboConfigCache.java
43.03% <0.00%> (-29.12%)
:arrow_down:

...che/shenyu/sync/data/http/HttpSyncDataService.java
61.38% <0.00%> (-19.81%)
:arrow_down:

...henyu/plugin/grpc/resolver/ShenyuNameResolver.java
44.68% <0.00%> (-19.15%)
:arrow_down:

...a/org/apache/shenyu/common/utils/VersionUtils.java
67.85% <0.00%> (-10.72%)
:arrow_down:

...apache/shenyu/admin/utils/ShenyuDictH2Trigger.java
63.63% <0.00%> (-9.10%)
:arrow_down:

...ache/shenyu/admin/utils/PluginHandleH2Trigger.java
63.63% <0.00%> (-9.10%)
:arrow_down:

.../apache/shenyu/admin/model/dto/BatchCommonDTO.java
50.00% <0.00%> (-7.15%)
:arrow_down:

... and 35 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update e1543e4...acbb6f3. Read the comment docs.


Requests made datastore v0.1.1

I looked at my API usage in my GCP project and the graph showed that all of my requests to Datastore are made with the v1beta2 API, even though I've migrated some of my servers to v1beta3. Is this a problem with @google-cloud/datastore, a backend issue, or something I'm doing wrong?

Sorry, accidentally submitted before actually writing anything. Must have accidentally hit some secret keyboard shortcut.

These are my usage graphs:

I think I'm using the new package right, but is there anything I need to do to make requests go to v1beta3 or v1? I need to do this before the old API is turned down
var gcloudDatastore = require('@google-cloud/datastore');

const datastore = gcloudDatastore({
  projectId: MY_PROJECT_ID,
  keyFilename: MY_KEY_FILE
});

Any usage of gcloud since 0.30.0, released 4/4/16 and any version of @google-cloud or @google-cloud/datastore have been using v1beta3.
We will have a release soon for v1. The only thing you'll need to do is upgrade @google-cloud/datastore.
As for the usage graphs, I have to assume it's coming from some other Datastore usage, as long as you've been using the versions of our library stated above. If that doesn't explain it, we can ask @pcostell if he has any ideas.

You're right – I have a service running on one server in my project that still uses the v1beta2 API, and it looks like all the v1beta2 logs are from that one server's IP.
I thought that v1beta3 traffic was being counted as v1beta2 traffic because I assumed that there would be some kind of log of API usage for every version. However, there are no logs or data on the usage graph for the other servers making requests to the v1beta3 API. I've entirely removed gcloud from most of my servers, so I am positive there is some v1beta3 usage. Do you know of any reason why this would happen?

I'm not sure, but @pcostell might have insight into that.
Going to close the issue since we're not talking about a bug in our library. Feel free to keep discussing.

v1beta3 and v1 traffic unfortunately do not appear in the API console usage tracker: https://github.com/GoogleCloudPlatform/google-cloud-datastore/issues/133

@pcostell Thank you. I'll subscribe to that issue.


Process Flow Page - scheduler create button is not redirect to correct url

Describe the bug

when click on create scheduler button it is not redirect to correct page

https://www.berrycast.com/conversations/e0d45302-9c34-5767-8759-617ef2c971cb

https://www.berrycast.com/conversations/d9bf0628-d76a-58f7-af9d-c8af0e8b30ac


bugfix(TDI-38566) : Updated error management for list operations

What is the current behavior? (You can also link to an open issue here)
https://jira.talendforge.org/browse/TDI-38566
What is the new behavior?
Fix mainly SOAP empty errors.
Please check if the PR fulfills these requirements

[X] The commit message follows Talend standard
[X] Tests for the changes have been added (for bug fixes / features)
[ ] Docs have been added / updated (for bug fixes / features) ?
[X] The code coverage on new code >75%
[X] The new code does not introduce new technical issues (sonar / eslint)

What kind of change does this PR introduce?

[X] Bugfix
[ ] Feature
[ ] Code style update (formatting, local variables)
[ ] Refactoring (no functional changes, no api changes)
[ ] Build / CI related changes
[ ] Other... Please describe:

Does this PR introduce a breaking change?

[ ] Yes
[X] No

If this PR contains a breaking change, please describe the impact and migration path for existing applications: ...
Other information:

Pull request test result: success :star:


Webcrawler agent enhancements

Currently, the web crawler agent uses Jsoup to:

Connect to page URL
Get all href's on the page and add to a crawl queue
Get the current page's HTML (document.html())
Create a document from that HTML

Ideally, the agent could offer  more features like:

Scrape the screen by rendering the page's HTML and create a Document from the text().

As a screen scrape it is assumed that no media (img, video, etc) will be included, just simple text.

Offer a filter by node id or node class
Offer the option to provide an abstract Jsoup processing function
Add select page head meta values to the Document header

Example screen scrape starting a certain node id and including a few head meta values
(so only the document's page content is retrieved, not the document navigation href's on every page pass):
  - name: "Crawl the WebSite"
    type: "webcrawler-source"
    configuration:
      seed-urls: "https://docs.langstream.ai/"
      allowed-domains: "https://docs.langstream.ai"
      ...
      asHtml: false
      asText: true
      parent-tag-id: "document-main"
      include-head-meta-names: "description, og:title, article:author, og:image"

asHtml could be the default
If parent-tag-id is not provided then grab the page .body()
Each  value will be added as name/value header with the Document

Example custom function:
  - name: "Crawl the WebSite"
    type: "webcrawler-source"
    configuration:
      seed-urls: "https://docs.langstream.ai/"
      allowed-domains: "https://docs.langstream.ai"
      ...
      page-render-function: -|
          private string renderPage(Jsoup.Document doc){
              Element ele = doc.body();

              // could do all kinds of weird page navigation

              return ele.text();
          }

I have been starting to test WebDriver + headless browser in order to render Javascript.
But it seems that modern websites are more crawler friendly and there is no much need.
We need examples of websites that we cannot handle well.
For the text extraction part the suggested approach is to us the builtin text-extractor agent that uses Apache Tika to handle HTML.
If the text is not grabber correctly then we have to fine tune Tika.


Unable to execute API command createLBStickine due to missing parameter methodname

Hello,
I am using Cloudstack <IP_ADDRESS>
After created a load balancer rule, I click on Configure, choose a sticky method, enter Sticky name and click OK but it shows an error:
Request failed. (431)
Unable to execute API command createLBStickine due to missing parameter methodname

I also tried all method: AppCookie, Lbcookie, SourceBased and got the same result.

Please help ! Thanks a lots

@tuanhoangth1603
I remember this has been fixed in #6571
maybe we need to backport to 4.17

Cloud we configure sticky via API ? And how to ?

@tuanhoangth1603
yes, you can use cloudmonkey
https://github.com/apache/cloudstack-cloudmonkey/releases

this has been fixed in #6571 by commit https://github.com/apache/cloudstack/pull/6571/commits/b4d3deaddf6725a0553a50470bc41dcc951fab38


Import git repo only if it is needed in native apps

Pre-review checklist

[ ] I've confirmed that instructions included in README.md are still correct after my changes in the codebase.
[ ] I've added or updated automated unit tests to verify correctness of my new code.
[ ] I've added or updated integration tests to verify correctness of my new code.
[ ] I've confirmed that my changes are working by executing CLI's commands manually.
[ ] I've confirmed that my changes are up-to-date with the target branch.
[ ] I've described my changes in the release notes.
[ ] I've described my changes in the section below.

Changes description
...

Just wondering, why is it important to not import git.Repo unless necessary? Is it a large module that would have performance impact to import? Or is it so that users don't need to have git installed unless they plan to initialize a native app from a git repository?

GitPython required installed git, we will have to change imports in 2.0


change(docs): Update 'Design Overview' page of Zebra book

Motivation
We want to update the design overview page with some notable blog posts and a graph of service dependencies to help new developers understand zebrad faster.
Related to #2740, unclear if this is enough to close the issue yet.
Solution

Add links to notable blog posts
Add a simplified graph of service dependencies

Related changes:

Correction of issue/PR references in Pipelineable Block Lookup RFC
Remove some out-of-date text

Review
Anyone can review.
Reviewer Checklist

[x] Will the PR name make sense to users?

[ ] Does it need extra CHANGELOG info? (new features, breaking changes, large changes)

[x] Are the PR labels correct?
[x] Does the code do what the ticket and PR says?

[ ] Does it change concurrent code, unsafe code, or consensus rules?

[ ] How do you know it works? Does it have tests?

Here's the input for the graph. I tried making it comprehensive at first but it seemed to grow unnecessarily complicated, I left in what I thought would be most useful. I'm open to suggestions on what should be included.
digraph services {
    state -> transaction_verifier
    state -> mempool
    state -> chain_verifier
    transaction_verifier -> mempool
    transaction_verifier -> chain_verifier
    mempool -> inbound
    chain_verifier -> inbound
    chain_verifier -> syncer
    inbound -> peer_set
    peer_set -> syncer
    peer_set -> mempool
}

Rendered here

Can you add the source of the diagram and the online tool you used to generate it in a markdown comment?
(I think they work the same as HTML comments.)
That way, anyone can edit the diagram if they want.


Upon opening Godot, it runs the last project instead of opening project list or even the editor.

OS:
Windows 10 Home edition
Can reproduce on these Godot versions:
2.0.2 and 2.0.3 win64
2.0.3 win32
Issue:
Upon opening Godot, it runs the last project instead of going to project list, or even going to editor.
Only way I can go back to project list or editor is editing engine.cfg and removing main_scene line.
I have to re-open the scene and assign it on project settings as main scene again.
If I close Godot and re-open it, same thing happens again.
Steps to reproduce:
Start new project from scratch.
Set main_scene in project settings.
Run project.
Save it.
Quit.
Open Godot......issue.
Project upload:
I'm sorry but I cannot upload the project, it is VERY SMALL though, nothing weird, just a few nodes with AnimatedSprite and AnimationPlayer.

I've been using Godot 2.0.3 on Windows 10 and I don't have the issue you're describing.
Could it be you accidentally changed some obscure setting or something?

Probably you saved the project in the same folder as the godot executable?

@bojidar-bg that was it, thank you so much bojidar!


util: Adding TargetNamedBreakpoint class for gdb.

This change adds a utility script that adds the definition of the TargetNamedBreakpoint class. This class inherits from gdb.Breakpoint and extends the class to allow stopping the execution only if it can extract symbol _name from the context of the breakpoint and if _name matches a predefined set of exact strings or regular expressions.

@powerjg @BobbyRBruce @studyztp


[6.x] created model event throws is not present in table when creating a new instance of relationship

Laravel Version: 6.0.2
PHP Version: 7.3.9
Database Driver & Version:

Description:
I have created an UserObserver as follows:
class UserObserver
{

    /**
     * Handle the user "creating" event.
     *
     * @param \App\Models\User $user
     * @return void
     * @throws \Exception
     */
    public function creating(User $user): void
    {
        $user->password = Hash::make($user->password);
        $user->{$user->getKeyName()} = Uuid::generate()->string;
    }

    /**
     * Handle the user "created" event.
     *
     * @param  \App\Models\User  $user
     * @return void
     */
    public function created(User $user): void
    {
        $user->profile()->create();
    }
}

Defined a HasOne relationship in my User model:
public function profile(): HasOne
{
    return $this->hasOne(UserProfile::class, $this->primaryKey);
}

When the created event is fired and error is thrown:
SQLSTATE[23503]: Foreign key violation: 7 ERROR:  insert or update on table \"user_profiles\" violates foreign key constraint \"user_profiles_id_foreign\"\nDETAIL:  Key (id)=(2c4783e0-db97-11e9-a718-87c3cb10e5a6) is not present in table \"users\". (SQL: insert into \"user_profiles\" (\"id\", \"updated_at\", \"created_at\") values (2c4783e0-db97-11e9-a718-87c3cb10e5a6, 2019-09-20 11:09:54, 2019-09-20 11:09:54))

Important part I think : Key (id)=(2c4783e0-db97-11e9-a718-87c3cb10e5a6) is not present in table \"users\".
Steps To Reproduce:

Try to create an instance of a related model in created eloquent event.

After removing the vender folder and removing composer.lock the error disappear.


Reported version number in phpinfo()

Build versions reported in phpinfo() on - at least - the Windows driver are confusing.

Last image is supposed to be from 4.1.3 release and the previous one from 4.1.2

@david-garcia-garcia Thanks for feedback, we redesigned the versioning in the latest release, please download the binaries from here.


Figure out our linkability story

 Issue by Hixie
Friday Jul 17, 2015 at 22:45 GMT
Originally opened as https://github.com/flutter/engine/issues/100

See: https://github.com/flutter/engine/blob/master/sky/specs/linkability.md

Closing in favor of https://github.com/flutter/flutter/issues/9768.


Not Working anymore

I cloned this and it's not working anoymore .. seems like packages are outdated ..
on which node version it works fine ?

I have v6.4.0 on my machine but really it should work with earlier versions of Node. What error message do you encounter?

i had v6.2.1 ...


Change UltraVNC <IP_ADDRESS> to uninstallPrevious

null
Microsoft Reviewers: Open in CodeFlow

@wingetbot run

https://github.com/microsoft/winget-pkgs/pull/68067#issuecomment-1241980759


add name to breadcrumbs tag

Add name option to resolve the issue where breadcrumbs would appear as unnamed on google rich text results.

Where is this name property documented?  I'm not seeing it at https://developers.google.com/search/docs/advanced/structured-data/breadcrumb.  Like I'm not sure what a valid name should be.

It's documented here https://schema.org/name, and here https://schema.org/BreadcrumbList. It's not actually a required property for "BreadcrumbList" schemas. Not much info on what a valid name should be. Looks to me that it is a label used for organizing BreadcrumbList schemas.

Yeah, but isn't that talking about the name of the breadcrumb items?

... which you already had implemented?  This PR adds name to the root node, which I don't see in the spec.

The root node which is a schema of type "BreadcrumbList" also has a name property. The specifications for this schema type are here https://schema.org/BreadcrumbList.

The specifications for the breadcrumb items are here https://schema.org/ListItem

This and #5 have are now released as 0.3.0


Disable debug

maestro-shell still prints a lot of extra stuff even when debug is disabled and I'll be continue working on that, but this at least turns off the option by default.

Looks good.
If you want, you can provide an explicit default for DEBUG like this:
DEBUG=${DEBUG:-0} ./build.sh
...unless they check for the existence of the variable and not its value; but who would do THAT?

Unfortunately, that is the case:  https://github.com/armPelionEdge/greasego-old/blob/9e2b2196616e842f9d57d4d2101e53975b9ca722/build.sh#L47


Site header - Add visible label to search

See https://www.nngroup.com/articles/form-design-placeholders/

@zakiya Is this p1 or p2?

It's a change to the component, the website doesn't have a search bar.  So I guess p2.

Article is talking about forms. And I agree with it. But here we are dealing with very conventional  search box (just one text field). I wold ask our researchers to do research on it. Do you think many people will forget what they are focused on if there is only one text field? i doubt it.

I'm definitely in favor of doing research before making assumptions.

Though this article agrees with @kkoryaka that it's okay to hide the visually hide the label. http://web-accessibility.carnegiemuseums.org/code/search/


add a primary content to patch/content/primary

Create patch/content/primary (based on feature/body) branch and add primary content here

successfully added primary content to patch/content/primary


[Extension Feature Request] Improvements for the emoji search

Extension – Emoji

Author: @FezVrasta

The Emoji search is one of the most used workflows on Alfred for me, so super happy to see this has been added to Raycast => on the path to one hurdle less for finally switching. 🤗
Three things (in order of importance) that make it really hard for me to use right now are

lack of alternative names that one can use for searching for the emojis. An example: I tried searching arm, strong, muscle and didn't find the emoji (that here is called Flexed Biceps) that I wanted to use. It's near impossible to remember what all these emojis are called exactly, so being able to type in sensible description that match the right emojis is really important to me
The Alfred workflow has an option to hit "command + enter" and the selected emoji will directly be copied AND pasted into the text you're currently in. Is it possible to add this to this extension as well?
the emojis are quite small in the results... is there a way to make them bigger? I care less about the text description of the emoji and more really just want to see the actual emoji in the results when searching for one.

Thanks a lot for developing this in the first place! :)

Hi 👋 regarding your first point, we have a ticket to track the feature https://github.com/raycast/extensions/issues/451
About 2. I'm not completely sure, I think available actions from the API are either Insert OR Copy, not both at the same time.
About 3, no luck for now, the extensions API doesn't allow larger icons.


SDAF control plane & Infrastructure deployment

As per our requirement we want to deploy the control plane in another subscriptions as of workload zone and infrastructure zone. As per our CEP policies Peering is not allowed b/w the subscriptions and if peering is not an option, connectivity b/w hub and spoke subscriptions looks like not supported by SDAF (Via FW port openings)yet.
For now only one work around we have is deploying control plane and workload zone in same Vnets.
Please consider this as an enhancement and help us to give us fix in forth coming releases.

@KimForss @hdamecharla - could you please check if we can include this enhancement request in our coming sprint (bypass the VNET peering between control plane and workload zone).

I believe this is possible now.
I have the Control Plane VNet peered to a HUB VNet, in one subscription. The HUB VNet contains the Corporate Firewall & Bastion.
The Workload Zones for Dev/Test/Prod are each in their own VNet  in their own Subscription.
From: Prasenjit Roy @.>
Sent: Friday, 2 September 2022 5:29 AM
To: Azure/sap-automation @.>
Cc: Subscribed @.***>
Subject: Re: [Azure/sap-automation] SDAF control plane & Infrastructure deployment (Issue #255)
@KimForsshttps://clicktime.symantec.com/15tpJ8Vx28Wq1ehHskFt8?h=60IVr8Z3V6MBoYA51U5LUqsmTaat5RhFhSDVp_YSbMI=&u=https://github.com/KimForss @hdamecharlahttps://clicktime.symantec.com/15tpNxhEUkCRRbXDRJf2k?h=qb1eWWLfzJv3fm6uYOq9imRrxOIhugqkd9pyJO-nkOQ=&u=https://github.com/hdamecharla - could you please check if we can include this enhancement request in our coming sprint (bypass the VNET peering between control plane and workload zone).
—
Reply to this email directly, view it on GitHubhttps://clicktime.symantec.com/15tpDJJfZWqEbhsNLBrjW?h=MTx2e8RhU-ivEcOFYoApheQyTUNjhGPmMIeMehPhc5E=&u=https://github.com/Azure/sap-automation/issues/255%23issuecomment-1234575025, or unsubscribehttps://clicktime.symantec.com/15tpTntWwMt1qYM8xs4BN?h=Omj282ebUanxopzC_-S07Q6kzDzq7MJVNDTz7pBiM4o=&u=https://github.com/notifications/unsubscribe-auth/AJHBSTXT564DIMU47RSGL7DV4DRT5ANCNFSM6AAAAAAQCICD7M.
You are receiving this because you are subscribed to this thread.Message ID<EMAIL_ADDRESS>DXC Technology NZ Limited (Company number 1441241).
DXC Technology Company -- This message is transmitted to you by or on behalf of DXC Technology Company or one of its affiliates. It is intended exclusively for the addressee. The substance of this message, along with any attachments, may contain proprietary, confidential or privileged information or information that is otherwise legally exempt from disclosure. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient of this message, you are not authorized to read, print, retain, copy or disseminate any part of this message. If you have received this message in error, please destroy and delete all copies and notify the sender by return e-mail. Regardless of content, this e-mail shall not operate to bind DXC Technology Company or any of its affiliates to any order or other contract unless pursuant to explicit written agreement or government initiative expressly permitting the use of e-mail for such purpose.

Firewall

Hello Kimmos,
We have a FW in the hub (which has a corporate FW) and if both subscriptions (1 subscription contains control plane and the other is a subscription where we need to deploy workload zone). Do we have to open any specific ports because all the types of communications are blocked between spokes via FW


ringSecretName won't work for k8s >= 1.9.6

The code at  https://github.com/habitat-sh/habitat-operator/blob/master/pkg/controller/v1beta2/stateful_sets.go#L269-L275 :+1:
vm := &apiv1.VolumeMount{
	Name:      ringSecretName,
	MountPath: "/hab/cache/keys",
	// This directory cannot be made read-only, as the supervisor writes to
	// it during its operation.
	ReadOnly: false,
}

wont work anymore due to the ReadOnly: false option being silently ignored since 1.9.6.  See https://github.com/kubernetes/kubernetes/issues/62099.
This hits me in #351 as well since hab can't change the directory permissions on a read-only volume mount.  The suggested workaround is an initContainer combined with a emptyDir Volume

IIUC, This should be taken care by the operator. Operator should detect such changes and update the secret in k8s accordingly and then the secret is updated in all the pods that has it mounted.


Faciliates data-sharing through an interactive and responsive system for both the data provider and data user.

Closed as this is a development objective rather then user story. Delivered through the data portal


#37 - Fix ClassCastException introduced by Mockito's mock-maker-inline

I saw another pull request that has been in limbo for a while.  I experienced the same issue in Mockito's new mock-maker-inline.  While this feature for Mockito is incubating, it highlighted a flawed assumption in the code for mockito-kotlin: that all created mocks subclass MockAccess.  This doesn't hold when different mocking strategies (plugins) are used (hence why it fails for mock-maker-inline and not for open classes with open functions).  This is likely why @jskierbi observed a similar issue with PowerMock.  He mentioned the proposed fix (essentially the same as the one I've included) didn't quite work with PowerMock.  So far, I have not observed anything to indicate that is true for the mock-maker-inline feature.  I included a similar testing approach as well to ensure that we would get an error if the original method was ever called.
While I wouldn't normally suggest fixing stuff for an incubating feature, this seems quite important since it allows us to mock Kotlin classes and stub methods without declaring them open.  We can still get the benefits of some of the Kotlin protections while still creating robust tests with mocks.  It also reduces the burden for anyone starting with mocking on an already large project.
Because of the way we have to enable this feature (by creating a resource that triggers a different mocking strategy applied to all tests--see http://hadihariri.com/2016/10/04/Mocking-Kotlin-With-Mockito/), I placed my tests in a different source folder.  This way, existing tests that are expected to fail due to a class/method being closed will continue to do so.

Thanks! I have made some modifications to match the code style and added some additional checks.
See 85bb5e4c7941bf6e34df6dfa17e1eafbb0ebe7d7.


Does this work for .mp4 URLs ??

Well, I haven't tested it with video files but I don't see any reason why it wouldn't work. Keep in mind though, that all cached data is stored completely in RAM and returned to you as NSData object, so I don't recommend playing large video files (>100Mb).

Okay thank you so much, but this would be cached for how long ?
Can it last for a week for ex ?

As I said, you will be given NSData object upon successfull download. You are responsible for what to do with it next.

i know, but i meant the cache will stay for how long ? the data will stay cached for how long ? forever ?

CachingPlayerItem doesn't have internal cache. All it does is gives you ability to store downloaded resource by yourself.

I don't understand .. how it caches ?

Technically, it doesn't cache. It only loads the data and gives it to you.


Gulp support

Discussed and approved at the PyCon 2016 sprints:

Add optional Gulp support
If parity is achieved with Gulp, remove Grunt
Document how to use the new Gulp configuration

I'm working on this.

Merged in #585.


Enable less strict requirements on including sections

It would be really helpful to be able to generate documentation for simple files and not to have a warning about a lack of section, or the fact the lack of a file block. Would it be possible to warn rather than error?

Implemented in 1.3.0


Javadocs and minor refactoring for Nearby package

Added Javadocs, fixed lint issues and optimized imports for several classes in Nearby package. Did a minor refactor of NearbyPlaces.java and DirectUpload.java to make it more readable.
Tested on Nexus S running API 27.

Codecov Report

Merging #2188 into master will increase coverage by <.01%.
The diff coverage is 0%.

@@            Coverage Diff            @@
##           master   #2188      +/-   ##
=========================================
+ Coverage    5.72%   5.72%   +<.01%
=========================================
  Files         231     231
  Lines       11587   11583       -4
  Branches     1078    1078
=========================================
  Hits          663     663
+ Misses      10869   10865       -4
  Partials       55      55

Impacted Files
Coverage Δ

...rc/main/java/fr/free/nrw/commons/nearby/Place.java
0% <ø> (ø)
:arrow_up:

...a/fr/free/nrw/commons/nearby/NearbyController.java
0% <0%> (ø)
:arrow_up:

...ain/java/fr/free/nrw/commons/nearby/Sitelinks.java
0% <0%> (ø)
:arrow_up:

.../java/fr/free/nrw/commons/nearby/NearbyPlaces.java
0% <0%> (ø)
:arrow_up:

.../java/fr/free/nrw/commons/nearby/DirectUpload.java
0% <0%> (ø)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 24a76b1...0dcedf0. Read the comment docs.

Thanks @domdomegg . You're right about the nested if statements, the current code does look better. :)


Suppress nil value error in application insight scaler

Proposal
Hi team,
I would like to have the option to suppress the error of reading nil value as reading 0 in using application insights.
Use-Case
My use case is as follows:
I have a metric which only logs when there are incoming requests to the service. During the period of no requests, there will be no metrics. This caused the issue that over a time span with no activity, I am reading nil value over that metric, and this will put the scaled object into fallback (which I do not want) and flood the keda operator logs with error logs.
It would be great if there is an option to ignore the nil value error.
Is this a feature you are interested in implementing yourself?
No
Anything else?
No response

Hi @kia69028
In prometheus Scaler, we have an option to treat nil as zero (returning 0 when nil is returned). Could this be enough for your use case?

Hi @JorTurFer
Thank you for your replay. I saw that option in prometheus Scaler, and yes this is exactly what I want.
However, the issue is that I am using azure application insight scaler, which does not support this feature at the moment.
Therefore, I would want to know if there is any work around possible in azure application insight scaler.
Thank you!

Hi @JorTurFer
Thank you for your replay. I saw that option in prometheus Scaler, and yes this is exactly what I want. However, the issue is that I am using azure application insight scaler, which does not support this feature at the moment. Therefore, I would want to know if there is any work around possible in azure application insight scaler.
Thank you!

IMHO it is not, but we are open to contributions. It's quite easy task, you can take inspiration from the Prom scaler.

Fixed by #4329


Stake Program

⚠ NOTE: The AuthorizeWithStake is giving me fits still, but I think it's close; obv much cleanup/documenting to do, but I wanted to confirm this is what we're looking for

Status
Type
⚠ Core Change
Issue

In Progress
Feature
Yes (addition)
Link

Problem
Implementing the Stake Program from the SDK

Not sure what I did to break that unit test, if anything, but I'll figure that out

I believe I have made the requested changes

I have made these changes. The TryCreateWithSeed is suddenly giving AddressWithSeedMismatch, though I am not sure what has changed to make it so. Fiddling with the EncodeRustString merely gives invalid transaction errors.


Feature: MQTT Battery % sensor as battery.

Hello.

In HA, to better show the battery percentage of my laptop on a Lovelace dashboard, I customise the sensor entity with the following:
sensor.spectre_x360_battery_charge_remaining_percentage:
unit_of_measurement: '%'
device_class: battery
friendly_name: X360 Battery %
icon:
By showing class as battery, and "unsetting" the icon, I can show the HA Battery icon as a dynamic icon, that changes size and colour based on the charged percentage:

Could you possibly update the sensor device class and remove the defined icon? I think this shows the icons more intuitively.
Thanks for the HASS.Agent - my laptop and tablet batteries charge to 80% and stay charging when they are at 15%. This is a battery saver, end ensures that my batteries stay in good health and don't bulge, when the device stays plugged in for days.
A great tool for a home assistant junkie!

Hello,
What kind of card are you using for the battery display?
When I just add some battery devices, icons are always blue, only navigating to the details makes them "coloured":

In general I'd say this is a very good suggestion (very large assumption but most likely when the battery sensor was implemented, HA didn't colour the battery icons or the author wasn't aware of this fact) but we'd also need to think about how this will impact people actually using the icon values from those sensors.

Using a "Glance Card" (The one with the Pellet Stove title that I have to change as it has evolved) and a vertical stack standard entity in the card higher up, to the right of the "HP Pavilion" charger icon.
It maybe the unit of measurement, or that device class (but you refer to batteries - so I guess you alrady have device class = battery).
I have a fullyKioskBrowser on an android tab I use to display the dashboard, and it has MQTT integration to send details to the MQTT broker, With this integration I saw the colored battery as soon as I added it, but had to do the following to get the HASS.Agent battery sensor to show in this way:
Nothing else special, other than adding this to my homeassistant: secontion of my configuration.yaml file :
customize:
    sensor.spectre_x360_battery_charge_remaining_percentage:
      unit_of_measurement: '%'
      device_class: battery
      friendly_name: X360 Battery %
      icon:


Notification suddenly stopped working - Error: getaddrinfo EMFILE fcm.googleapis.com : getaddrinfo EMFILE fcm.googleapis.com

Hi there,
I have built a app few months back using your chat and video call service, app was working fine. Notifications were working fine.
Now I have rebuild the app to make some changes, but notifications are no longer working -
My app details -
"react-native": "0.63.0",
"react-native-connectycube": "^3.7.5",
android log

connectycube admin

Notification log from connectycube admin - 1

Notification log from connectycube admin - 2

Have I to make any changes - as it was all  working fine and suddenly I start getting errror -
"Error: getaddrinfo EMFILE fcm.googleapis.com : getaddrinfo EMFILE fcm.googleapis.com"
I have also checked with Mobile phone, getting same error
Please guide

Also  I had used  notification to inform call receiving user of incoming video call - viideo call also has stopped

@rexcode is it still actual?

Hello,
I encounter the same problem, @rexcode have you found a fix ?

@arnofo are you still face it?

@DaveLomber i just tested it and it seems to work again.
Would be nice to know what caused it though.

It looks like a network issue, e.g. a ConnectyCube Push service was not able to communicate with Google FCM service by some reason.
Looks like as an intermittent connection issue

Me too, please help me check push notify android chat message, iOS work, android not work

@andybui090 please share more details


feat(ci): Add action for bumb version

Add action for bumb version
Fix https://github.com/SchwarzIT/go-template/issues/180

Tested on fork and works fine 🙂


Enable multiple op synthesis from capture points on multiple values

To be discussed at next session.

duplicate of #1099


Need to Increase TOKEN_SCOPE field length in tables

Describe your problem(s)
Need to alter all existing IDN_OAUTH2_ACCESS_TOKEN_SCOPE tables to hold 100 varchars in TOKEN_SCOPE field.
This is in order to match the database script change introduced in: https://github.com/wso2/carbon-apimgt/pull/10704
Describe your solution

How will you implement it

Optional Fields
Related Issues:

Suggested Labels:

Suggested Assignees:

Hi @chathuranga95
I found this table in multiple repository of wso2. Is it required to update all of them or specific ones? As per my understanding all of them required update.
Please confirm.

Added the above to 4.1.0-4.0.0 migration scripts


sudden memory increase  in jaeger collector

Requirement - what kind of business use case are you trying to solve?
We have a jaeger 1.14  set up working since last 3-4 months without any issue which has two collector pod  , with provision of 4GB  memory in  Kubernetes cluster.  Average memory usage  by jaeger collector was around 1GB . Somedays back there was sudden spike in memory and increased till 4GB  for one collector and  another collector was around  1-2 GB.  There is no increase in corresponding traffic . Only  change i see is  there was a schedule maintenance  in kubernetes cluster  during that time  drain and delete some worker node from kubernetes cluster .    Is there anyway i can further check what is causing the memory hike ?

Problem - what in Jaeger blocks you from solving the requirement?

Proposal - what do you suggest to solve the problem or improve the existing situation?

Any open questions to address

Any pointer will be appreciated

Are you also storing metrics from the /metrics endpoint? If so, check for the metrics around the queue sizes, as that's the only thing that should impact the memory consumption. It should get stable over time if you have enough throughput in the storage part, though.

Attached is the  last 6 hours  collector queue size  and  and  colellector memory graphs
  . Do not see that much queue size   or span drops

With the given information, I can't figure out what might be happening. How are you getting the memory stats? Do they match with the metrics reported by the collector, like go_memstats_alloc_bytes, go_memstats_alloc_bytes_total, go_memstats_heap_objects, process_resident_memory_bytes, process_virtual_memory_bytes?
Do you also see that for new instances? What happens if you scale the collector up to 4 pods?

@prana24 what storage backed are you using?

@jpkrohling  ,   we get memory usage by using  cadvisor   avg(container_memory_usage_bytes{container_label_io_kubernetes_container_name="jaeger-collector"}) by (pod)    is the query  being used for the same.
I have not used metrics mentioned by you , will add it ,   I think these are client ( agent ) specific metrics right ?  Does it also co-relate to collector  memory usage ?

@pavolloffay   we are using Elastic Search  for backend storage

I think these are client ( agent ) specific metrics right ? Does it also co-relate to collector memory usage ?

They are all common to all components, so, they exist as well for the collector. Not sure there's a 100% correlation between them and what you see from cadvisor, but I would expect to also see a spike there.

@jpkrohling  I see your point , will share the findings with you as soon as i see something


fix: fix bug about tsconfig  bug.

Changes
In most cases. When users import the official typescript plugin. The path of tsconfig.json is in the root dir. So we should set the default value to the arg field. It can also fix the bug https://github.com/snowpackjs/snowpack/discussions/2190.

Testing
All tests have been passed.

Docs
Have been updated.

We set cwd: snowpackConfig.root || process.cwd(), in the call to tsc, so I think this isn't needed? Or, maybe what we want to do is add support for a special root option to this plugin, which would then set the cwd of the command that gets run.
The root should be the cwd for most users, unless they explicitly set root in their config file. So, I think that the current args support is okay to leave as-is for now.

We set cwd: snowpackConfig.root || process.cwd(), in the call to tsc, so I think this isn't needed? Or, maybe what we want to do is add support for a special root option to this plugin, which would then set the cwd of the command that gets run.
The root should be the cwd for most users, unless they explicitly set root in their config file. So, I think that the current args support is okay to leave as-is for now.

We set cwd: snowpackConfig.root || process.cwd(), in the call to tsc, so I think this isn't needed? Or, maybe what we want to do is add support for a special root option to this plugin, which would then set the cwd of the command that gets run.
The root should be the cwd for most users, unless they explicitly set root in their config file. So, I think that the current args support is okay to leave as-is for now.

The reason for that bug is we don't set the default path of config to tsc. when we use create-snowpack-app to create an app with a typescript. we should set the args filed by ourselves or the tsconfig.json can't work. But in most cases. the args is the root dir of projects. So I think we should set the default value for args.

We set cwd: snowpackConfig.root || process.cwd(), in the call to tsc, so I think this isn't needed? Or, maybe what we want to do is add support for a special root option to this plugin, which would then set the cwd of the command that gets run.
The root should be the cwd for most users, unless they explicitly set root in their config file. So, I think that the current args support is okay to leave as-is for now.

The reason for that bug is we don't set the default path of config to tsc. when we use create-snowpack-app to create an app with a typescript. we should set the args filed by ourselves or the tsconfig.json can't work. But in most cases. the args is the root dir of projects. So I think we should set the default value for args.

Sorry for dropping this, I still think that this isn't required since we set cwd to the project root when we run the command. If you could spin up a quick reproduction that I could run locally to reproduce this issue, I'd be happy to revisit.
In the meantime, closing as a part of some triage/cleanup work but happy to reopen if you're still interested in getting this merged!


Fixes for Issues reported by Repository checker [#350]

#350

@mattreim
Are you sure that words.js is NOT used by any code part? Might be access from runtime code too - not only from (removed) admin html code. Did you check this?
If deleted adaptions at weblate config are required. Whover merges this PR please consider this and contact me.

You're right. I can't check it properly so I restored it.

@mattreim
Did you Test compact mode?
Simply enabling it is not the goal.

Actually it should work with admin5.

Actually it should work with admin5.

Ähhmm
I do not see any reaktion between ADMIN and compact mode. Did you mean js-controller 5?
But there might be a timer which is not cancelled at unload. Thats incompatible with compact mode.


PermissionError: [Errno 13] Permission denied: '/home/pythainlp-data'

pyspark
py file settings  os.environ['PYTHAINLP_DATA_DIR'] = "./"
Distributed operations to executor nodes to report permissions
How to set the environment variables of each executor node in a distributed environment

Hi,
Thanks a lot for reporting the issue. As far as I know, we haven't tested much on such a distributed system, e.g. Spark.
Would you mind elaborating a bit more about your system, e.g. what is the setup of your cluster?

@COLDkl have you tried changing ./ to something else and see if it works?

Hello everyone, we use the company's machine to submit the Spark task to translate Thai data, so we cannot have root privileges.
I changed the pythainlp-data directory to the current directory to avoid program errors due to permission issues

In order to speed up the translation, we changed the code to run distributed. Currently, it is not possible to change the PYTHAINLP_DATA_DIR path of each computer in the Spark task.

Spark 2.4.5
python 3.6
pythainlp 2.2.3

If PYTHAINLP_DATA_DIR is not defined, PyThaiNLP will use ~/pythainlp-data,
see https://github.com/PyThaiNLP/pythainlp/blob/dev/pythainlp/tools/path.py
Does it ok for this case? As it is home directory and not root.
Or you like to have a unique directory for each computer?

We use the Spark framework for distributed computing and translation
The Spark computing framework consists of Driver nodes and Executor nodes
Currently, Spark tasks are started in the Home directory by default
PermissionError: [Errno 13] Permission denied: '/home/pythainlp-data'

Why not consider migrating the default directory from ~(home) to. (Current) Directory?
pythainlp_data_dir = os.getenv("PYTHAINLP_DATA_DIR", os.path.join("~", PYTHAINLP_DEFAULT_DATA_DIR))
pythainlp_data_dir = os.getenv("PYTHAINLP_DATA_DIR", os.path.join(".", PYTHAINLP_DEFAULT_DATA_DIR))

When the Spark program is running, a temporary directory will be generated on the Driver node. This directory stores some data and dependencies of the program. After the program ends, the current directory will be automatically deleted.

I don't know if it is possible to set the default path like this

PYTHAINLP_DEFAULT_DATA_DIR = "pythainlp-data"
pythainlp_data_dir = os.getenv("PYTHAINLP_DATA_DIR", os.path.join(".", PYTHAINLP_DEFAULT_DATA_DIR))
path = os.path.expanduser(pythainlp_data_dir)
os.makedirs(path, exist_ok=True)

Do we also have to make sure executor nodes have this directory?

For distributed tasks, you must ensure that each running node has a target directory.

@COLDkl Did you encounter the same problem with nltk? (nltk-data)

Not used in a distributed environment

any updates on this issue?

I've encountered the same problem for using pythainlp on Spark

It worked for us for pySpark code :)
import os
os.environ['PYTHAINLP_DATA_DIR'] = './pythainlp-data'
import pythainlp
from pythainlp.tokenize import word_tokenize as thai_tokenizer

for nltk_data error in pyspark
import nltk
nltk.download("punkt", download_dir='./nltk_data')

For NTLK error: PermissionError: [Errno 13] Permission denied: '/home/nltk_data'
raise LookupError(resource_not_found)
Add this in code:
import os
os.environ['NLTK_DATA'] = './nltk_data'
nltk.download("punkt", download_dir='./nltk_data')
nltk.data.path.append(nltk_data_path)


legend needs to account for multiple colors/size/type in one call

gs <- gsplot() %>%
  points(1:5, 1:5, col=colors, cex=1:5, pch=15:19, legend.name="Options") %>%
  legend(location = "topleft")
gs

I guess what I mean is I want to be able to make a manual legend. Or use legend as if I were in base graphics:
So in base R, this:
plot(1:5, 1:5, col=colors, cex=1:5, pch=15:19)
legend(1,5, pch=15:19, legend=c("a","b","c","d","e"),col="red", title = "Thing 1")
legend(1,3, pch=19, legend=c("1","2","3","4","5"),col=colors, title = "Thing 2")
legend(4,2.5, pch=19, legend=c("a1","a2","a3","a4","a5"),
       pt.cex = 1:5, title = "Thing 3", col="red")

Would be:
gs <- gsplot() %>%
  points(1:5, 1:5, col=colors, cex=1:5, pch=15:19, legend.name="Options") %>%
  legend(location = "topleft", pch=15:19,
         legend=c("a","b","c","d","e"),col="red", title = "Thing 1" ) %>%
  legend(location = "toleft", pch=19,
         legend=c("1","2","3","4","5"),col=colors, title = "Thing 2") %>%
  legend(location="bottomright",pch=19, legend=c("a1","a2","a3","a4","a5"),
         pt.cex = 1:5, title = "Thing 3", col="red")
gs


Added Kerberos documentation

What is this PR for?
Added Kerberos setup with Zeppelin
What type of PR is it?
Documentation
Is there a relevant Jira issue?
No
How should this be tested?
Check out the website
Screenshots (if appropriate)
Questions:

Does the licenses files need update? No
Is there breaking changes for older versions? No
Does this needs documentation? No

Thank you for contribution @sejunra
Right now CI fails on the new file you have added, as it does not have an apache licence header.
 Unknown Licenses

*******************************

Unapproved licenses:

  docs/manual/conf_kerberos.md

*******************************

Would you care for adding one please?
See this example for a licence header in docs, right before {% include JB/setup %}

Thanks for the documentation.
While the documentation is specific for Spark Interpreter, why not adding it under /docs/interpreter/spark.md ?

@Leemoonsoo kept it on manual instead of your recommended /interpreter folder as it made more sense under /manual which is more how-tos and not related to interpreters (though it's specific to spark). If you feel strongly about the /interpreter location, I can move it.

@sejunra
The docs/interpreter/spark.md supposed to have configurations for Spark Interpreter. And this document have instruction for configuring SparkInterpreter with Kerberos enabled yarn cluster. Not applied to any other interpreter nor Zeppelin server daemon. I think docs/interpreter/spark.md natural place to be.
Then the duplication that this documents made (instruction for SPARK_HOME and HADOOP_CONF_DIR) also can be removed. And user can see all necessary information in a single place.
It's up to you, but i suggest move it into docs/interpreter/spark.md or at least update doc to make it clear that the instruction is for only Spark interpreter.

@sejunra any update?

sorry. thought i already pushed. done.

Made all changes as requested.

looks good to me - @AhyoungRyu @Leemoonsoo ?

LGTM

I left some comments in this file. Except them, LGTM! : )

@AhyoungRyu thank you for a thoughtful review!
If you have a spare moment and could contribute those 2 changes, please do, as it might really speed merging this on a lot.

@bzz I've addressed and pushed them : )

Thank you so much for taking care!
Merging this guy if there is no more discussion.

Let's merge! : )


Can it work with shadowsocks-windows?

I tried to use it with ss-win, but just got an error: "tcp.go:63: failed to get target address: SOCKS error: 8".
But it works well with Proxifier, which is inconvenient for me.
So here is my question. Thanks for your reply!

Same error message, start ss client on windows 10

Same error on shadowsocks-NG on MacOS.

Cannot reproduce the issue on my Mac/PC.
I will reopen if there is an update regarding this issue

Same error on Kali linux.

Same error on Kali linux.

Which version of go-shadowsocks2 and shadowsocks-windows did u use?
And which cipher, plugin?

"SOCKS error: 8" means ErrAddressNotSupported in readAddr, it is mostly because the browser/Windows does not support socksv5. use firefox or other proxy tools on windows instead.


ImproperlyConfigured at /admin

ImproperlyConfigured at /admin
You're using the Django "sites framework" without having set the SITE_ID setting. Create a site in your database and set the SITE_ID setting or pass a request to Site.objects.get_current() to fix this error.

I'm also experiencing this. Tested with django 2.0 and django 1.8


Multiple inventories to generate multiple outputs.

I'm wondering if there is anyway to have exclusion lists during generation and insert "include"/"using"/"import"s etc in the output?  The specific intention is that I want to generate multiple files from a crate rather than a single bulk header.  One file would be a support type used in the other files but currently the support type gets generated in all generated files.  I haven't run across any way to tell interoptopus to insert an include/using/import statement during generation nor a way to tell it not to generate something referenced just because it has a CType implementation (i.e. it was generated by an other inventory).  Have I missed something here?
I'm currently using CBindgen which allows this in an annoying way, I have a whole slew of little crates which I generate as individual files and of course tweak all the toml's to exclude the things I don't want in each.  With the inventory approach here, it seemed like I could do this without all the annoyances, except the above?

I'm not sure I fully understand your use case, but are "namespaces" what you are looking for? You can put items into namespaces and at generation time use that to filter. The C# backend has best support for that right now. Which backend do you use?

Yes, if I understand that correctly this should be what namespaces address, have a look at the common namespace that's using in some examples.
Unfortunately their support in the backends varies, C being the worst. Depending on what you specifically want to achieve you might get away by applying an inventory filter when writing headers, and adding an explicit include. If that doesn't work then this would need a PR.

Well, I ended up in a meeting so haven't looked at the namespaces yet but you did mention two things I haven't seen in the docs yet so hopefully you could point towards them.  The "inventory filter" and adding an explicit 'include' bits.  That would work just fine for the simple case that I have but I never saw them while spelunking the documentation.

So, after poking around, the filter + explicit include seemed like the best solution for my purposes.  Only problem was that while internally when using C I don't allow headers in .h files, the externally visible files should be self contained for ease of use.  So, after poking about in the C generator I could not find anything which allowed me to control additional includes.  So, I present for your perusal: PR https://github.com/ralfbiedert/interoptopus/pull/103
Let me know if there is anything you would like changed.  It seems to accomplish what I need though and all the tests passed.

Looks good!