[HCA DX] Remove deprecated UA tags, triggers and variables from GTM

Need
The HCA GTM container still has configuration objects (tags, triggers and variables) that are specific to UA; these need to be removed.
Definition of Done

[ ] All UA-specific objects are removed from GTM.
[ ] Remove any UA-specific values from GA.

The following UA tags were removed:

Bulk Download Copy to Clipboard

Entity Type
Entity URL
Tool Name
Index
Catalog

Bulk Download Request (implemented in GA4)

Entity Type
Tool Name
Index
Catalog

Cohort Manifest Copy to Clipboard

Entity Type
Entity URL
Catalog

Cohort Manifest Download

Entity Type
Entity URL
Catalog

Chort Manifest Request

Entity Type
Catalog

DB Page View
Entity Return to Tab

Current Query
Catalog

Entity Select Tab (already implemented as entity_selected)

Current Query
Catalog

Export Copy to Clipboard

Entity Type
Entity URL
Tool Name
Index
Catalog

Export Launch

Entity Type
Entity URL
Tool Name
Catalog

Export Request

Entity Type
Tool Name
Catalog

File Download

Entity URL
Related Entity ID
Related Entity Type
Current Query
Catalog

Portal Link

Entity URL
Current Query
Source
Catalog

Portal Page View
Project Download/Copy Full Manifest

Entity ID
Entity URL
Related Entity ID
Related Entity Type
Related Entity URL
Catalog

Project Download/Copy Manifest/Matrix

Entity ID
Entity URL
Related Entity ID
Related Entity Type
Related Entity URL
Catalog

Project Request/Copy curl

Entity ID
Catalog
Tool Name
Term

Project View Accession

Entity ID
Related Entity ID
Related Entity Type
Related Entity URL
Catalog

Project View Deprecated

Entity URL
Current Query
Entity ID
Catalog

Project View External Resource

Entity URL
Related Entity ID
Related Entity Type
Current Query
Entity ID
Related Entity URL
Catalog

Project View Withdrawn

Entity URL
Current Query
Entity ID
Related Entity URL
Catalog

Request/Copy/Launch Project Terra

Entity ID
Catalog
Tool Name
Term

Search

Entity Type
Current Query
Facet
Term
Source
Min
Max
Entity ID
Index
Catalog

Search Metadata Click

Entity Type

Search Metadata Enter Text

Entity Type

Search Result Page

Current Query
Index
Catalog

Search Result Sort

Entity Type
Current Query
Source
Direction
Index
Catalog

Support Request Create

Source
Catalog

Survey Launch
View Catalog

Entity Type
Catalog

View Matrix Archive Preview

Entity Id
Related Entity ID
Related Entity Type
Catalog

LGTM, thanks @jpaten!


Rework Sextant verity logic

This change simplifies and documents the dm-verity logic and moves it into its own crate.
Fixes #55.

Good idea to split it up!


WIP: Enable config flow for Tesla

Breaking Change:

Device tracker entity names have changed due to the conversion to config_flow. They now follow the naming convention of the rest of the Tesla entities.
Description:
This add config flow to Tesla.
Related issue (if applicable): fixes #
Pull request with documentation for home-assistant.io (if applicable): home-assistant/home-assistant.io#11170
Example entry for configuration.yaml (if applicable):

Checklist:

[x] The code change is tested and works locally.
[x] Local tests pass with tox. Your PR cannot be merged unless tests pass
[x] There is no commented out code in this PR.
[x] I have followed the development checklist

If user exposed functionality or configuration variables are added/changed:

[x] Documentation added/updated in home-assistant.io

If the code communicates with devices, web services, or third-party tools:

[x] The manifest file has all fields filled out correctly. Update and include derived files by running python3 -m script.hassfest.
[x] New or updated dependencies have been added to requirements_all.txt by running python3 -m script.gen_requirements_all.
[x] Untested files have been added to .coveragerc.

If the code does not interact with devices:

[x] Tests have been added to verify that the new code works.

Please split this PR into two sequential PRs. The first should migrate to async api and update the dependency. The second should add config entry support.

@MartinHjelmare That will be extremely difficult since this was based off #28131 and included many suggested changes from that PR where config_flow was added first.

Keep this branch for the second PR. Then make a new branch for the first PR based from dev branch and go over each module and change the api. Then after the first PR is merged, rebase the branch for the second PR, this branch, on dev branch and solve any conflicts.
For the second PR,

@MartinHjelmare The first PR will not be standalone functional. For example the device tracker was rewritten per your prior request for async. I don't intend to rewrite it sync just to create a first PR.

The device tracker change can only come in the second PR since it relies on config entries.

As long as you're ok with the first PR not being functional, I'll do the breakup.

We can still use the old device tracker class but just change to async api to make it work.

There are significant structural changes beyond the device tracker. That was one example. As another example, I never built an async_setup_platform because I converted directly to async_setup_entry. I'd basically have to rewrite it from scratch to get a functional async without config entry.

What significant changes are there? In the binary sensor platform it looks like three lines need to change:
async def async_setup_platform(...):
    ...

    async def async_update(self):
        await super().async_update()

I don't think it's productive to list every change that was made and argue how easy it would be to rewrite it in a separate PR. If you don't believe me that there are additional changes, then that is fine.
I think it's a huge waste of time to write and test sections that will be immediately removed by the next PR for config_flow. I don't intend to test the first PR. If that's a problem, I'll just close this and save all time for all of us.

We'll save time by doing this split. The time for the work doesn't stop when you create the PR. It stops when the PR is merged. Reviewaand adjusting a bug PR takes longer than reviewing and adjusting many small PRs. We'll be able to focus our attention on fewer changes in each PR.
The first PR focus will be the change in the component to use the library with asyncio. The platforms will just contain a few lines of change each.
The second PR will focus on using config entry api and adding the config flow and tests for that.

@MartinHjelmare I assume you also want a separate pr for the icon fix and adding a new sensor right?

Yes, please. :+1:

Ok, I'll add those in after this one. This should be ready for your review.

@MartinHjelmare Any chance to review this or are you waiting for me on something?

Sorry, I'm just busy with other things at the moment. I'll try to find some time.

As a general question, does it make sense if I add myself as a codeowner since I've been helping @zabuldon with the recent changes in the underlying library and here?

@alandtse, yes please add yourself as a codeowner 👍

There are still unresolved comments that needs addressing. Otherwise this looks good.

@MartinHjelmare @balloob The unresolved conversations are related to how to update the options with a config import where no config entry exists yet. Right now I can get it to work with a lambda with async_call_later because the entry doesn't exist immediately but open to suggestions on how to approach.

There's also this question:
https://github.com/home-assistant/home-assistant/pull/28744#discussion_r354153266

@MartinHjelmare That code is no longer needed.

@balloob Any chance you can chime in on how to handle the options updating by configuration.yaml importing?

@balloob Any update?

@MartinHjelmare Is there anything that can be done to move this forward?

https://github.com/home-assistant/home-assistant/pull/28744#discussion_r360269514

@MartinHjelmare done

Please add tests to reach 100% test coverage of the config flow module.

@MartinHjelmare done.

@MartinHjelmare Thanks again for all your help. Changes completed. I also added an options test for a SCAN_INTERVAL being too low.

We should add to the breaking change paragraph that the id device tracker entity attribute was removed.

I think this is ready when the last comments are addressed.


Dimensionality Reduction Manifold Preservation

Describe the problem concisely.
Preserving measures of stress / manifold topology in low dimensional embeddings of single cell data
Propose datasets
Include links to at least one publicly available dataset that could be used.
Propose methods
UMAP, PHATE, PCA
Propose metrics
https://github.com/scottgigante/DEMaP
https://github.com/scikit-learn/scikit-learn/blob/0fb307bf39bbdacd6ed713c00724f8f871d60370/sklearn/manifold/_mds.py#L20

Thinking about how to use DEMaP in these settings where we are not simulating data. Would it make sense simply to have a separate task or subtask where ground truth is available and only use it there? Or treat the raw data as ground truth and compute DEMaP anyway?

I think it's probably better to do this only on simulated data where there's ground truth. I think we could probably use a few different kinds of simulated data?

I think it's probably better to do this only on simulated data where there's ground truth. I think we could probably use a few different kinds of simulated data?


Can't compile on fresh debian install?

I've been having trouble building noria-server on my fresh debian stretch install. I've installed libclang-dev and build-essential, and I have a libstdc++ on my system, but I'm having trouble building rocksdb-sys:
# rustc -V
rustc 1.32.0-nightly (00e03ee57 2018-11-22)
# cargo build --release --bin noria-server
   Compiling librocksdb-sys v5.14.2 (https://github.com/ekmartin/rust-rocksdb.git?branch=custom#20f8595a)
error: failed to run custom build command for `librocksdb-sys v5.14.2 (https://github.com/ekmartin/rust-rocksdb.git?branch=custom#20f8595a)`
process didn't exit successfully: `/app/target/release/build/librocksdb-sys-86702df300c1afd1/build-script-build` (exit code: 101)
--- stdout
cargo:rerun-if-changed=build.rs
cargo:rerun-if-changed=rocksdb/
cargo:rustc-link-lib=lz4
cargo:rerun-if-changed=snappy/

--- stderr
rocksdb/include/rocksdb/c.h:48:9: warning: #pragma once in main file [-Wpragma-once-outside-header]
rocksdb/include/rocksdb/c.h:68:10: fatal error: 'stdarg.h' file not found
rocksdb/include/rocksdb/c.h:48:9: warning: #pragma once in main file [-Wpragma-once-outside-header], err: false
rocksdb/include/rocksdb/c.h:68:10: fatal error: 'stdarg.h' file not found, err: true
thread 'main' panicked at 'unable to generate rocksdb bindings: ()', src/libcore/result.rs:1009:5
note: Run with `RUST_BACKTRACE=1` for a backtrace.

I think the fatal error: 'stdarg.h' file not found error comes from an issue with your clang installation — what version does libclang-dev provide? You could try installing the clang package explicitly, and if that doesn't work, try installing at least version 6 of clang?


Incorrect result when the name of a method is equal to the name of any parameter with deconstruction

In the screenshot below, object method name options is equal to the name of the first argument options.  It seems that the first line in the function body (const { input } = options) was wrongly transformed.
Code

However, if I slightly change the first line statement, it turns fine:
Code

Adding: According to this repo and its dist file, it seems "buble": "^0.13.1" worked correctly.


Add full support for Android O and update deps

@samtstern I've got a string of PRs lined up. This one updates deps, adds explicit autofill support, and does Android O cleanup.

Woot!


Add CLIs: dt, sigi, findup, fib, and yn

feat: add so-dang-cool/yn
feat: add so-dang-cool/findup
feat: add so-dang-cool/dt
feat: add so-dang-cool/fib
feat: add sigi-cli/sigi

Thank you!

About so-dang-cool/dt, I regenerated code with --deep option and fixed the code manually.
rm -R pkgs/so-dang-cool/dt
aqua-registry scaffold --deep so-dang-cool/dt # Same with `cmdx sd so-dang-cool/dt`

About so-dang-cool/yn, in my understanding filenames is case insensitive on macOS.
So commands Yn and yN can't be installed to the same directory.
aqua creates symbolic links in AQUA_ROOT_DIR/bin, but aqua can't create those links in it.

About so-dang-cool/yn, in my understanding filenames are case insensitive on macOS. So commands Yn and yN can't be installed to the same directory. aqua creates symbolic links in ${AQUA_ROOT_DIR:-${XDG_DATA_HOME:-$HOME/.local/share}/aquaproj-aqua}/bin, but these links can't be created in it.

05c36c4e89b33cee0ea3b99d5091f1e9f08141cc To address the issue, create only Yn on macOS.

v4.66.0 is out 🎉
https://github.com/aquaproj/aqua-registry/releases/tag/v4.66.0


Features a Code of Conduct at the top level directory of the project repository or prominently in the documentation (with a link in the navigation, footer, or homepage).

We need this automated deploys through Netlify.  This is an item that will give us all the Pro features

Moving to "Ready to be staged".  The code of conduct is in dev


Move package.json and package-lock.json to .gitignore

I have seen in some pull requests that the package.json is being committed as well, maybe it should be in the .gitignore files or should made clear to not add the package files.
Thank you.

We should make this clear not to commit, these should not be ignored otherwise people cannot install in the dependencies

yes otherwise their might be different version of packages installed for different people.

We should make this clear not to commit, these should not be ignored otherwise people cannot install in the dependencies

Yes I agree

I will change the issue name.
Thank you

thank you 👍

Is this to be added in the readme?

Yes, I think that is where it should be said @krishguptadev

I think we should wait for the contributing.md file and add it there instead. Thanks 😊👍


building drake_cmake_installed with clang++ causes a 'google::protobuf::FatalException' at runtime

I was debugging linker errors on a different project which uses drake as an external and discovered that building with clang++ solves the linker issues (will submit this as a separate issue once I understand it better) but introduces a libprotobuf exception at runtime.
This is on a fresh install of Ubuntu 16.04. This problem does not occur on macOS.
to reproduce (following the README.md instructions in drake_cmake_installed):
mkdir build
cd build
cmake -Ddrake_DIR=$HOME/drake/build/lib/cmake/drake -DCMAKE_CXX_COMPILER=/usr/bin/clang++ ..
which produces the following output:
-- The C compiler identification is GNU 5.4.0
-- The CXX compiler identification is Clang 3.8.0
-- Check for working C compiler: /usr/bin/cc
-- Check for working C compiler: /usr/bin/cc -- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Detecting C compile features
-- Detecting C compile features - done
-- Check for working CXX compiler: /usr/bin/clang++
-- Check for working CXX compiler: /usr/bin/clang++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Could NOT find GTest (missing:  GTEST_LIBRARY GTEST_INCLUDE_DIR GTEST_MAIN_LIBRARY)
-- Could NOT find GTest (missing:  GTEST_LIBRARY GTEST_INCLUDE_DIR GTEST_MAIN_LIBRARY)
-- Configuring done
-- Generating done
-- Build files have been written to: /home/momap/exp/sham/drake_cmake_installed/build

then make -j and cd src/particles followed by ./uniformly_accelerated_particle_demo which results in:
[libprotobuf ERROR external/com_google_protobuf/src/google/protobuf/descriptor_database.cc:58] File already exists in database: google/protobuf/any.proto
[libprotobuf FATAL external/com_google_protobuf/src/google/protobuf/descriptor.cc:1394] CHECK failed: generated_database_->Add(encoded_file_descriptor, size):
terminate called after throwing an instance of 'google::protobuf::FatalException'
  what():  CHECK failed: generated_database_->Add(encoded_file_descriptor, size):
Aborted (core dumped)

The whole pipeline works fine if you omit the -DCMAKE_CXX_COMPILER=/usr/bin/clang++ and I wouldn't care - except my other project won't link if I don't use clang.
An example failure in my custom project:
[ 81%] Linking CXX executable test_ik
libdracula.a(constraint_solver.cc.o): In function `ConstraintSolver::getJointNames[abi:cxx11]()':
constraint_solver.cc:(.text+0x2291): undefined reference to `RigidBodyTree<double>::get_position_name(int) const'
collect2: error: ld returned 1 exit status

Thanks for the help! In the meantime I'll try and get the other project building without clang.

Can you confirm whether the installed bazel you have is gcc or clang?
(If you got the binaries via wget from the server, they will have been built with gcc, if instead you just did a bazel run //:install, it will be clang). Not an ideal situation, but we're looking into that.

I believe it was originally clang. I was able to fix my libprotobuf error by first building drake with bazel build --compiler=gcc-5 --config snopt //... and then compiling my cmake project as usual.
However, I'm now running into segmentation faults in my external project, which are not present in the macOS build which uses clang.

results so far (build / run)
drake-clang & drake_cmake_installed-clang : SUCCESS / FAIL (libprotobuf)
drake-clang & drake_cmake_installed_gcc : SUCCESS / SUCCESS
drake-gcc & drake_cmake_installed_gcc : SUCCESS / SUCCESS
drake-clang & my_project-clang : SUCCESS / FAIL (libprotobuf)
drake-clang & my_project-gcc : FAIL ( won't link - can't find the drake symbols)
drake-gcc & my_project-gcc : SUCCESS / FAIL (segmentation fault - though this looks fixable)

to clarify drake-gcc & my_project-gcc - I can build drake examples and run them, so from your standpoint this is a SUCCESS / SUCCESS

The drake-clang & my_project_clang is probably where we should focus. Is my_project_clang also linking to libprotobuf by another path (non-drake, e.g. directly or transitively via another library)?

Not unless drake_cmake_installed-clang is somewhere. That fails in the same way as my project with the libprotobuf error. I would have expected clang / clang to work fine - and it does on macOS.

drake-clang & drake_cmake_installed-clang is actually working for me, though using
cd build && cmake -Ddrake_DIR=/opt/drake/lib/cmake/drake -DCMAKE_CXX_COMPILER=/usr/bin/clang++-4.0  .. && make VERBOSE=1 -j5

when I build the actual project (you used /usr/bin/clang++, which I do not have).

hmm.. I just tried that with clang-4.0 - and it still failed. Both for my project and for drake_cmake_installed.
That seems to point towards a problem with my particular installation.

@stonier are you building from the precompiled binaries?

For this, I was testing with bazel run install method, so I could switch it from gcc to clang as you have done.

I did verify that the gcc method (both bazel and precompiled) fails due to (I believe) my project also including Eigen. As soon as drake calls a function which uses Eigen, it seg faults.
I'm testing bazel-clang on a fresh ubuntu install now.

Are you making sure you find_package(Drake CONFIG REQUIRED) before anything else (if your project or another down the line is doing find_package(EIGEN ...) before Drake it will find the system Eigen which is incompatible with Drake's Eigen, but the other way around is fine.
Some notes on this in the PCL example README.

I was able to reproduce the libprotobuf error on a fresh, completely clean ubuntu 16.04 install trying to do drake-clang and drake_cmake_installed-clang
# drake
bazel build --compiler=clang-4.0 --config snopt //...
mkdir build
bazel run --compiler=clang-4.0 --config snopt //:install -- $PWD/build

# drake_cmake_installed
mkdir build; cd build
cmake -Ddrake_DIR="$HOME/drake/build/lib/cmake/drake" -DCMAKE_CXX_COMPILER="/usr/bin/clang++-4.0"  ..
make -j

~/sham/drake_cmake_installed/build/src/particles$ ./uniformly_accelerated_particle_demo
[libprotobuf ERROR external/com_google_protobuf/src/google/protobuf/descriptor_database.cc:58] File already exists in database: google/protobuf/any.proto
[libprotobuf FATAL external/com_google_protobuf/src/google/protobuf/descriptor.cc:1394] CHECK failed: generated_database_->Add(encoded_file_descriptor, size):
terminate called after throwing an instance of 'google::protobuf::FatalException'
  what():  CHECK failed: generated_database_->Add(encoded_file_descriptor, size):
Aborted (core dumped)

maybe note-worth - the CXX flag only specifies the CXX complier, while the C complier is still GNU
The C compiler identification is GNU 5.4.0
-- The CXX compiler identification is Clang 4.0.0
-- Check for working C compiler: /usr/bin/cc
-- Check for working C compiler: /usr/bin/cc -- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Detecting C compile features
-- Detecting C compile features - done
-- Check for working CXX compiler: /usr/bin/clang++-4.0
-- Check for working CXX compiler: /usr/bin/clang++-4.0 -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Could NOT find GTest (missing:  GTEST_LIBRARY GTEST_INCLUDE_DIR GTEST_MAIN_LIBRARY)
-- Could NOT find GTest (missing:  GTEST_LIBRARY GTEST_INCLUDE_DIR GTEST_MAIN_LIBRARY)
-- Configuring done
-- Generating done

Testing the above instructions, but for Bionic with clang-6.0 (specified for both CC and CXX), and using environment variables since we've stopped using CROSSTOOL in Drake.
$ bash-isolate  # See https://bit.ly/2FtluQs
$ export CC=clang-6.0 CXX=clang++-6.0 SNOPT_PATH=git

$ cd drake
$ git rev-parse --short HEAD
a57d3198a
$ drake_dir=${PWD}/build/py2
$  bazel run --config=snopt //:install -- ${drake_dir}

$ cd .../drake-external-examples/drake_cmake_installed
$ git rev-parse --short HEAD
43ff258
$ mkdir build && cd build
$ cmake -DCMAKE_PREFIX_PATH=${drake_dir} ..
$ make -j
$ ctest -V -R
# No failures

Since this succeeds, I'm closing the issue for now.
However, @dmsj, if you still have this as an active pain point, I can re-open the issue.
(Also, are you still on Xenail, or have y'all migrated to Bionic?)


RAG Agent in agentchat

What feature would you like to be added?
A good high-performing rag agent
Why is this needed?
it doesn't exist cc: @rickyloynd-microsoft

+1 here.
@gagb , any change this is related to #4039 #4438

We can utilize the memory module that will be added to an assistant agent.

Also related to #4612

Not long ago I started this draft migration of what we had in 0.2 with @thinkall  https://github.com/microsoft/autogen/pull/3879
I think it would be useful to think about a storage abstraction that we can share between memory and information retrieval.

Going forward, when a new abstraction is needed, let's review what SK has in terms of abstractions before creating our own.

What happened to the teachability capability from 0.2, it looks like it completely disappeared, can we bring it back?

@r-bit-rry  we will add it back through a new memory abstraction. See work in #4438;
See the migration guide (in progress) for other missing features: #4765


Accessibility issue in the standalone Foundry VTT application

I hope I am not being rude by posting this here. I asked around in the Official Foundry Discord, and they heartily encouraged me to try posting it here, and assured me that it would not be rude of me to do so. Here goes:
I'm having a problem that is preventing me from switching my campaign over to Foundry :-/
The thing is, I'm disabled, in such a way that I cannot use a regular mouse. Instead, I use a Logitech T650 touchpad, which rests on a thin plank of wood in my lap. And, on roll20, I use two fingers to pan up/down and left/right, as well as to zoom whenever I hold down a keyboard button and move the two fingers up/down. This gives an extremely smooth panning and zooming experience in roll20, but I have been unable to get that functionality to work in Foundry.
I tried using your Zoom/Pan Options module to see if that would fix the issue, but no luck. Here are the issues that I found:

The vertical scrolling works to pan up/down, but it is very "choppy". That is to say, it jumps many pixels at a time, rather than being "smooth". This happened even when I toned the sensitivity down so low that I would never have been able to use Foundry that way. And, even with the sensitivity toned down that low, the jumpiness of the scrolling gave me nausia.

The horizontal scrolling to pan left/right has an odd behavior going on right now. Whenever I test it, I can do a single scroll, either left or right, and then after that, it is completely stuck, that is to say it is unable to scroll in either direction. But if I do a single scroll up or down, then that seems to "reset" this bug. That is to say, after doing a single scroll up or down, then I am once again able to do one (and only one) scroll in either the left or the right direction.

The horizontal scrolling seems to move about 50 times faster than the vertical scrolling. I tested this at multiple sensitivity settings, and that seemed to be the ratio each time. And also, it was "choppy" in the same way that the vertical scrolling was.

Thanks for reading this. I hope it wasn't rude, and I hope that I'll one day be able to move my campaign over to Foundry VTT :-)

hi Ronnie!  I'm glad to hear your feedback, it's definitely not rude and you're more than welcome to contact me here or through discord (I'm shem#0226).
I have some basic questions:

you say "Standalone Foundry VTT application".  have you tried using the touchpad through browsers?  Chrome and Firefox both behave a bit differently with this mod (that's why I added the sensitivity setting), so it's possible that the standalone app has yet another different behavior.
I haven't been able to reproduce the bug you're describing, though I have different equipment:  I have a keyboard+mouse computer running with Chrome (works, and also works with the standalone app), and a MacBook Pro where I use the touchpad  (seems to work well enough, too).  So, I'm guessing the bug is related either to the standalone app or to your specific Logitech T650 touchpad.

If trying in a browser doesn't help you - could you send me a direct message on Discord?  I could try changing some code for you to see if your touchpad behaves differently and to see how I can work around it.

Closing this issue, please reopen if there is no information.


I see the 0 size log factory is still working full time

I see 0 size log factory still working full steam ahahahah, what a joke.
Maybe before adding new functions would have been better fixing what is already there.

Before criticize, please make a correct report on how this happens.
You are using an open source projects, if you want something done, you probably need to help instead of complaining and mocking people that invest time to share a project with other for free.
And if you were really into looking for a fix for this issue, you would have read that we are discussing and trying some solutions...

Ma vai a fare in culo faccia di merda.

Interesting how you're not using it, yet you have time to waste everyone's else time.
And just because you write in Italian, it doesn't mean you can use this kind of words here.


Add typed_data flavors of drawAtlas and drawVertices

Currently, these methods take things like lists of offsets, colors, or integers. However, these values aren't used as is; they are converted to Float32Lists etc before they are handed to Skia.
Recreating those lists and refilling them with each call adds some overhead which you might want to avoid in some scenarios like games.
#10087 is same thing for drawPoints.

Thanks for the suggestion!


Remove or make DoCM step optional.

Regardless of how we approach generating a DoCM list, we need a version of the tumor-only workflow and paired workflow (aka detect_variants) that runs without DoCM. Since optional steps are not supported in CWL, we either use a wrapper that returns true if no DoCM input is provided or we make a new CWL that simply does not include the DoCM step/inputs.

DoCM now runs in all somatic workflows, but by default, docm-only variants are marked as failing filters, so appear in the VCF, but not the final tabular output


Rendered out of order

I'm experiencing an issue where nodes are rendered out of order with Qwik.  This only occurs when using cypress, not during normal use.  It occurs when using Firefox, Electron and cli (which I'm guessing is headless electron).
The three child elements are rendered in the correct order in the DOM however, the console log shows that the first element is always rendered last, even when you add more.  I took a quick look at the cypress-ct-qwik code and it's pretty simple.  I'm not sure what could be going on here, but in my actual component I have order relevant state that becomes untestable because things are no longer in the right order.
import { component$ } from<EMAIL_ADDRESS>
const Child = component$((props: { order: string }) => {
  console.log(props.order);
  return
;
});

describe('Sample', () => {
  it('should exist', () => {
    cy.mount(

        <Child order="1">1</Child>
        <Child order="2">2</Child>
        <Child order="3">3</Child>

    );
    cy.get('.test').should('exist');
  });
});

Thanks for the report @ulic75
yeah this sounds weird indeed
Basically the difference is in the render function (render vs renderToStream)
I'll have time to debug it only after next week
In the meantime if you can help me pin point the issue that'll be awesome
We need to figure out if the problem is with SSR vs non SSR
So I would try 2 things -

Try to load your app in "dev mode" and see if that matters or not

Put a debugger in the console log and try to locate the source of creation and what's different between running it in Qwik server vs in Cypress

Will you have time to help me with this?
Thanks 🙏

I'm not sure what you mean by "dev mode".  If you mean pnpm dev just running the Qwik app that way then no the problem does not exist when running the app that way or in preview or in build/serve.  I'm going to be out of the office most of today, but I'll try to do some more digging.

@ulic75 thanks
I mean running it without --ssr flag (I think pnpm dev still adds it)

So the dev script runs vite --mode ssr.  So I manually just ran pnpm vite and indeed I do see it print 2, 3, 1 instead of 1, 2, 3.  So I guess this is a qwik issue.  Let me know if you have other thoughts.

Thanks @ulic75 !
Yeah looks like a Qwik issue
Can you pleases file an issue about it in the Qwik repo?


build: Enable pyright to check if type hints are missing

This change adds a pyright check to ensure that we add type hints to our code.

Needs #316


BMI1 functions

https://www.intel.com/content/www/us/en/docs/intrinsics-guide/index.html#othertechs=BMI1
https://en.wikipedia.org/wiki/X86_Bit_manipulation_instruction_set#BMI1_(Bit_Manipulation_Instruction_Set_1)
implementation status for TZCNT: https://github.com/simd-everywhere/implementation-status/blob/main/x86.md#bmi1

TZCNT is a nightmare to get the best code-gen on any given platform. The rest of TBM and BMI1 are simple boilerplate.
However, they don't really have anything to do with SIMD...
Does SIMDe want to provide coverage for all Intel Intrinsics?
There are many others _BitScanForward, _subborrow_u32, etc?


Increase reconnect delay

Hello guys!
I am working on a project which handles a long-running process of retrieving tweets using the river (let's say long-running = 1 year). Sometimes, the stream is failing / closing and restarting. This is quite annoying BUT the reconnect stuff is working like a charm! :+1:
However, the delay to reconnect to the Stream API after a failure is too quick, after what it keeps getting 420 errors.
StackTrace (for a 2seconds window)
[2015-01-27 00:23:53,085][WARN ][river.twitter            ] There was failures while executing bulk
[2015-01-27 00:24:13,084][WARN ][river.twitter            ] There was failures while executing bulk
[2015-01-27 00:24:43,085][WARN ][river.twitter            ] There was failures while executing bulk
[2015-01-27 00:26:13,085][WARN ][river.twitter            ] There was failures while executing bulk
[2015-01-27 00:28:06,532][INFO ][twitter4j.TwitterStreamImpl] Stream closed.
[2015-01-27 00:28:06,532][WARN ][river.twitter            ] [Taj Nital] [twitter][twitter-river] stream failure, restarting stream...
Stream closed.
Relevant discussions can be found on the Internet at:
        http://www.google.co.jp/search?q=a8fd061d or
        http://www.google.co.jp/search?q=00076b7e
TwitterException{exceptionCode=[a8fd061d-00076b7e a8fd061d-00076b0b], statusCode=-1, message=null, code=-1, retryAfter=-1, rateLimitStatus=null, version=4.0.2}
        at twitter4j.StatusStreamBase.handleNextElement(StatusStreamBase.java:190)
        at twitter4j.StatusStreamImpl.next(StatusStreamImpl.java:56)
        at twitter4j.TwitterStreamImpl$TwitterStreamConsumer.run(TwitterStreamImpl.java:504)
Caused by: java.net.SocketTimeoutException: Read timed out
        at java.net.SocketInputStream.socketRead0(Native Method)
        at java.net.SocketInputStream.read(SocketInputStream.java:152)
        at java.net.SocketInputStream.read(SocketInputStream.java:122)
        at sun.security.ssl.InputRecord.readFully(InputRecord.java:442)
        at sun.security.ssl.InputRecord.read(InputRecord.java:480)
        at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:927)
        at sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:884)
        at sun.security.ssl.AppInputStream.read(AppInputStream.java:102)
        at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
        at java.io.BufferedInputStream.read1(BufferedInputStream.java:275)
        at java.io.BufferedInputStream.read(BufferedInputStream.java:334)
        at sun.net.www.http.ChunkedInputStream.readAheadBlocking(ChunkedInputStream.java:552)
        at sun.net.www.http.ChunkedInputStream.readAhead(ChunkedInputStream.java:609)
        at sun.net.www.http.ChunkedInputStream.read(ChunkedInputStream.java:696)
        at java.io.FilterInputStream.read(FilterInputStream.java:133)
        at sun.net.www.protocol.http.HttpURLConnection$HttpInputStream.read(HttpURLConnection.java:3053)
        at java.util.zip.InflaterInputStream.fill(InflaterInputStream.java:238)
        at java.util.zip.InflaterInputStream.read(InflaterInputStream.java:158)
        at java.util.zip.GZIPInputStream.read(GZIPInputStream.java:116)
        at sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:283)
        at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:325)
        at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:177)
        at java.io.InputStreamReader.read(InputStreamReader.java:184)
        at java.io.BufferedReader.fill(BufferedReader.java:154)
        at java.io.BufferedReader.readLine(BufferedReader.java:317)
        at java.io.BufferedReader.readLine(BufferedReader.java:382)
        at twitter4j.StatusStreamBase.handleNextElement(StatusStreamBase.java:75)
        ... 2 more
[2015-01-27 00:28:06,533][INFO ][twitter4j.TwitterStreamImpl] Stream closed.
[2015-01-27 00:28:06,533][WARN ][river.twitter            ] [Taj Nital] [twitter][twitter-river] stream failure, restarting stream...
[2015-01-27 00:28:06,534][INFO ][twitter4j.TwitterStreamImpl] Waiting for 250 milliseconds
[2015-01-27 00:28:06,784][INFO ][twitter4j.TwitterStreamImpl] Establishing connection.
[2015-01-27 00:28:06,869][INFO ][twitter4j.TwitterStreamImpl] Stream closed.
[2015-01-27 00:28:06,869][WARN ][river.twitter            ] [Taj Nital] [twitter][twitter-river] stream failure, restarting stream...
Stream closed.
Relevant discussions can be found on the Internet at:
        http://www.google.co.jp/search?q=a8fd061d or
        http://www.google.co.jp/search?q=00076b7e
TwitterException{exceptionCode=[a8fd061d-00076b7e a8fd061d-00076b0b], statusCode=-1, message=null, code=-1, retryAfter=-1, rateLimitStatus=null, version=4.0.2}
        at twitter4j.StatusStreamBase.handleNextElement(StatusStreamBase.java:190)
        at twitter4j.StatusStreamImpl.next(StatusStreamImpl.java:56)
        at twitter4j.TwitterStreamImpl$TwitterStreamConsumer.run(TwitterStreamImpl.java:504)
Caused by: java.net.SocketTimeoutException: Read timed out
        at java.net.SocketInputStream.socketRead0(Native Method)
        at java.net.SocketInputStream.read(SocketInputStream.java:152)
        at java.net.SocketInputStream.read(SocketInputStream.java:122)
        at sun.security.ssl.InputRecord.readFully(InputRecord.java:442)
        at sun.security.ssl.InputRecord.read(InputRecord.java:480)
        at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:927)
        at sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:884)
        at sun.security.ssl.AppInputStream.read(AppInputStream.java:102)
        at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
        at java.io.BufferedInputStream.read1(BufferedInputStream.java:275)
        at java.io.BufferedInputStream.read(BufferedInputStream.java:334)
        at sun.net.www.http.ChunkedInputStream.readAheadBlocking(ChunkedInputStream.java:552)
        at sun.net.www.http.ChunkedInputStream.readAhead(ChunkedInputStream.java:609)
        at sun.net.www.http.ChunkedInputStream.read(ChunkedInputStream.java:696)
        at java.io.FilterInputStream.read(FilterInputStream.java:133)
        at sun.net.www.protocol.http.HttpURLConnection$HttpInputStream.read(HttpURLConnection.java:3053)
        at java.util.zip.InflaterInputStream.fill(InflaterInputStream.java:238)
        at java.util.zip.InflaterInputStream.read(InflaterInputStream.java:158)
        at java.util.zip.GZIPInputStream.read(GZIPInputStream.java:116)
        at sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:283)
        at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:325)
        at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:177)
        at java.io.InputStreamReader.read(InputStreamReader.java:184)
        at java.io.BufferedReader.fill(BufferedReader.java:154)
        at java.io.BufferedReader.readLine(BufferedReader.java:317)
        at java.io.BufferedReader.readLine(BufferedReader.java:382)
        at twitter4j.StatusStreamBase.handleNextElement(StatusStreamBase.java:75)
        ... 2 more
[2015-01-27 00:28:06,870][INFO ][twitter4j.TwitterStreamImpl] Stream closed.
[2015-01-27 00:28:06,870][WARN ][river.twitter            ] [Taj Nital] [twitter][twitter-river] stream failure, restarting stream...
[2015-01-27 00:28:06,870][INFO ][twitter4j.TwitterStreamImpl] Stream closed.
[2015-01-27 00:28:06,870][WARN ][river.twitter            ] [Taj Nital] [twitter][twitter-river] stream failure, restarting stream...
Stream closed.
Relevant discussions can be found on the Internet at:
        http://www.google.co.jp/search?q=a8fd061d or
        http://www.google.co.jp/search?q=00076b7e
TwitterException{exceptionCode=[a8fd061d-00076b7e a8fd061d-00076b0b], statusCode=-1, message=null, code=-1, retryAfter=-1, rateLimitStatus=null, version=4.0.2}
        at twitter4j.StatusStreamBase.handleNextElement(StatusStreamBase.java:190)
        at twitter4j.StatusStreamImpl.next(StatusStreamImpl.java:56)
        at twitter4j.TwitterStreamImpl$TwitterStreamConsumer.run(TwitterStreamImpl.java:504)
Caused by: java.net.SocketTimeoutException: Read timed out
        at java.net.SocketInputStream.socketRead0(Native Method)
        at java.net.SocketInputStream.read(SocketInputStream.java:152)
        at java.net.SocketInputStream.read(SocketInputStream.java:122)
        at sun.security.ssl.InputRecord.readFully(InputRecord.java:442)
        at sun.security.ssl.InputRecord.read(InputRecord.java:480)
        at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:927)
        at sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:884)
        at sun.security.ssl.AppInputStream.read(AppInputStream.java:102)
        at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
        at java.io.BufferedInputStream.read1(BufferedInputStream.java:275)
        at java.io.BufferedInputStream.read(BufferedInputStream.java:334)
        at sun.net.www.http.ChunkedInputStream.readAheadBlocking(ChunkedInputStream.java:552)
        at sun.net.www.http.ChunkedInputStream.readAhead(ChunkedInputStream.java:609)
        at sun.net.www.http.ChunkedInputStream.read(ChunkedInputStream.java:696)
        at java.io.FilterInputStream.read(FilterInputStream.java:133)
        at sun.net.www.protocol.http.HttpURLConnection$HttpInputStream.read(HttpURLConnection.java:3053)
        at java.util.zip.InflaterInputStream.fill(InflaterInputStream.java:238)
        at java.util.zip.InflaterInputStream.read(InflaterInputStream.java:158)
        at java.util.zip.GZIPInputStream.read(GZIPInputStream.java:116)
        at sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:283)
        at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:325)
        at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:177)
        at java.io.InputStreamReader.read(InputStreamReader.java:184)
        at java.io.BufferedReader.fill(BufferedReader.java:154)
        at java.io.BufferedReader.readLine(BufferedReader.java:317)
        at java.io.BufferedReader.readLine(BufferedReader.java:382)
        at twitter4j.StatusStreamBase.handleNextElement(StatusStreamBase.java:75)
        ... 2 more
[2015-01-27 00:28:06,870][INFO ][twitter4j.TwitterStreamImpl] Waiting for 250 milliseconds
[2015-01-27 00:28:07,120][INFO ][twitter4j.TwitterStreamImpl] Establishing connection.
[2015-01-27 00:28:07,476][INFO ][twitter4j.TwitterStreamImpl] 420:Returned by the Search and Trends API when you are being rate limited (https://dev.twitter.com/docs/rate-limiting).
Returned by the Streaming API:
 Too many login attempts in a short period of time.
 Running too many copies of the same application authenticating with the same account name.
Exceeded connection limit for user

Idea: Increasing delay to reconnect
@dadoonet Do you think it would be possible to increase the time after which it reconnects?
or at least allowing to configure it?
I'm always forced to stop ES (I can't remove the river because it is dynamically updated so I would be forced to get it, and reput it after some time) for 20-30s, and then restart it.
As I'm quite a beginner to ES and rivers in general, you may have better tips! ;)
Thank your for your time!

Good timing for this post.  I've been seeing this too lately, and the fix for me is to delete the river, wait a couple of minutes, then recreate it.
But yes, if we could set a reconnect delay when rate exceeded "error 420" is seen, it might help here.

Very interesting indeed. Do you know that Logstash actually supports it already?
Look at this line: https://github.com/logstash-plugins/logstash-input-twitter/blob/master/lib/logstash/inputs/twitter.rb#L115

@dadoonet I do now! :) I'll take a look at it later, thank you !
do you think it would be possible to add something like this, just for the help it brings for now? :)

Hi @dadoonet, the problem with Logstash at the moment is it doesn't support proxy servers so we can't get to Twitter from within our  company.  I raised this as a bug on the logstash channel, but there's been no progress on that for a while so for the moment, it's a no-go.

@schmorgs Fair point. I opened an issue here: https://github.com/logstash-plugins/logstash-input-twitter/issues/7

@dadoonet For now, is it about changing the value of TimeValue.timeValueSeconds(10): https://github.com/elasticsearch/elasticsearch-river-twitter/blob/master/src/main/java/org/elasticsearch/river/twitter/TwitterRiver.java#L548
for a value defined in the conf?

@Ninir I agree. It's not a big change and can be seen as a bug fix somehow useful in the meantime. retry_after could be the name?
Wanna come with a PR?

Closed with #92.


Error with libssl

Hi,
I just installed magic-cli 0.0.2 using the curl in zsh but I get this error as soon as I try to run the executable:
magic-cli: error while loading shared libraries: libssl.so.1.1: cannot open shared object file: No such file or directory
Any recommendation?

Same here under Linux Mint 21.3 ~ Ubuntu 22.04

I also have this issue on Ubuntu 22.04
Additionally I cloned the repo and built with cargo, which generates an error about ld
note: /usr/bin/ld: cannot find -lxcb: No such file or directory
          /usr/bin/ld: cannot find -lxcb-render: No such file or directory
          /usr/bin/ld: cannot find -lxcb-shape: No such file or directory
          /usr/bin/ld: cannot find -lxcb-xfixes: No such file or directory
          collect2: error: ld returned 1 exit status

dev branch builds fine if the following dependencies are added to environment: libxcb1-dev libxcb-render0-dev libxcb-shape0-dev libxcb-xfixes0-dev

I also have this issue on Ubuntu 22.04
Additionally I cloned the repo and built with cargo, which generates an error about ld
note: /usr/bin/ld: cannot find -lxcb: No such file or directory
          /usr/bin/ld: cannot find -lxcb-render: No such file or directory
          /usr/bin/ld: cannot find -lxcb-shape: No such file or directory
          /usr/bin/ld: cannot find -lxcb-xfixes: No such file or directory
          collect2: error: ld returned 1 exit status

dev branch builds fine if the following dependencies are added to environment: libxcb1-dev libxcb-render0-dev libxcb-shape0-dev libxcb-xfixes0-dev

Thank you, i was able to build the main branche thanks to you

Thanks folks. I install that dep in the CI as well.
But I will reopen as I do want to avoid folks building from source if they can help it, perhaps bundling rustls with the app in case of an issue dynamically linking with openssl.


wip

Stack:

#1583 ⬅
#1553
#1536

⚠ Part of a stack created by spr. Do not merge manually using the UI - doing so may have unexpected results.

This change is


Added check on HTML tages for XSS activity.

Issue Reference
Added check on HTML tages for XSS activity.

Chekced and found all XSS activities are fixed and now it is working fine. Please check the videos for reference. These videos are taken from different section of Bagisto Admin Panel.
Videos
https://github.com/bagisto/bagisto/assets/92721837/b23bb283-5966-42c0-a411-986f4effa54b
https://github.com/bagisto/bagisto/assets/92721837/911bebf1-4432-47e0-9690-a4b97ccfd796
https://github.com/bagisto/bagisto/assets/92721837/6480e378-6e5c-4699-b19d-8055f5501e43
https://github.com/bagisto/bagisto/assets/92721837/19b92727-c3c6-4f26-801d-bf93ce456061
https://github.com/bagisto/bagisto/assets/92721837/f398979b-a6e2-44ec-9a96-1a1c4b61edc1
https://github.com/bagisto/bagisto/assets/92721837/d5864969-2a95-4338-b1b3-8bef586c25a8
https://github.com/bagisto/bagisto/assets/92721837/08725f60-db68-4924-bd29-6ef567ef1a0c
https://github.com/bagisto/bagisto/assets/92721837/30a6eeac-6777-4ffa-90ba-620dc812f790


RTL is worse after #4747

Before:

After:

See utf82.txt within https://github.com/microsoft/terminal/issues/4375.
This is probably just not accounting for RTL stuff when dividing glyphs for scaling.
Also, I'm not sure that any of the RTL was correct before 4747, but it was at least displaying something. Now it's blank spaces.
We don't really state we support RTL at all yet (#538)...

We'll need to figure out RTL, but not for v1. Backlogged.

 Okay, yes, it got much worse on the font fallback, but that was still useful -- I could mentally read the words in the wrong order for a brief peek into a file.


Allow specifying the groups that are allowed/blocked from using the VPN

Hi,
It would be great if we can specify which users are allowed/blocked from using the VPN at all on the level of IdP. I think that having a configuration to specify which group(s) is allowed to login to the VPN Is going to be the best solution for this. In this case, every user that is part of any of these allowed group(s) will be able to login.
For example, we sync groups called VPN Users and Administrators from the IdP, and all users that are part of these two groups should be able to use the VPN, then it comes to the access control judgment to see what this logged in user is allowed to access.
A bit more detailed example, we add the following combo box / radio box:

Allow by default and block the members of the following groups.
Block by default and allow the members of the following groups.
and beneath we have a text box to specify which groups will allowed/blocked depending of the radio box.

Of course, the user can be part of other groups, which may potentially change the behavior depending of access control rules, in case the user was able to use the VPN at all according to the VPN Allow/Block rules.

Suggestion: rename this ticket to "Allow mapping additional OIDC claims to netbird groups".
IMHO everything else that's needed to accomplish the OP's goals already exists in policies and is in use by direct user invitation flow (default groups).
I also need this mechanism in order to apply group-based policies new users.
Looking at the code, this one is IMHO unlikely to be implemented any time soon, so my plan is to not wait for this feature and instead assign groups to users using some external mechanism. I'm guessing I'll need to constantly poll the API events endpoint to figure out whether a new user was created. Or maybe my idP (Azure AD) can trigger some event notification; I'll need to figure it out.

Hi, @horzadome
it a good point, but let us say this issue the entrypoint to start mapping between claims and other functionalities in this software.
Do you have any suggestion or workaround for my use-case to block or enable specific users to use the VPN when they have a specific group in their group claim?

Hey, @mlsmaycon @braginini!
I am just wondering if there are any plans to implement this soon or to prioritize it. Any official statement would be helpful for me to be able to prioritize my work. Thank you.


Update to allow using with cocoapods and modern Cedar versions

There's a bunch of useful commits on this branch which adds a .podspec as well as replaces typeof with __typeof__ which seems to be more readily available on modern project setups.

:+1:


In preparation for Node.js 0.12, upgrade to 0.9.0, fix header param inconsistency, and cherry-pick WSDL Import fix

@jxayala, @y-tang - Code review, please
Use the following to see all of our changes compared to upstream:
https://github.com/vpulim/node-soap/compare/master...shelbys:node_0_12
In particular, see:

package.json
lib/client.js
lib/http.js
lib/soap.js
lib/wsdl.js
test/wsdl-test.js

:+1:


Table with pagination not apply default icon pack (fa)

Overview of the problem
Buefy version: [^0.6.2]
Vuejs version: [2.5.13]
Description
I configure buefy with defaultIconPack 'fa',
Vue.use(Buefy, {
    defaultIconPack:'fa',
    defaultFirstDayOfWeek:1
});

Try to use Table component with sorting and pagination feature
Pagination buttons for next and previous page rendered with mdi icons
In other places font-awesome applied successful

@Insolita Are you sure to import FontAwesome ?
For example: https://jsfiddle.net/du2oxe1r/46/

Hello.
I just want to use the Pagination component and so, I just import this only component.
How should I define the use of font-awesome?
I import the component like docs indicated:
window.Vue.component(Buefy.Pagination.name, Buefy.Pagination);

@jtommy sorry to bother you. I hope you can help me.
I just want to use the Pagination component and so, I just import this only component.
How should I define the use of font-awesome?
I import the component like docs indicated:
window.Vue.component(Buefy.Pagination.name, Buefy.Pagination);


Insertion of element at nth position in linkedlist

hello, I'm a GSSOC'21 participant,
I saw that there is no code for inserting an element at nth given position in linkedlist in the folder 'NeoAlgo/C/'
so, I want to add this code to 'NeoAlgo/C'

/assign


Support external redis host and using <IP_ADDRESS> as default

I want to use my external redis because after many hours of streaming and recording oryx stops working. There are many keys written that get cleaned only after you delete the recording task.
I would like to be able to use my custom redis to support more intensive recordings

我想这个需求是合理的，感谢你提交这个PullRequest。
同时，我想和你讨论一个问题：如果使用外部的Redis Server，我们是否应该支持databases，这样可以多个Oryx使用同样的一个redis，通过参数DB隔离数据：
redis.NewClient(&redis.Options{Addr, Password, DB: 0})

如果你觉得合理，那么请增加一个环境变量 REDIS_DATABASE，默认为0。

Ok I think we can do this. Let me make the changes

I've also attempted to run this docker with my modifications, but I noticed even if I have my own redis setup, oryx will attempt to create it's own redis server. How should we face this issue? Do you have any ideas?

I've also attempted to run this docker with my modifications, but I noticed even if I have my own redis setup, oryx will attempt to create it's own redis server. How should we face this issue? Do you have any ideas?

Same problem

@winlinvip let me know if we need to do more changes.
The issue I have been having is that if I record multiple streams for more than 10 hours with a docker with 4GB of ram, Oryx will start writing ts files in the wrong positions in the filesystem, so I'm guessing that redis gets filled up and oryx can't keep track of what he is supposed to do. Oryx will also stop working and won't come back up. If you have any thoughts on how to solve this it would be great. I'm hoping that outsourcing redis from the docker will fix this issue.

这个问题和这个PR不相关，请单独提交一个Issue详细说明它。

I've also attempted to run this docker with my modifications, but I noticed even if I have my own redis setup, oryx will attempt to create it's own redis server. How should we face this issue? Do you have any ideas?

这个环境变量只是决定了Oryx连接哪个Redis server，但Oryx永远会创建一个自己的redis server，这个应该不影响最终的效果，它占用的资源也非常少，只是不使用而已。

@winlinvip let me know if we need to do more changes.
The issue I have been having is that if I record multiple streams for more than 10 hours with a docker with 4GB of ram, Oryx will start writing ts files in the wrong positions in the filesystem, so I'm guessing that redis gets filled up and oryx can't keep track of what he is supposed to do. Oryx will also stop working and won't come back up. If you have any thoughts on how to solve this it would be great. I'm hoping that outsourcing redis from the docker will fix this issue.

This issue is not related to this pull request. Please submit a separate issue with detailed information about it.
TRANS_BY_GPT4

I have created a seperate issue with screenshots detailing the issue. Thanks @winlinvip
https://github.com/ossrs/oryx/issues/197


Merge + Delete OLTP-Bench Fork

I don't want us to maintain a special fork of OLTP-Bench just for Peloton. I will make Peloton a supported DBMS in the framework, merge any changes that we have (manually), and then delete the CMU-DB fork.

This is finished. I have merged all of the fixes and logic that we had for Peloton in this branch to the main branch. I deleted the forked repository. There is a back-up available here in case we need to look at it again:
http://pelotondb.org/files/old/oltpbench-peloton.tar.gz


Allow shortening the command line using a pathing JAR

See #10114
Context

Gradle Core Team Checklist

[ ] Verify design and implementation
[ ] Verify test coverage and CI build status
[ ] Verify documentation
[ ] Recognize contributor in release notes

Any chance this addresses #5754 as well?

We scoped this "path shortening" to Windows only. We can look at making it work on Linux/macOS. The reason was Linux and macOS has huge limits for the command lines. If you think otherwise, we can see about scoping this issue to include other OS.

@big-guy I pushed some changes.

We scoped this "path shortening" to Windows only. We can look at making it work on Linux/macOS. The reason was Linux and macOS has huge limits for the command lines. If you think otherwise, we can see about scoping this issue to include other OS.

Would be appreciated if you could port this to other Linux/macOS as well, #5754 is a problem for us and I think we are not alone.

@simonschiller Out of curiosity and to help us with porting this, what's the length of your classpath? Also in what context are you hitting the Linux/macOS limits? I mean, how many projects, dependencies, etc. your Gradle build has and the average per projects?

We started hitting this limitation when compiling Kotlin code in the context of an Android project. The Kotlin compile task fails with an exception that states that the argument length is exceeded. Downgrading to Kotlin 1.3.41 from 1.3.50 fixed this issue, so there might have been a change within Kotlin. I don't have a computer near me at the moment, I can provide more details later if needed.
We are building 1 project with ~120 direct dependencies. We only encountered the issue on CI, which is a Linux machine, on the development machines (macOS, Linux, even Windows) everything seems fine. Strangely, ARG_MAX on the CI machine is much higher than on my local machine.
How can I check the classpath of a certain task/command?

@simonschiller
We also encountered this problem on Linux machine with Kotlin 1.3.50.
You can try to check the length of your command line by running Gradle in debug mode and attaching a debugger to it:
./gradlew :app:assembleDebug --no-daemon --stacktrace -Dorg.gradle.debug=true

Then for example with jdb you can:
jdb -attach 5005

Add a breakpoint to the method which fails with exception:
stop in org.jetbrains.kotlin.daemon.client.NativePlatformUtilKt.launchProcessWithFallback

For me, it was here https://github.com/JetBrains/kotlin/blob/master/compiler/daemon/daemon-client/src/org/jetbrains/kotlin/daemon/client/NativePlatformUtil.kt#L40
And then print the variable:
print processBuilder.command()

I've checked the argument list for javac process and the total length of the arguments is ~450k characters. The first 35k characters look normal but the rest is -Xcommon-sources= argument which contains a list of ~2500 kt files specified using absolute path. Probably, we should create a ticket for the Kotlin plugin.

Any updates here re: linux support? Similar to the above recent reports, my projects are seeing occasional classpaths that require shortening.


PR: Merge master into split-plugins

This merge is to maintain split-plugins up to date, and make the final merge easy

@dalthviz, please help @rlaverde to finish this PR because it's failing with one of your tests.

Great work @dalthviz!! Please squash your last three commits and leave simply one. Then I'll merge :-)


4.0版本的开发是被你们放弃了吗

几年前你们就说在开发4.0，4.0版本的开发是被你们放弃了吗

all v4 major features are already completed, they've been in the master branch for quite a while and everything seems to be stable. Some of the planned API breaking changes are also in the master, there are expected to be more API changes.


esfit: multiple sim functions for multi-component fit

It might be useful to allow the possibility to supply as many different simulation functions as there are components:
esfit({'pepper','salt'},{Sys1,Sys2},...)

This can be solved with a custom model function.


Docusaurus website missing import

Have you read the Contributing Guidelines on issues?

[X] I have read the Contributing Guidelines on issues.

Prerequisites

[X] I'm using the latest version of Docusaurus.
[X] I have tried the npm run clear or yarn clear command.
[X] I have tried rm -rf node_modules yarn.lock package-lock.json and re-installing packages.
[ ] I have tried creating a repro with https://new.docusaurus.io.
[X] I have read the console error message carefully (if applicable).

Description
When running yarn build on the Docusaurus website, Component APITable was not imported, exported, or provided by MDXProvider as global scope is printed twice to the console. The import for APITable is missing in both versions of the no-untranslated-text.md files.
Reproducible demo
No response
Steps to reproduce

Run yarn build in the docusaurus repository

Expected behavior
I did not expect Component APITable was not imported, exported, or provided by MDXProvider as global scope to be printed.
Actual behavior
Component APITable was not imported, exported, or provided by MDXProvider as global scope is printed to the console twice.
Your environment

Public source code: https://github.com/facebook/docusaurus
Public site URL: https://docusaurus.io/
Docusaurus version used: version in the GitHub repository as of this commit
Environment name and version (e.g. Chrome 89, Node.js 16.4): Node.js 16.15
Operating system and version (e.g. Ubuntu 20.04.2 LTS): Ubuntu 20.04 LTS

Self-service

[X] I'd be willing to fix this bug myself.

Thanks, the errors are in versioned_docs, the two api/misc/eslint-plugin/no-untranslated-text.md files. If you want to fix that by adding the missing imports it would be great. I didn't fix it because it would automatically be fixed after bumping another two versions, and we seldom edit versioned files unless absolutely needed.


error: Project  does not have a lock file

I am new to the .NET core and working on the TodoApi tutorial but in the middle i found the error that "project TodoApi does not have a lock file". Anyone help me to resolve this.

run dotnet restore on your project.

In my case that makes no difference whatsoever
C:\Users\Bruce\Desktop>md test

C:\Users\Bruce\Desktop>cd test

C:\Users\Bruce\Desktop\test>dotnet new
Created new C# project in C:\Users\Bruce\Desktop\test.

C:\Users\Bruce\Desktop\test>dir
 Volume in drive C is TI10665200H
 Volume Serial Number is 384F-4E8A

 Directory of C:\Users\Bruce\Desktop\test

25/06/2016  11:27 PM    <DIR>          .
25/06/2016  11:27 PM    <DIR>          ..
25/06/2016  11:27 PM               214 Program.cs
25/06/2016  11:27 PM               302 project.json
               2 File(s)            516 bytes
               2 Dir(s)  425,735,077,888 bytes free

C:\Users\Bruce\Desktop\test>dotnet run
Project test does not have a lock file.
Project test does not have a lock file.

C:\Users\Bruce\Desktop\test>dotnet restore
log  : Restoring packages for C:\Users\Bruce\Desktop\test\project.json...
error: Failed to retrieve information from remote source 'C:\Users\Bruce\Documents\Projects\Work\Resources\packages'.

C:\Users\Bruce\Desktop\test>dotnet --info
.NET Command Line Tools (1.0.0-preview1-002702)

Product Information:
 Version:     1.0.0-preview1-002702
 Commit Sha:  6cde21225e

Runtime Environment:
 OS Name:     Windows
 OS Version:  10.0.10586
 OS Platform: Windows
 RID:         win10-x64

And the project.json says
{
  "version": "1.0.0-*",
  "buildOptions": {
    "emitEntryPoint": true
  },
  "dependencies": {
    "Microsoft.NETCore.App": {
      "type": "platform",
      "version": "1.0.0-rc2-3002702"
    }
  },
  "frameworks": {
    "netcoreapp1.0": {
      "imports": "dnxcore50"
    }
  }
}

Not happy

@axtens I think that means you have the directory C:\Users\Bruce\Documents\Projects\Work\Resources\packages configured as package source in your C:\Users\Bruce\AppData\Roaming\NuGet\NuGet.Config, but that directory does not exist.
Either remove or disable that source (by manually editing NuGet.Config or from VS) or create that directory.

I think the error message should be describe solution (explicit or with link)
"project TodoApi does not have a lock file. Please run "dotnet restore" or see http://link-to.solution"
Need to google it to find the right solution :smile:


Unix domain socket support

Summary
I want to run CouchDB behind a reverse proxy by listening to the unix domain socket.
Desired Behaviour
[chttpd]
bind_address = /path/to/couchdb.sock

or
[chttpd]
socket_path = /path/to/couchdb.sock

Then CouchDB will accept requests from /path/to/couchdb.sock.
Possible Solution
Additional context
This is because I want to run CouchDB on a shared host where I can't have exclusive access to any ports.

Thanks, @hkcomori. That might work, seeing as Erlang supports unix sockets https://www.erlang.org/doc/apps/kernel/inet#t:local_address/0, and assuming mochiweb will transparently pass it through.


Added an api for applying mutations

solve #43

How will we know which part of the Node has been mutated?
A node could be quite big, for example, this code:
if(a > b){
  //Some code
} else if (false){
  //Lots of code
} else {
  //Some more code
}

Is passed as a single IfStatement node. If the RemoveConditionalsMutation gets this node, it will replace a > b with true and the receiver of the mutated node will most likely generate the entire if/else-if/else batch as mutated code.

Hmm, you are correct. We should change it like this:
applyMutations(node: ESTree.Node): ESTree.Node[];

The node passed trought to applyMutations should be frozen (readonly). We can do that easely with the following piece of code (utilizing the Object.freeze() method).
https://github.com/substack/deep-freeze/blob/master/index.js
Basically: the idea is that you walk the given node and only copy the node you want to mutate. You than mutate the copy and return the mutated node (or nodes). We than can easily fill in the node at the correct place using the location node and escodegen for the code generation.
For example:
// Javascript:
if(i%15===0){
	console.log('FizzBuzz')
}
// AST
        {
            "loc": {
                "start": {
                    "line": 1,
                    "column": 0
                },
                "end": {
                    "line": 2,
                    "column": 1
                }
            },
            "type": "IfStatement",
            "test": {
                "loc": {
                    "start": {
                        "line": 1,
                        "column": 3
                    },
                    "end": {
                        "line": 1,
                        "column": 11
                    }
                },
                "type": "BinaryExpression",
                "operator": "===",
                "left": {
                    "loc": {
                        "start": {
                            "line": 1,
                            "column": 3
                        },
                        "end": {
                            "line": 1,
                            "column": 7
                        }
                    },
                    "type": "BinaryExpression",
                    "operator": "%",
                    "left": {
                        "loc": {
                            "start": {
                                "line": 1,
                                "column": 3
                            },
                            "end": {
                                "line": 1,
                                "column": 4
                            }
                        },
                        "type": "Identifier",
                        "name": "i"
                    },
                    "right": {
                        "loc": {
                            "start": {
                                "line": 1,
                                "column": 5
                            },
                            "end": {
                                "line": 1,
                                "column": 7
                            }
                        },
                        "type": "Literal",
                        "value": 15,
                        "raw": "15"
                    }
                },
                "right": {
                    "loc": {
                        "start": {
                            "line": 1,
                            "column": 10
                        },
                        "end": {
                            "line": 1,
                            "column": 11
                        }
                    },
                    "type": "Literal",
                    "value": 0,
                    "raw": "0"
                }
            },
            "consequent": {
                "loc": {
                    "start": {
                        "line": 1,
                        "column": 12
                    },
                    "end": {
                        "line": 2,
                        "column": 1
                    }
                },
                "type": "BlockStatement",
                "body": []
            },
            "alternate": null
        }

You than would only retrieve mutation:
 {
                        "loc": {
                            "start": {
                                "line": 1,
                                "column": 5
                            },
                            "end": {
                                "line": 1,
                                "column": 7
                            }
                        },
                        "type": "Literal",
                        "value": true,
                        "raw": "true"
                    }

Looks like a good approach @nicojs !

Shall we add the discussed change about providing a 'frozen' node to the mutation in this PR or a different one?

I think this one. I'll update it


Query fail post-auth

After successful auth, initial query with resulting token yields:
Location header not present in redirection response
Assuming this is buried down in the HTTP helper below the MSGraph SDK - any thoughts?

Thanks for your interest in Microsoft Graph! We are archiving this sample, so I'm closing this issue. For a replacement C# console app sample, please see https://github.com/microsoftgraph/msgraph-training-dotnet-core. We apologize for any inconvenience.


Issue with Docker MACVLAN and Traefik as ReverseProxy when using VisualEditor

Quick outline of my Setup :

Docker Host is running on <IP_ADDRESS>
A non docker Webserver is running on <IP_ADDRESS> port 5000 but also redirecting port 80 and 443 to 5000
Traefik is running on the docker host, using MACVLAN on <IP_ADDRESS>
canasta is running on the docker host with port 80 mapped to 463 (so reachable by <IP_ADDRESS>:463 without a reverse proxy)
Traefik is configured to proxy wiki.mydomain.com to the canaste-web container on port 463
The DNS Record wiki.mydomain.com points to <IP_ADDRESS> (the IP of the Traefik container)

This seems to be working just fine but if i try to edit anything in visual editor it does not load and only shows puzzle icons.
If I create a new wiki site and write something with visual editor and then hit save, it writes html source code into the article. Exactly that sourcecode from the non docker webserver. Somehow, instead of reading the source from the wiki page it seems to contact the webserver on <IP_ADDRESS> and simply uses the response of that. For Displaying that doesn't make any sense so it just doesn't show any meaningful data, saving on the other hand simply saves the raw html source code of that web server.
If I set $wgServer = "http://<IP_ADDRESS>:463"; and access it over this url it works fine. This strange behavior only starts when using the traefik proxy  and accessing over wiki.mydomain.com.
So my uneducated guess would be it's looking for parsoid under the <IP_ADDRESS> IP and gets redirected to the webserver running on port 5000. I tried some host file entries redirecting wiki.mydomain.com to 'localhost', but that didn't work. I dont know there it should have that IP from and how to change this. Anybody got an idea?
To add even more strange things :

ping wiki.mydomain.com  from inside the container resolves to <IP_ADDRESS> => the docker network ip adress of that container
curl -v https://wiki.mydomain.com/rest.php/v1/page/Main_Page  shows the response header HTTP/1.1 302 Moved Temporarily < Server: nginx-dsm => this is the http response header of the webserver running on <IP_ADDRESS>:5000/443/80

I'm sorry to hear about these problems! While we are fine with keeping this issue open to see if anyone can get this fixed, Canasta does not offer support for setups that modify the deployment manifests in significant ways, such as modifying the ports and combining it with other Docker networks. Canasta is meant to run independently from existing services using the way we have set it up already.

@jeffw16
Thank you for your quick response. I completly understand.
I just found out changing $wgServer = "https://wiki.mydomain.com"; to $wgServer = "http://<IP_ADDRESS>:463"; (changing https => http) does work. Traefik always forces https in the end anyway so I hope I don't create any security issue by using http in the config file.
Pretty strange though that changing https to http leads me to a completly webserver running on a different IP address.
Anyway now that I actually got it in a working state and planning to rebuild my docker setup soon allowing me to build much simpler networking I will close this issue. Sorry to have taken up your time.


Test table with outside datadir for --test_mode

The thing is to be tested:
https://dev.mysql.com/doc/refman/5.6/en/tablespace-placing.html

Implemented.Merged.


Update dns_record.rb

Fix for https://github.com/wk8/cookbook-cloudflare/issues/9

Thanks

This was merged in but not pushed to supermarket


Bearer

I am wondering if it's possible to do this kind of things in play-swagger?
https://gist.github.com/kindlychung/a14069599b985d32c42edbfbdbb845d2#file-swagger-yml-L17-L38

securityDefinitions:
  Bearer:
    description: |
      For accessing the API a valid JWT token must be passed in all the queries in
      the 'Authorization' header.

      A valid JWT token is generated by the API and retourned as answer of a call
      to the route /login giving a valid user & password.

      The following syntax must be used in the 'Authorization' header :
      Bearer: xxxxxx.yyyyyyy.zzzzzz
    type: apiKey
    name: Authorization
    in: header
paths:
  /products:
    get:
      security:
        - Bearer: []

the securityDefinitions part will have to go to the root swagger.yml, while the path part needs to go to the swagger comment in the routes file. I think it should work but let me know if it doesn't.

Works perfect. Thanks!


Support variable milliseconds precision

I'm really sorry for the other PR. It seems like the Go backend is fuzz testing the Elm frontend, and I got a value in which the fraction is not rounded to milli-, micro- or nanoseconds: 2018-09-01T20:46:47.23833Z.
The solution I came up with is maybe less elegant. I extract fractions into a float and then convert it to integer milliseconds.

Gotcha, makes sense! That seems like a fine solution to me.

Published as 1.1.2.

@rtfeldman thanks for the prompt merge! I finally managed to upgrade Alertmanager https://github.com/prometheus/alertmanager/pull/1539


Overhaul literal infrastructure

Fix #598.
tl;dr: The unification now starts to play a role in solving literal types and disambiguation. RIP the old hacky and tricky code!
Details: When a literal may be represented by more than one datatype, we construct a hole for it and store it as the type in a MetaLit. Every time a type-solved literal is required during unification, we eagerly check for the solution to the type and attempt to inline the MetaLit (like, when unfolding a global definition, normalizing a substituted term, etc.).
What's left: Because we need to know which universe list elements live in, which is only known when the underlying DataCall is provided, ambiguous list literals cannot yet be handled in this manner.

Conflicts

@imkiva conflict again

little task: cover the code below

Rest lgtm

bors r+


Add segformer image processor

What does this PR do?
Add segformer image processor

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint.


incorrect package.json location for additional native module

The package.json for additional module definitions was moved ./app dir to ./src  dir in v2.0.0.
But on following page, it still says ./app.
Problem page
docs/adding-dependencies.md

and
https://electron-react-boilerplate.js.org/docs/adding-dependencies/
Pull request on the boiler plate side
https://github.com/electron-react-boilerplate/electron-react-boilerplate/pull/2661

fixed


let GitHub build the Docker image

depends on #14

Just rebased and added @WowbaggersLiquidLunch to codeowner.


Remote SSH Crashing after latest update

After the latest update, Remote SSH Crashes after about 30 seconds.
I've tried going back to the previous Remote SSH extension, and 1.95.2, but I am not sure which version of VS Code server gets installed and perhaps that is the issue. I did delete and let vscode re-install on the server side which is a (Windows 2019 Server)

Unfortunately, when this message come up it doesn't allow me to look at any logs as they are all disabled and then the program closes.
If i click Reload, it does the same thing, so I end up in a loop.
Let me know if I can get any other logs for you, but this is quite annoying.

It started with 1.95.3 and the new extension security updates.
I tried going back to 1.95.2 and the older versions of the extensions, but it didn't work.
Yes it connects before it crashes, then about 20 seconds later throws the above error.

Is anyone else hitting this, and if so could you please provide:

a native crash dump
Your local OS
Your remote OS
Version of VS Code
Version of the Remote - SSH extension

Any other information you can provide would also be helpful.  We haven't heard many reports, so for folks that are hitting more details would be appreciated :)

The crash report doesn't work since VS Code doesn't technically crash like a traditional Mac App Crash.  All I get is
The window terminated unexpectedly (reason: 'crashed', code: '5') --it would be nice if that message box would let me copy the SSH log and see what's happening in the background. (unless it's saved somewhere but it's always clear each time I load up VSCode.
Local: MacOS 15.1.1
Remote: Windows Server 2019 - 20348.2700
VS Code: Version: 1.95.3
Commit: f1a4fb101478ce6ec82fe9627c43efbf9e98c813
Date: 2024-11-13T14:50:04.152Z
Browser: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Code/1.95.3 Chrome/128.0.6613.186 Electron/32.2.1 Safari/537.36
Remote SSH - v0.115.1

Thanks for checking.  Is there a version of either VS Code (or the extension) where this no longer repros for you (if you have a few minutes, checking with vscode-bisect) would be very helpful for us.
@roblourens, @connor4312 do you have ideas of another way we can collect data for this particular kind of crash?

So as a test, I downloaded the Insiders Build, and can report that everything works fine now.
So either there is something in my current configuration or an extension is causing an issue.  I tried running the bisect and it didn't seem to help, I kept getting the error.
So how do I remove and create a CLEAN VSCODE install?

https://code.visualstudio.com/docs/setup/uninstall#_clean-uninstall Let us know if you're able to repro again and get a crash dump


ram : fix zstd load

This will fix cases that may cause errors in other function segments because the new array is too large

For reviewers, please carefully format the squashed commit title/messages when merging this PR. Thanks

This PR is due to some exceptions during VCS simulation. However, the C++ seems to have the same functionality before and after this PR. I'm converting this to draft now. After we find why the simulation aborts on VCS, we will come back.


Resolvable boolean expressions

Reopening #164, as it's been rebased on master, and the failing tests have been fixed.
The issue was that the old PR was replacing all our logic in VariableNode.parse(:token:) with a simple compileExpression + compileFilter. This PR moves those 2 into that function, so that it also applies to … if … else … expressions.

Hey 👋 I'm Eve, the friendly bot watching over Stencil 🤖
Thanks a lot for your contribution!

Seems like everything is in order 👍 You did a good job here! 🤝

  Generated by :no_entry_sign: Danger


Does this work with cross compilation?

Hello,
I am cross-building a windows binary from linux. I used go-winres to generate rsrc files, but I didn't find a way to get it included in the executable.
I tried to put the files both in the project root as well as in the same directory than the main, but it didn't work.
Am I missing something?
The documentation mentions that go build automatically embeds in the executable, but I didn't find any reference or documentation about this behavior or how it's supposed to work. Could you please give some additional references?
This is how I compile the binary for windows:
GOOS=windows GOARCH=amd64 CGO_ENABLED=1 CC=x86_64-w64-mingw32-gcc go build -o ./bin/main.exe ./cmd/main.go
And my json file (it's a bit messy because I tried many things, but still nothing works):
{
  "RT_GROUP_ICON": {
    "APP": {
      "0000": "../assets/icon.png"
    },
    "IDI_ICON1": {
      "0409": "../assets/icon.png"
    }
  },
  "RT_MANIFEST": {
    "#1": {
      "0409": {
        "description": "Project name"
      }
    }
  },
  "RT_VERSION": {
    "#1": {
      "0000": {
        "info": {
          "0409": {
            "ProductName": "Project name"
          }
        }
      }
    }
  }
}

I found some hints in this discussion about rust: https://users.rust-lang.org/t/when-cross-compiling-from-linux-to-windows-how-do-i-add-an-icon-to-the-exe-file/63117/7
I now installed the package mingw-w64-tools for debian.
I now have a x86_64-w64-mingw32-windres in my path along with the x86_64-w64-mingw32-gcc cross-compiler, but it does not change the result. I am not sure how to use this stuff properly.

@Seb-C
In case it is helpful, here is an example of how I'm currently using this tool:

Add a go:generate comment in the source file

https://github.com/atc0005/check-cert/blob/f7aa971eaabd508990baeeefc1ce607b106e864c/cmd/lscert/main.go#L8

Create a config file (could be optional, I forget)

https://github.com/atc0005/check-cert/blob/f7aa971eaabd508990baeeefc1ce607b106e864c/cmd/lscert/winres/winres.json

Run go generate with applicable GOOS and GOARCH values

https://github.com/atc0005/check-cert/blob/f7aa971eaabd508990baeeefc1ce607b106e864c/Makefile#L353C3-L353C45

After adding the appropriate go:generate comment to your cmd/main.go file:
cd /path/to/your/project
GOOS=windows GOARCH=amd64 go generate
GOOS=windows GOARCH=amd64 CGO_ENABLED=1 CC=x86_64-w64-mingw32-gcc go build -o ./bin/main.exe ./cmd/main.go

Forgot to note it, but I generate builds using an Ubuntu environment; confirming that cross compilation does work.

@atc0005 Thank you for the insights. Unfortunately, I don't see any major difference with how you use it. I even tried some of you files/commands, and it did not change anything to my project.
I will continue to investigate tomorrow.

@Seb-C Do you have a public repo you could link to? If not, perhaps create a minimal repro that you could link to and others could assist further.

@atc0005 Thank you for your time. I found the solution.
For the syso files to be included in the binary, it must be in the same package than another go source file, and this package must be imported by the main.
However, for some reason, it does not work in my case if I put the syso files directly along with the main.
This is my final setup (a bit non-standard because I want to avoid having random files all over the place):
Makefile:
build-windows:
    go-winres make --arch amd64,386 --in ./build/meta/winres.json --out ./build/meta/rsrc
    GOOS=windows GOARCH=amd64 CGO_ENABLED=1 CC=x86_64-w64-mingw32-gcc go build -o ./bin/main.exe ./cmd/main.go

I added this to the main:
import _ "***/build/meta"
Then I have build/meta/winres.json and build/meta/meta.go (which is an empty file containing only package meta).


String rotation program done

I have a doubt if append and pop are the best options to change the order of de list, it was faster in coding but may be I am using a lot of memory.   Should  I use a triangular reference for  rotate de list?

The changes pretend not to add or delete elements  in the list.


Decompiler: x86-16 external functions are not being handled

Describe the bug
In x86-16 files such as the NE (new executable) format for Windows where external symbols to DLLs are loaded, the decompiler for whatever reason is being informed of external references but not querying to get the details needed for naming and type information.  Instead the raw decompilation contains names like func_0x009002();
To Reproduce

Also useful debugging tip - on Windows an API Monitoring tool like API Monitor v2 64-bit from www.rohitab.com (with Tools -> Options -> Memory -> Maximum size of captured buffers = 4096, and filter for Data Access and Storage -> Local File Systems -> File Management -> Kernel32.dll) monitoring Ghidra's javaw.exe can yield this interface details (in the child decompile.exe process):
WriteFile: getMappedSymbolsXML........<addr space="ram" offset="0x9002"/>
ReadFile: <result>.<parent>.<val/></parent>.<mapsym>.<externrefsymbol name="Ordinal_1_exref">.<addr space="ram" offset="0x9002"/></externrefsymbol>.<addr space="ram" offset="0x9002"/><rangelist/></mapsym>.</result>

Then the decompilation completes without anything further.
Expected behavior
The decompiler is supposed to send getExternalRefXML to get the function details for the external referenced function.  It does this consistently on 32 and 64-bit Windows modules.
Environment (please complete the following information):

OS: Windows 10
Java Version: 11.0.3
Ghidra Version: 9.0.4

Can you send the debug decompiler xml dump from the pull down menu in the upper right corner of the decompiler?

Yes certainly.  Here it is.
Also an easy example to see the issues with external calls not being properly handled by the decompiler as well as no call fixups which could lead to bad code segment registers in a large enough program (not this one) is here:
http://www.minesweeper.info/downloads/Winmine31.html
winmine.zip

Reference #485 and #765

Conclusion: coreaction.cc has only handled CPUI_CALLIND and not CPUI_CALL (which a ptr:offset call is) for resolving external symbols.  Suggestion is to resolve CPUI_CALLs.  The Java client could send a function prototype instead of marking external functions in 16-bit modules as external.  But this is merely a workaround not a solution.

Yes, it seems the NE importer is improperly creating external references which were designed for indirect calls. Working on fix so the importer properly creates external functions.

Is this necessarily needed?  There is a real difference in the ASM which still requires the fix which is proposed and working.  I do not see where the NE loader would need a change.  There are several interesting things in NE files:
The imports are far pointers (not relative/near pointers as per 32/64 bit) - CALLF 0x#:0x# vs CALL ptr [0x#]
The imports are relocated and fictitious far pointers into the import table which is loaded and then the actual far pointers are copied into their place by the NE loader at initialization (not simple indirect reference relocations, into a pointer table) - this means there is no IAT, and you cannot hook a call by merely changing the import table pointer, the Ghidra NE loader currently makes fictitious extensions to the code segment(s) (convenient way to mask other bugs to do with the CS register after far calls being wrong).
IDA Pro on its part does not create fictitious locations at the end of the code and instead leaves the original fictitious pointer value but of course those addresses are contiguous and cannot actually be called.   Ghidra's fictitious locations are 1 byte each so obviously no placeholder code could even fit a single return instruction there either.  Regardless these things need to be considered.

This is part of a series of changes to 16-bit analysis that are making their way through review (some are already in master). The NeLoader hadn't been visited in a while, so some adjustment was necessary anyway to support "protected mode" addressing via the new ProtectedAddressSpace class. For this particular ticket, the decompiler was receiving pointer information for direct calls when it should have been receiving function information. This fix lets the decompiler receive the information normally for a direct call, without having to requery for the information at a later stage of the decompilation.
We'll repost here when the change is up on master, and you can take a look.

Thanks for the info, looking forward to see what comes about - too many details to discuss here as you point out.  I had contributed a large batch of changes to address some of them albeit some were so deep in the architecture, it was difficult to say if my approach was the ideal one or not, despite that outwardly they appeared to work (and were refined to attempt not to break anything else).

This seems to be a fudge as when trying to create types like:
typedef char far* LPSTR;
or
typedef const char far* LPCSTR;
or any "far*" we end up with an incorrect 2-byte pointer reference that subsequently breaks analysis further down the line.
I've been trying to understand how this shortcoming can be rectified, but it seems like the DNA of Ghidra will need updating to accommodate pointers of differing sizes simultaneously.  I would appreciate some pointers (pun unintended) on possible solutions.


Add finalizer on role/rolebinding for work agent

Create controllers running on hub to add finalizer on role/rolebinding for work agent. It ensures that all manifest works in a certain cluster namespace are deleted before role/rolebinding in the same namespace is deleted.

/assign @deads2k

/assign @pmorie

/assign @qiujian16

needs an integration test on this.

/hold
reconsider move this into registration controller

Closing since registration/48 handles this


A PR to test Github Actions

There were earlier some troubles with comment PR step in the preview workflow.

Awesome, works.


Add GitHub Actions

I sent this PR as part of my Daily CI project. I wrote about here: https://dev.to/szabgab/day-4-github-actions-for-columbian-spanish-kop

It is of course your call, but I'd appreciate if you mentioned why you don't want to set up Continuous Integration for this project.


[CLI] Issues with updating

From the log file:
>   file_|-sift-version-file_|-/etc/sift-version_|-managed:
>     __run_num__: 545
>     __sls__: sift.vm
>     changes: {}
>     comment: 'One or more requisite failed: sift.python-packages.sift-python-packages'
>     duration: 0.032
>     result: false
>     start_time: '07:50:02.088349'
>
>   pip_|-sift-python-packages-machinae_|-machinae_|-installed:
>     __id__: sift-python-packages-machinae
>     __run_num__: 261
>     __sls__: sift.python-packages.machinae
>     changes: {}
>     comment: "Failed to install packages: machinae. Error: Collecting machinae\n  Downloading
>       https://files.pythonhosted.org/packages/e1/32/fcf173886cb51cbba843a9eb4e6550d71c8f5f9aefec08dc08359232e022/machinae-1.4.0.tar.gz\nCollecting
>       dnspython3 (from machinae)\n  Downloading https://files.pythonhosted.org/packages/f0/bb/f41cbc8eaa807afb9d44418f092aa3e4acf0e4f42b439c49824348f1f45c/dnspython3-1.15.0.zip\n
>       \   Complete output from command python setup.py egg_info:\n    Traceback (most
>       recent call last):\n      File \"<string>\", line 1, in <module>\n      File
>       \"/tmp/pip-build-3Xcvvq/dnspython3/setup.py\", line 25\n        \"\"\"+\"=\"*78,
>       file=sys.stdout)\n                        ^\n    SyntaxError: invalid syntax\n
>       \   \n    ---------------------------------------- The directory '/home/sansforensics/.cache/pip/http'
>       or its parent directory is not owned by the current user and the cache has been
>       disabled. Please check the permissions and owner of that directory. If executing
>       pip with sudo, you may want sudo's -H flag.\nThe directory '/home/sansforensics/.cache/pip'
>       or its parent directory is not owned by the current user and caching wheels
>       has been disabled. check the permissions and owner of that directory. If executing
>       pip with sudo, you may want sudo's -H flag.\nCommand \"python setup.py egg_info\"
>       failed with error code 1 in /tmp/pip-build-3Xcvvq/dnspython3/\nYou are using
>       pip version 9.0.1, however version 10.0.1 is available.\nYou should consider
>       upgrading via the 'pip install --upgrade pip' command."
>     duration: 9539.937
>     name: machinae
>     result: false
>     start_time: '07:48:22.418053'
>
>   test_|-sift-python-packages_|-sift-python-packages_|-nop:
>     __run_num__: 280
>     __sls__: sift.python-packages
>     changes: {}
>     comment: 'One or more requisite failed: sift.python-packages.machinae.sift-python-packages-machinae'
>     duration: 0.034
>     result: false
>     start_time: '07:49:21.605613'

Tried to Upgrade to 2018.26.1 and got the same, I think, issues.
`

List of Failures (first 10 only)

 NOTE: First failure is generally the root cause.

 IMPORTANT: If opening a ticket, please include this information.

  - ID: sift-python-packages-machinae
    SLS: sift.python-packages.machinae
    Run#: 261
    Comment: Failed to install packages: machinae. Error: Collecting machinae

Downloading https://files.pythonhosted.org/packages/e1/32/fcf173886cb51cbba843a9eb4e6550d71c8f5f9aefec08dc08359232e022/machinae-1.4.0.tar.gz
Collecting dnspython3 (from machinae)
Downloading https://files.pythonhosted.org/packages/f0/bb/f41cbc8eaa807afb9d44418f092aa3e4acf0e4f42b439c49824348f1f45c/dnspython3-1.15.0.zip
Complete output from command python setup.py egg_info:
Traceback (most recent call last):
File "", line 1, in
File "/tmp/pip-build-QHzM6n/dnspython3/setup.py", line 25
"""+"="*78, file=sys.stdout)
^
SyntaxError: invalid syntax
---------------------------------------- The directory '/home/sansforensics/.cache/pip/http' or its parent directory is not owned by the current user and the cache has been disabled. Please check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag.

The directory '/home/sansforensics/.cache/pip' or its parent directory is not owned by the current user and caching wheels has been disabled. check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag.
Command "python setup.py egg_info" failed with error code 1 in /tmp/pip-build-QHzM6n/dnspython3/
You are using pip version 9.0.1, however version 10.0.1 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
- ID: undefined
SLS: sift.python-packages
Run#: 280
Comment: One or more requisite failed: sift.python-packages.machinae.sift-python-packages-machinae
- ID: undefined
SLS: sift.vm
Run#: 545
Comment: One or more requisite failed: sift.python-packages.sift-python-packages
`

I tried "pip3 install machinae" and it went successful.
Though still the same issues when trying upgrade.
Probably related to https://github.com/sans-dfir/sift/issues/285

Looks like a bug with dnspython3
Sent from my iPhone

On Jun 29, 2018, at 07:43, zappeee<EMAIL_ADDRESS>wrote:
Tried to Upgrade to 2018.26.1 and got the same, I think, issues.
`
List of Failures (first 10 only)
NOTE: First failure is generally the root cause.
IMPORTANT: If opening a ticket, please include this information.

ID: sift-python-packages-machinae
SLS: sift.python-packages.machinae
Run#: 261
Comment: Failed to install packages: machinae. Error: Collecting machinae
Downloading https://files.pythonhosted.org/packages/e1/32/fcf173886cb51cbba843a9eb4e6550d71c8f5f9aefec08dc08359232e022/machinae-1.4.0.tar.gz
Collecting dnspython3 (from machinae)
Downloading https://files.pythonhosted.org/packages/f0/bb/f41cbc8eaa807afb9d44418f092aa3e4acf0e4f42b439c49824348f1f45c/dnspython3-1.15.0.zip
Complete output from command python setup.py egg_info:
Traceback (most recent call last):
File "", line 1, in
File "/tmp/pip-build-QHzM6n/dnspython3/setup.py", line 25
"""+"="*78, file=sys.stdout)
^
SyntaxError: invalid syntax

---------------------------------------- The directory '/home/sansforensics/.cache/pip/http' or its parent directory is not owned by the current user and the cache has been disabled. Please check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag.
The directory '/home/sansforensics/.cache/pip' or its parent directory is not owned by the current user and caching wheels has been disabled. check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag.
Command "python setup.py egg_info" failed with error code 1 in /tmp/pip-build-QHzM6n/dnspython3/
You are using pip version 9.0.1, however version 10.0.1 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.

ID: undefined
SLS: sift.python-packages
Run#: 280
Comment: One or more requisite failed: sift.python-packages.machinae.sift-python-packages-machinae
ID: undefined
SLS: sift.vm
Run#: 545
Comment: One or more requisite failed: sift.python-packages.sift-python-packages
`

—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub, or mute the thread.

Could this be related to pip (Python2) trying to install dnspython3 (which is for Python3)? The version for Python2 is dnspython I believe.

Could very well be. It’s the theory I’m working on right now.
Sent from my iPhone

On Jun 30, 2018, at 08:42, Thomas Bouve<EMAIL_ADDRESS>wrote:
Could this be related to pip (Python2) trying to install dnspython3 (which is for Python3)? The version for Python2 is dnspython I believe.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub, or mute the thread.

Closing in favor of one issue https://github.com/sans-dfir/sift/issues/287 for tracking.