karate.sort() gives inconsistent results

  Scenario: sort
    * def fun = function(x){ return x.title }
    * def sortedList = [{"title": "a"},{"title": "a a"},{"title": "a a"}]

    * def list1 = [{"title": "a a"},{"title": "a"},{"title": "a a"}]
    * match karate.sort(list1, fun) == sortedList

    * def list2 = [{"title": "a"},{"title": "a a"},{"title": "a"}]
    * match karate.sort(list2, fun) == sortedList

Hello,
in the code above, list1 and list2 contain the same elements but karate.sort() sorts them differently. The first match will pass but not the second. I expect both to pass. This behavior can be observed in a basic karate project, version 1.3.1 and 1.4.0.RC2.

@andrewbwogi I don't understand. I think it is behaving as expected, list2 does not contain the same elements as list1
here's a simplified example, works fine.
* def sortedList = ['a', 'a a', 'a a']

* def list1 = ['a a', 'a', 'a a']
* match karate.sort(list1) == sortedList

* def list2 = ['a a', 'a a', 'a']
* match karate.sort(list2) == sortedList

Hi @ptrthomas, sorry my previous example is incorrect. The problem is this:
  Scenario: sort
    * def sortedList = ['a','a','a a']
    * def list = ['a','a a','a']

    * match karate.sort(list) == sortedList

I expect the match to pass but it does not. The sorted list becomes ['a','a a','a'] so that 'a' has both a higher and lower order than 'a a'.

@andrewbwogi ah, I tried to fix it but realize that that space causes all kinds of problems with the logic we have. solving that and duplicates at the same time is too hard for me ;)
you are welcome to look at the code and submit a PR. I'm treating this as a won't fix. here's the code: https://github.com/karatelabs/karate/blob/v1.3.0/karate-core/src/main/java/com/intuit/karate/core/ScenarioBridge.java#L829
for future reference, I attempted this solution:
    public Object sort(Value o, Value f) {
        if (!o.hasArrayElements()) {
            return JsList.EMPTY;
        }
        assertIfJsFunction(f);
        long count = o.getArraySize();
        Map<Object, Object> map = new TreeMap();
        Map<String, Integer> duplicates = new HashMap();
        for (int i = 0; i < count; i++) {
            Object item = JsValue.toJava(o.getArrayElement(i));
            Value key = JsEngine.execute(f, item, i);
            if (key.isNumber()) {
                map.put(key.as(Number.class), item);
            } else {
                String keyString = key.asString();
                if (map.containsKey(keyString)) { // duplicates handled only for string values
                    duplicates.put(keyString, i);
                    map.put(keyString + i, item);
                } else {
                    map.put(keyString, item);
                }
            }
        }
        duplicates.forEach((k, i) -> {
            Object item = map.remove(k);
            map.put(k + (i - 1), item);
        });
        return JsValue.fromJava(new ArrayList(map.values()));
    }

if the documentation needs to be updated to reflect that the logic works only on sort-friendly strings without spaces, a PR is welcome.
note that you can fall back to Java collections for custom sorting needs: https://stackoverflow.com/a/52932601/143475

reopening, turns out a solution is possible for all cases

this is actually fixed, solution is probably terribly memory-inefficient (creates 3 extra collections of same size) but it works

@andrewbwogi 1.4.0.RC3 has been released, please try it and let us know

The problem is fixed, thanks

1.4.0 released


Sending unicode in chat.postMessage doesn't work

Description
response = "d\u00a7\u00ae\u00a9\ud83d\ude08\ud83d\udc51\u00e9\u00e3\u00f4"
self.slack_client.api_call("chat.postMessage", channel=channel, text=response)
Describe your issue here.
When using python2 and sending a message with unicode in it,
the posted message in slack does not include unicode characters.
What type of issue is this? (place an x in one of the [ ])

[x] bug
[ ] enhancement (feature request)
[ ] question
[ ] documentation related
[ ] testing related
[ ] discussion

Requirements (place an x in each of the [ ])

[ ] I've read and understood the Contributing guidelines and have done my best effort to follow them.
[ ] I've read and agree to the Code of Conduct.
[ ] I've searched for any related issues and avoided creating a duplicate issue.

Bug Report
Filling out the following details about bugs will help us solve your issue sooner.
Reproducible in:
slackclient version: 1.0.6
python version:2.7.10
OS version(s): Mac OS X
Steps to reproduce:

in python run these lines:
response = "d\u00a7\u00ae\u00a9\ud83d\ude08\ud83d\udc51\u00e9\u00e3\u00f4"
self.slack_client.api_call("chat.postMessage", channel=channel, text=response)

check for unicode in slack chat

notice the lack of unicode

Expected result:
What you expected to happen
There should be unicode in the chat.
Actual result:
What actually happened
Saw the raw escaped unicode string
Attachments:
Logs, screenshots, screencast, sample project, funny gif, etc.

Self-resolved the issue.
The problem was that I was sending <type 'str'> when I should have been sending <type 'unicode'>
When I sent
response = u"d\u00a7\u00ae\u00a9\ud83d\ude08\ud83d\udc51\u00e9\u00e3\u00f4"
Unicode was correctly displayed

``u"d\u00a7\u00ae\u00a9\ud83d\ude08\ud83d\udc51\u00e9\u00e3\u00f4"


Hide Trello card ID

I've noticed that when I attach a Trello card to a note, at the top of said note lies some kind of header like trello_plugin_note_id: XXXX.
Is there any way to hide this from the note itself, in reading mode? I'd prefer to only look at the Trello card from the dedicated side panel...

I don't think the YAML frontmatter is displayed in read mode. Do you have a plugin that displays it, or perhaps it's your theme?

mmmm
I'll have to check that, I'm not sure... Thanks!

Can you reliably reproduce that duplication? It shouldn't add another YAML block. That's definitely why it's visible; the way I modify the metadata is probably out of date, but I've not been updating this plugin since I don't even use Trello anymore.

Seems like I can.
Upon opening Obsidian, if I link a card to a note this happens. Navigating to and back from another note, the correct YAML is shown but there's also the extra bit.
Deleting everything and re-linking seems to create the correct YAML, with no extra bit. From this point on, it seems even linking another note to a card does not create the extra bit.
I'm open to provide videos or logs or whatever if needed!


Show useful error message if proxy settings are missing

14:46:26,163  WARN 57 RouterThread /<IP_ADDRESS>:56481 HttpClient:336 - Unknown host: api.server.test:443
14:46:26,163  WARN 57 RouterThread /<IP_ADDRESS>:56481 HTTPClientInterceptor:77 - Target host api.server.test is unknown. DNS was unable to resolve host name.
14:46:26,163  WARN 57 RouterThread /<IP_ADDRESS>:56481 HTTPClientInterceptor:78 - Maybe the target is only reachable over an HTTP proxy server. Please check proxy settings in conf/proxies.xml.
Maybe additional link to documentation.


Reproduce experimental results

Hi, author,
How should I reproduce the experimental results in Table 2 of the paper? Could you provide the corresponding script?

An other question is how to reproduce the performance of Table 1 of the paper?

We encountered some hardware issues while organizing the code. We plan to open source the related content by the end of October.

Hello author.
I noticed that some files were updated. But unfortunately, some files are empty. For example, Instruction_Tuning.md, eval_emotion_EMER.py, etc., uploaded last week. Is everything ok with u？

Yes, we prepared the relevant code files and documentation a week ago and successfully verified the code locally. However, the team member responsible for this part has recently encountered some urgent matters, so we need to wait for them to upload the content. Thank you for your understanding.


Is handlePastedText a mandatory prop?

What?
handlePastedText breaks if not defined.
It's necessary always define this prop?
I'm just doing this to avoid error:
  handlePastedText () {
    return true
  }

Thanks, that was fast! 👏


Filter by date: submission and publication date

Do we filter by day or year? This is because the time format needs to be pre-processed in metadata and scripts.

Would it be possible to filter by date range (e.g. in google scholar you can search for publications between 2015 and 2020)?


SPA doesn't load React scripts on Firefox

If you load a page without react (index for example) and then navigate to a page with react, the react JS script doesn't get loaded.
However, if you start on a page with react (e.g. Aspect Ratio Calculator), the script gets loaded and everything works fine even while navigating.

Update: ChromeOS v199.0.6045.29 also seems to have this issue. Might have to remove it for now.

I will do some testing, but in order to organise data I will just use this comment and edit it

Browser
Has issues?

Arc
No

Firefox
Yes

Safari (iOS)
No

Safari (macOS)
Yes

Brave (macOS & Linux)
Yes

Chrome
No

Chrome (ChromeOS)
Yes

SigmaOS (WebKit)
Yes

Weird how Brave, unlike other Chromium browsers, doesn't like the SPA, especially considering that the Chromium and V8 versions for Chrome and Brave are the same.
Also weird how WebKit on iOS doesn't have any issue with this, while WebKit on macOS does.

Temporarily disabled SPA for everyone in c46ce0b


Fix build with Windows

What needs to be done
Fix the build of main branch under Windows.
Why it needs to be done
After getting my hands on a Windows machine it turned out the build fails.

One thing I noticed in my tests here is that there are a lot of ant path patterns starting with "/" (for instance, on MoveFilesActionTest class).
I think that these patterns should be using relative patterns (such as **/SomeFile.foo, not /**/SomeFile.foo).

I can't recall. I think I had problems with relative paths.
Currently, I have no access to a Win machine but when #965 is merged these patterns should be working.

I tested the branch of @ammachado on Windows but there are still failing tests, for example:
[ERROR]   Module_searchMainJava_Test$MultiMavenModuleProject.withClassesInMainAndTest_providesClassesFromSrcMainJava:219->lambda$withClassesInMainAndTest_providesClassesFromSrcMainJava$2:222 expected: "application/src/main/java/SomeClass.java"  but was: "application\src\main\java\SomeClass.java" [ERROR]   Module_searchMainJava_Test$MultiMavenModuleProject.withClassesInMain_providesClassesFromSrcMainJava:236->lambda$withClassesInMain_providesClassesFromSrcMainJava$3:239 expected: "application/src/main/java/SomeClass.java"  but was: "application\src\main\java\SomeClass.java"
The failing tests compare the toString method of getSourcePath, for example
assertThat(projectResourceSet.list().get(0).getSourcePath().toString()).isEqualTo("application/src/main/java/SomeClass.java");
Should I add a method String getUnifiedSourcePath to RewriteSourceFileHolder?
The fixes @fabapp2 did on the methods getSourcePath() and getAbsolutePath doesn't seem to work as the return type is Path, not String. And Path uses the default file system separator.
An alternative is to fix it in the tests themselves, so I don't need to touch RewriteSourceFileHolder:
assertThat(LinuxWindowsPathUnifier.unifyPath(projectResourceSet.list().get(0).getSourcePath())).isEqualTo("application/src/main/java/SomeClass.java");

@bottemav I applied the changes you mentioned, can you test again?

@ammachado Thanks for the quick fix. The build now fails due to this test
[ERROR] org.springframework.sbm.project.parser.ForgivingParsingOfTestResourcesTest.test_renameMe -- Time elapsed: 0.410 s <<< ERROR!
java.lang.RuntimeException:
src\test\resources\error.yaml mapping values are not allowed here
 in 'reader', line 4, column 21:
      risk-score-classes: !include risk-score-class_ok.y ...
                        ^
	at org.springframework.sbm.openrewrite.RewriteExecutionContextErrorHandler.accept(RewriteExecutionContextErrorHandler.java:47)
	at org.springframework.sbm.openrewrite.RewriteExecutionContextErrorHandler.accept(RewriteExecutionContextErrorHandler.java:27)
	at org.openrewrite.yaml.YamlParser.lambda$parseInputs$0(YamlParser.java:84)
	at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:197)
	at java.base/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1625)
	at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:509)
	at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499)
	at java.base/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:921)
	at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
	at java.base/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:682)
	at org.openrewrite.yaml.YamlParser.parseInputs(YamlParser.java:98)
	at org.springframework.sbm.project.parser.ResourceParser.parseSingleResource(ResourceParser.java:150)
	at org.springframework.sbm.project.parser.ResourceParser.lambda$getSourceFileStream$8(ResourceParser.java:143)
        ...
Caused by: java.lang.IllegalStateException: src\test\resources\error.yaml mapping values are not allowed here
 in 'reader', line 4, column 21:
      risk-score-classes: !include risk-score-class_ok.y ...
                        ^
	... 106 more
Caused by: mapping values are not allowed here
 in 'reader', line 4, column 21:
      risk-score-classes: !include risk-score-class_ok.y ...
                        ^

I then fixed ResourceParser and ForgivingParsingOfTestResourcesTest, but after that 5 other tests fail:

AddSpringBootContextTestClassTest$GivenSingleModuleProject.testApplyShouldAddNewSource:94
AddSpringBootMainClassActionTest.testApplyShouldAddNewSource:56
SpringBeanMethodDeclarationFinderTest$WithMatchingBean.shouldReturnTheMatchingBeanDeclaration:81
SpringBeanMethodDeclarationFinderTest$WithMultipleMatchingBeans.shouldReturnTheMatchingBeanDeclarations:151
InitializeSpringBootMigrationRecipeIntegrationTest.initializeBlankProjectAsSpringBootApplication:29

What is the best approach to proceed?

@fabapp2 the Windows build is still broken.


Dact 385 retrieve list of directors

The current directors page is the 6th page in the happy path journey for the web service. It acts as a page where an Officer may select from a list of active directors associated with a company to remove.
An Officer should be able to click the remove director link which will take them to the ‘When was this director removed ?’ (removal date) page.
To complete this work, we first need an endpoint to retrieve the list of active Directors.

I'm still not sure that this call from the officer API is the appropriate place to do it.

In reply to Phil's comment and In Mike Moore's absence...
I think the design is fine - the Web API should not need to call multiple APIs, the Filing API is acting as an API Gateway and thus the 'extra hop' is justified, to maintain a single API.


flutter upgrade shows version output from the old version, not new version

Experienced this while upgrading on a machine I havn't used for a while:
$ flutter upgrade
Downloading Dart SDK from Flutter engine 1ed25ca7b7e3e3e8047df050bba4174074c9b336...
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 58.6M  100 58.6M    0     0  9822k      0  0:00:06  0:00:06 --:--:-- 11.0M
Building flutter tool...
Upgrading Flutter from /Users/mit/dev/flutter...
[..].
Downloading ios-release tools...

Flutter 0.5.1 • channel beta • https://github.com/flutter/flutter.git
Framework • revision c7ea3ca377 (4 months ago) • 2018-09-07 12:33:05 -0700
Engine • revision 58a1894a1c
Tools • Dart 2.0.0-dev.58.0.flutter-f981f09760

Running flutter doctor...
Doctor summary (to see all details, run flutter doctor -v):
[✓] Flutter (Channel beta, v0.8.2, on Mac OS X 10.13.6 17G65, locale en-DK)
[✓] Android toolchain - develop for Android devices (Android SDK 28.0.0)
[✓] iOS toolchain - develop for iOS devices (Xcode 9.4.1)
[✓] Android Studio (version 3.1)
[✓] VS Code (version 1.26.1)
[!] Connected devices
    ! No devices available

While the doctor output at the bottom does list 0.8.1, the version output just a few lines about it still lists 0.5.1. I find that pretty confusing.

This is still happening.
cc @jonahwilliams


Handling "RuntimeError: can't start a new thread" error at production.

Checked other resources

[ ] This is a bug, not a usage question. For questions, please use GitHub Discussions.
[X] I added a clear and detailed title that summarizes the issue.
[X] I read what a minimal reproducible example is (https://stackoverflow.com/help/minimal-reproducible-example).
[x] I included a self-contained, minimal example that demonstrates the issue INCLUDING all the relevant imports. The code run AS IS to reproduce the issue.

Example Code
@celery_app.task(bind=True)
def content_gen_celery_task(self, task_id: str) -> str:
   loop = asyncio.get_event_loop()
   asyncio.set_event_loop(loop)
  loop.run_until_complete(generate(task_data=task_data, temerature=0.7))

async def generate(task_data:TaskData, temerature:float=0.7):
    content_maker_agent = ContentMakerAgent(
                input_data=input_data,
                llm_model=task_data.llm_model,
                temperature=temerature
            )
    generated_content = await content_maker_agent.graph.ainvoke(input_data )

class ContentMakerAgent():
    def __init__(self, input_data:ContentState, llm_model:str, temperature=0.7):
        builder = StateGraph(ContentState)
        self.writer_model = ChatOpenAI(model=llm_model, temperature=temperature)
        self.briefs = input_data["briefs"]

        for i, brief in enumerate(self.briefs):
            node_name = f"node_{i}"
            function_declaration = GenContent(state=input_data,
                                              brief=brief,
                                              llm_model=llm_model,
                                              temperature=temperature, )

            builder.add_node(node_name, function_declaration)
            builder.add_edge(START, node_name)

            builder.add_edge(node_name, END)
        self.graph = builder.compile()

Error Message and Stack Trace (if applicable)
[2024-11-28 05:20:12,030: ERROR/ForkPoolWorker-26] can't start new thread
Traceback (most recent call last):
File "/app/core/ai/agent.py", line 196, in r_brief_generator
response = await self.standart_writer_model.with_structured_output(Briefs).ainvoke(messages)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/venv/lib/python3.11/site-packages/langchain_core/runnables/base.py", line 2921, in ainvoke
input = await asyncio.create_task(part(), context=context)  # type: ignore
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/venv/lib/python3.11/site-packages/langchain_core/runnables/base.py", line 5105, in ainvoke
return await self.bound.ainvoke(
^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/venv/lib/python3.11/site-packages/langchain_core/language_models/chat_models.py", line 298, in ainvoke
llm_result = await self.agenerate_prompt(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/venv/lib/python3.11/site-packages/langchain_core/language_models/chat_models.py", line 787, in agenerate_prompt
return await self.agenerate(
^^^^^^^^^^^^^^^^^^^^^
File "/opt/venv/lib/python3.11/site-packages/langchain_core/language_models/chat_models.py", line 747, in agenerate
raise exceptions[0]
File "/opt/venv/lib/python3.11/site-packages/langchain_core/language_models/chat_models.py", line 923, in _agenerate_with_cache
result = await self._agenerate(
^^^^^^^^^^^^^^^^^^^^^^
File "/opt/venv/lib/python3.11/site-packages/langchain_openai/chat_models/base.py", line 843, in _agenerate
response = await self.async_client.create(**payload)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/venv/lib/python3.11/site-packages/openai/resources/chat/completions.py", line 1490, in create
return await self._post(
^^^^^^^^^^^^^^^^^
File "/opt/venv/lib/python3.11/site-packages/openai/_base_client.py", line 1838, in post
return await self.request(cast_to, opts, stream=stream, stream_cls=stream_cls)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/venv/lib/python3.11/site-packages/openai/_base_client.py", line 1532, in request
return await self._request(
^^^^^^^^^^^^^^^^^^^^
File "/opt/venv/lib/python3.11/site-packages/openai/_base_client.py", line 1552, in _request
self._platform = await asyncify(get_platform)()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/venv/lib/python3.11/site-packages/openai/_utils/_sync.py", line 69, in wrapper
return await anyio.to_thread.run_sync(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/venv/lib/python3.11/site-packages/anyio/to_thread.py", line 56, in run_sync
return await get_async_backend().run_sync_in_worker_thread(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/venv/lib/python3.11/site-packages/anyio/_backends/_asyncio.py", line 2114, in run_sync_in_worker_thread
worker.start()
File "/root/.nix-profile/lib/python3.11/threading.py", line 964, in start
_start_new_thread(self._bootstrap, ())
RuntimeError: can't start new thread
Description
I have deployed a langgraph agent at production. The agent runs inside a Celery task. 10-20 nodes of the agent are executed parallelly. At peak usage, I get "can't start a new thread" error.
My agent is stateless, no thread ID is provided while invoking the agent. I am new to langgraph and multi threading.
Should I upgrade my CPU and memory? How can I improve my code so that more threads won't be a problem in the future?
System Info
CPU: 32 vCPU
Memory: 32 GB

Please include full stack trace and if possible a minimal reproducible example. There's not enough context to help now

[2024-11-28 05:20:12,030: ERROR/ForkPoolWorker-26] can't start new thread
Traceback (most recent call last):
File "/app/core/ai/agent.py", line 196, in r_brief_generator
response = await self.standart_writer_model.with_structured_output(Briefs).ainvoke(messages)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/venv/lib/python3.11/site-packages/langchain_core/runnables/base.py", line 2921, in ainvoke
input = await asyncio.create_task(part(), context=context)  # type: ignore
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/venv/lib/python3.11/site-packages/langchain_core/runnables/base.py", line 5105, in ainvoke
return await self.bound.ainvoke(
^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/venv/lib/python3.11/site-packages/langchain_core/language_models/chat_models.py", line 298, in ainvoke
llm_result = await self.agenerate_prompt(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/venv/lib/python3.11/site-packages/langchain_core/language_models/chat_models.py", line 787, in agenerate_prompt
return await self.agenerate(
^^^^^^^^^^^^^^^^^^^^^
File "/opt/venv/lib/python3.11/site-packages/langchain_core/language_models/chat_models.py", line 747, in agenerate
raise exceptions[0]
File "/opt/venv/lib/python3.11/site-packages/langchain_core/language_models/chat_models.py", line 923, in _agenerate_with_cache
result = await self._agenerate(
^^^^^^^^^^^^^^^^^^^^^^
File "/opt/venv/lib/python3.11/site-packages/langchain_openai/chat_models/base.py", line 843, in _agenerate
response = await self.async_client.create(**payload)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/venv/lib/python3.11/site-packages/openai/resources/chat/completions.py", line 1490, in create
return await self._post(
^^^^^^^^^^^^^^^^^
File "/opt/venv/lib/python3.11/site-packages/openai/_base_client.py", line 1838, in post
return await self.request(cast_to, opts, stream=stream, stream_cls=stream_cls)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/venv/lib/python3.11/site-packages/openai/_base_client.py", line 1532, in request
return await self._request(
^^^^^^^^^^^^^^^^^^^^
File "/opt/venv/lib/python3.11/site-packages/openai/_base_client.py", line 1552, in _request
self._platform = await asyncify(get_platform)()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/venv/lib/python3.11/site-packages/openai/_utils/_sync.py", line 69, in wrapper
return await anyio.to_thread.run_sync(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/venv/lib/python3.11/site-packages/anyio/to_thread.py", line 56, in run_sync
return await get_async_backend().run_sync_in_worker_thread(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/venv/lib/python3.11/site-packages/anyio/_backends/_asyncio.py", line 2114, in run_sync_in_worker_thread
worker.start()
File "/root/.nix-profile/lib/python3.11/threading.py", line 964, in start
_start_new_thread(self._bootstrap, ())
RuntimeError: can't start new thread``

Please include full stack trace and if possible a minimal reproducible example. There's not enough context to help now

Thanks for the response. This error is generated at peak usage. Above, I have provided an error trace.

I added the error trace and my code that generates the runtime error. Let me know if you need more information.

My agent is stateless, no thread ID is provided while invoking the agent. I am new to langgraph and multi threading.

Based on the stack trace the issue isn't related at all to langgraph threads (Langgraph threads are just unique identifiers for a conversation and have nothing to do with hardware threads).
The celery code is probably not set up properly for async workloads. I haven't used celery in an async setting in the past but have you looked into guidelines for doing so?

@eyurtsev I ham using celery in async setting for a year know. I used langchain and simple for-loop for content creation. I had never had any threading issue back then.
However, I am utilizing parallel node execution functionality of the langgraph instead of simple "for-loop" right now. I am under the impression that langgraph spawns a new thread for each node execution. Each parallelly executed node is a separate thread and gets closed when the node is finished.
Honestly, I am not sure if I set celery in the right way for async task execution. I am doing more research on this.
I believe that high celery task concurrency (30-60 celery task concurrency) + langgraph threads are combined to quickly blow away my system resources.
Is my assumption of langgraph spawning a new thread for a node execution correct?
How do other developers deploy langgraph at production and prevent threading error?


Watermark pattern might be incorrect

Hello,
Can you please double-check the image: vggface_watermark_pattern.png.
It seems to me that this is not the watermark pattern (according to your paper).
If so, can you please upload the correct one?
Best,

I believe the watermark pattern is correct. It should be identical to the one in the paper (Fig 7, b).


Add limit method rdd

This commit adds limit method to RDD so we can limit query set retrieved by single worker

Nice! Thanks for the improvement!


Appstudio update test-component-pac-qacl

Pipelines as Code configuration proposal

Pipelines as Code CI/test-component-pac-qacl-on-pull-request has successfully validated your commit.

StatusDurationName

✅ Succeeded
16 seconds
init

✅ Succeeded
12 seconds
clone-repository

✅ Succeeded
1 minute
build-container

✅ Succeeded
24 seconds
deprecated-base-image-check

✅ Succeeded
23 seconds
sanity-inspect-image

✅ Succeeded
3 minutes
clair-scan

✅ Succeeded
50 seconds
clamav-scan

✅ Succeeded
15 seconds
sbom-json-check

✅ Succeeded
7 seconds
sanity-optional-label-check

✅ Succeeded
7 seconds
sanity-label-check

✅ Succeeded
6 seconds
show-summary

Pipelines as Code CI/test-component-pac-qacl-on-pull-request has successfully validated your commit.

StatusDurationName

✅ Succeeded
6 seconds
init

✅ Succeeded
21 seconds
clone-repository

✅ Succeeded
28 seconds
build-container

✅ Succeeded
9 seconds
sanity-inspect-image

✅ Succeeded
9 seconds
deprecated-base-image-check

✅ Succeeded
10 seconds
clair-scan

✅ Succeeded
35 seconds
clamav-scan

✅ Succeeded
9 seconds
sbom-json-check

✅ Succeeded
16 seconds
sanity-optional-label-check

✅ Succeeded
17 seconds
sanity-label-check

✅ Succeeded
6 seconds
show-summary


click event tray doesn't trigger on OS X

Electron version: 0.35.0
Operating system: OS X

Currently the click event on the tray doesn't trigger on OS X, it does so on Windows
tray = new Tray(path.join(__dirname, '/img/app.png'));
tray.on('click', function(){
        if (mainWindow.isMinimized()) mainWindow.restore();
        mainWindow.focus();
    });

Have you tried recent versions like v0.37.x?

This doesn't work for me either. I'm using Electron v0.37.10. Here's the code:
https://github.com/Aluxian/Whatsie/blob/master/src/scripts/browser/managers/tray-manager.js
I see "tray right-click" in the console, but no "tray click".

An example app with reproduce steps would help here.

I also have this issue. Please re-open, or describe a work-around I can use to know when it's safe to update the menu (since updating the menu closes it if the user has it open)

The click event does not fire when a context menu is open on mac, https://github.com/electron/electron/blob/307b504eb411add469fb9e9bbf8fea93ece178b9/atom/browser/ui/tray_icon_cocoa.mm#L234-L239
So this is the current intended behavior, you can explicitly call http://electron.atom.io/docs/api/tray/#traypopupcontextmenumenu-position-macos-windows to pop up the menu when click fires.


Redesign Gene/Drug Record pages for readability

Individual drug and gene record pages (accessed from clicking on an individual drug or gene result) are currently difficult to read and have little styling.
Consider:

[ ] Accordion tab design for content
[ ] Nav sidebar

completed #252


Dependency issue for SQLite Database?

I'm hoping this is a case of PEBKAC on my part.
OS: Debian 11 Bullseye
Architecture: x64
ErsatzTV Version: 0.7.2
stacktrace.txt

PEBKAC. Apparently tar -xf did not extract the libe_sqlite3.so file. I'm sorry to have wasted your time.

Glad you got it working :+1:


add test that creates three references, makes relations from first to…

… second and first to third, then merged second and third, and tests that first to third has both types of relations

Thanks @sweng66 !


reset pw through jwt

not sure this is the right thing to do
let me think about it...

I don't like that we need to setup up JWT just for this


Downstream cluster using Oracle Linux 8.2 fails health check and is in Error state

What kind of request is this (question/bug/enhancement/feature request):
bug
Steps to reproduce (least amount of steps as possible):

Install rancher v2.5.2, 2.5.5 or 2.5.6-rc2 (single-node cluster)
provision Oracle Linux 8.2 custom cluster

install docker on the node (using rancher script for 19.03)
follow instructions here for oracle linux firewall with rancher (also tested skipping this step, same result)
run custom node install command from rancher server

Result:

rancher reports Cluster health check failed: cluster agent is not ready after adding custom cluster (default and system projects report cluster not ready
node page reports all good. viewing the containers on the node also appear healthy (no restarts)

da88f11e84ed        rancher/kube-api-auth                             "/bin/sh -c 'kube-ap…"   4 minutes ago       Up 4 minutes                            k8s_kube-api-auth_kube-api-auth-2gk5n_cattle-system_a4b9da15-276f-4789-967b-d418eaaa55da_0
4a7747e779f3        rancher/nginx-ingress-controller-defaultbackend   "/server"                4 minutes ago       Up 4 minutes                            k8s_default-http-backend_default-http-backend-65dd5949d9-hkrmg_ingress-nginx_0499e8af-32b8-45ee-b6d3-a2589b9be753_0
f4d15c0a54e8        46177de0d5d3                                      "run.sh"                 4 minutes ago       Up 4 minutes                            k8s_agent_cattle-node-agent-xw755_cattle-system_2c518787-9486-4a3a-aa53-151dff056269_0
60a90418c5f0        rancher/pause:3.2                                 "/pause"                 4 minutes ago       Up 4 minutes                            k8s_POD_kube-api-auth-2gk5n_cattle-system_a4b9da15-276f-4789-967b-d418eaaa55da_0
de021c0f99c0        rancher/pause:3.2                                 "/pause"                 4 minutes ago       Up 4 minutes                            k8s_POD_cattle-node-agent-xw755_cattle-system_2c518787-9486-4a3a-aa53-151dff056269_0
37c4eb5632ff        rancher/pause:3.2                                 "/pause"                 4 minutes ago       Up 4 minutes                            k8s_POD_cattle-cluster-agent-57cc48f446-wcg72_cattle-system_14de5414-34a6-43e2-9b11-0bbf74b86c9c_0
5009a1fb08bf        rancher/nginx-ingress-controller                  "/usr/bin/dumb-init …"   5 minutes ago       Up 5 minutes                            k8s_nginx-ingress-controller_nginx-ingress-controller-b45zq_ingress-nginx_c6c70aa9-c2f1-4a59-8d97-3d1ddb5ae7cf_0
86d1659777af        rancher/metrics-server                            "/metrics-server --k…"   5 minutes ago       Up 5 minutes                            k8s_metrics-server_metrics-server-8449844bf-2bscr_kube-system_3a5c3061-1866-45a7-8090-7a131e636836_0
6763685cae4d        rancher/coredns-coredns                           "/coredns -conf /etc…"   5 minutes ago       Up 5 minutes                            k8s_coredns_coredns-6f85d5fb88-6md6v_kube-system_8fd4185c-a4ac-4d35-87ed-9e82515a80f7_0
41905a59c66d        rancher/cluster-proportional-autoscaler           "/cluster-proportion…"   5 minutes ago       Up 5 minutes                            k8s_autoscaler_coredns-autoscaler-79599b9dc6-c5cmc_kube-system_e7c79597-20dc-4a4c-9014-bbd82a54f1a3_0
404fd67de74a        rancher/pause:3.2                                 "/pause"                 5 minutes ago       Up 4 minutes                            k8s_POD_default-http-backend-65dd5949d9-hkrmg_ingress-nginx_0499e8af-32b8-45ee-b6d3-a2589b9be753_0
5cdbc3e3fa7b        rancher/pause:3.2                                 "/pause"                 5 minutes ago       Up 5 minutes                            k8s_POD_nginx-ingress-controller-b45zq_ingress-nginx_c6c70aa9-c2f1-4a59-8d97-3d1ddb5ae7cf_0
aceffc4914e4        rancher/calico-kube-controllers                   "/usr/bin/kube-contr…"   5 minutes ago       Up 5 minutes                            k8s_calico-kube-controllers_calico-kube-controllers-7fbff695b4-mwjh7_kube-system_a1a98fa5-fc0a-49bc-8e6a-874984044ff7_0
2ebbf09d7dfa        rancher/coreos-flannel                            "/opt/bin/flanneld -…"   5 minutes ago       Up 5 minutes                            k8s_kube-flannel_canal-zmmd7_kube-system_1845e40c-d8f6-4ad9-955c-bf0be5159eae_0
538fda673b79        rancher/pause:3.2                                 "/pause"                 5 minutes ago       Up 5 minutes                            k8s_POD_metrics-server-8449844bf-2bscr_kube-system_3a5c3061-1866-45a7-8090-7a131e636836_1
3ccb9ad9f8d3        rancher/pause:3.2                                 "/pause"                 5 minutes ago       Up 5 minutes                            k8s_POD_coredns-6f85d5fb88-6md6v_kube-system_8fd4185c-a4ac-4d35-87ed-9e82515a80f7_1
268e45055e1b        rancher/pause:3.2                                 "/pause"                 5 minutes ago       Up 5 minutes                            k8s_POD_coredns-autoscaler-79599b9dc6-c5cmc_kube-system_e7c79597-20dc-4a4c-9014-bbd82a54f1a3_0
735621b5dd66        rancher/pause:3.2                                 "/pause"                 5 minutes ago       Up 5 minutes                            k8s_POD_calico-kube-controllers-7fbff695b4-mwjh7_kube-system_a1a98fa5-fc0a-49bc-8e6a-874984044ff7_0
4664c06ac16d        rancher/calico-node                               "start_runit"            5 minutes ago       Up 5 minutes                            k8s_calico-node_canal-zmmd7_kube-system_1845e40c-d8f6-4ad9-955c-bf0be5159eae_0
816b7fc5b262        rancher/pause:3.2                                 "/pause"                 5 minutes ago       Up 5 minutes                            k8s_POD_canal-zmmd7_kube-system_1845e40c-d8f6-4ad9-955c-bf0be5159eae_0
cb32ea3ca47f        rancher/hyperkube:v1.19.6-rancher1                "/opt/rke-tools/entr…"   5 minutes ago       Up 5 minutes                            kube-proxy
7f9e5507142f        rancher/hyperkube:v1.19.6-rancher1                "/opt/rke-tools/entr…"   5 minutes ago       Up 5 minutes                            kubelet
62b91a9e87e1        rancher/hyperkube:v1.19.6-rancher1                "/opt/rke-tools/entr…"   6 minutes ago       Up 5 minutes                            kube-scheduler
fa50e9e133c0        rancher/hyperkube:v1.19.6-rancher1                "/opt/rke-tools/entr…"   6 minutes ago       Up 6 minutes                            kube-controller-manager
ee5f4a2bcd1f        rancher/hyperkube:v1.19.6-rancher1                "/opt/rke-tools/entr…"   6 minutes ago       Up 6 minutes                            kube-apiserver
82bb68700533        rancher/coreos-etcd:v3.4.13-rancher1              "/usr/local/bin/etcd…"   6 minutes ago       Up 6 minutes                            etcd

however, dashboard of custom cluster does not display information:

Other details that may be helpful:
blocking this ticket: #30899
Environment information

Rancher version (rancher/rancher/rancher/server image tag or shown bottom left in the UI): tested on v2.5.2, 2.5.5, 2.5.6-rc2
Installation option (single install/HA): single install

Cluster information

Cluster type (Hosted/Infrastructure Provider/Custom/Imported): imported, Oracle Linux 8.2

Machine type (cloud/VM/metal) and specifications (CPU/memory): tested with aws t2/t3.medium, t2.xlarge

Kubernetes version (use kubectl version):  v1.19.6

Docker version (use docker version):  v19.03

Error seen in kubelet when disabling firewalld:
E0121 21:46:40.252248    3313 pod_workers.go:191] Error syncing pod 6847fb94-ff62-4ee0-94d9-4dc4cfb21995 ("cattle-cluster-agent-5b796f7bcb-8567h_cattle-system(6847fb94-ff62-4ee0-94d9-4dc4cfb21995)"), skipping: failed to "StartContainer" for "cluster-register" with CrashLoopBackOff: "back-off 2m40s restarting failed container=cluster-register pod=cattle-cluster-agent-5b796f7bcb-8567h_cattle-system(6847fb94-ff62-4ee0-94d9-4dc4cfb21995)"

k8s v1.19.3
Rancher v2.5.5

Error seen in kubelet when disabling firewalld:
E0121 21:46:40.252248    3313 pod_workers.go:191] Error syncing pod 6847fb94-ff62-4ee0-94d9-4dc4cfb21995 ("cattle-cluster-agent-5b796f7bcb-8567h_cattle-system(6847fb94-ff62-4ee0-94d9-4dc4cfb21995)"), skipping: failed to "StartContainer" for "cluster-register" with CrashLoopBackOff: "back-off 2m40s restarting failed container=cluster-register pod=cattle-cluster-agent-5b796f7bcb-8567h_cattle-system(6847fb94-ff62-4ee0-94d9-4dc4cfb21995)"

k8s v1.19.3
Rancher v2.5.5

workaround was to disable iptables and firewalld on all nodes running Oracle Linux (we tested 7.9 and 8.2)

sudo systemctl stop iptables
sudo systemctl disable iptables

systemctl disable firewalld
systemctl stop firewalld

### install docker
### run command from rancher

workaround was to disable iptables and firewalld on all nodes running Oracle Linux (we tested 7.9 and 8.2)

sudo systemctl stop iptables
sudo systemctl disable iptables

systemctl disable firewalld
systemctl stop firewalld

### install docker
### run command from rancher


fix(fw): EOF - Accept initcode_prefix on EOF Container.Init

🗒 Description
Adds initcode_prefix parameter to Container.Init in order to add executable bytecode that must be appended before EOFCREATE[0](0, 0) in the resulting container's code section.
🔗 Related Issues
None
✅ Checklist

[x] All: Set appropriate labels for the changes.
[x] All: Considered squashing commits to improve commit history.
[x] All: Added an entry to CHANGELOG.md.
[x] All: Considered updating the online docs in the ./docs/ directory.
[x] Tests: All converted JSON/YML tests from ethereum/tests have been added to converted-ethereum-tests.txt.
[x] Tests: A PR with removal of converted JSON/YML tests from ethereum/tests have been opened.
[x] Tests: Included the type and version of evm t8n tool used to locally execute test cases:  e.g., ref with commit hash or geth 1.13.1-stable-3f40e65.
[x] Tests: Ran mkdocs serve locally and verified the auto-generated docs for new tests in the Test Case Reference are correctly formatted.

And what will it look like if we mstore some bytes in init code prefix?

Not really, it will just append bytecode to execute before returning the contract, for example an SSTORE if you would like to store something during contract initialization.


Input fields within the selection boundary cannot be focused on

Do you want to request a feature or report a bug?
A bug
What is the current behavior?
When using selection-js, any input field within the selection boundary cannot be focused on.
If the current behavior is a bug, please provide the steps to reproduce and create a JSFiddle.

I created a codepen (couldn't get the jsfiddle to work) to illustrate the issue:
https://codepen.io/au_re/project/editor/ZbWWrj
What is the expected behavior?
Ideally you should still be able to focus input fields inside the selection boundary, or selectable elements
Your environment:
Selection-version: 1.6.0
Browser-version:  Firefox/Chrome
Operating-system:  Windows/Linux

This kind of wanted-behavior (let's not call it an issue) can be easily fixed via the beforestart event:
selection.on('beforestart', ({oe}) => {
    return oe.target.tagName !== 'INPUT';
});

beforestart gets fired before a selection takes place, inside of the event-handler you can decide whether a selection should be initiated or not. In your case you only want the user to make a selection if the target-element (where the user clicked) is not a input-element.

Thanks! I should read the documentation more carefully next time :/ Great job by the way, this library is super useful!

 I have to admit that the event-section in the docs isn't very extensive - I've just added a few inline-comments to the event-examples to show how each event could be used :)


Add SqlPackage to Windows

Tool name
SqlPackage
Tool license
Unsure. The tool already exists in the Ubuntu image.
Add or update?

[X] Add
[ ] Update

Desired version
latest/any
Approximate size
No response
Brief description of tool
This tool already exists in the Ubuntu image since #2787, see that issue for reference.
Please add this to Windows as well.
URL for tool's homepage
https://docs.microsoft.com/en-us/sql/tools/sqlpackage/sqlpackage-download?view=sql-server-ver15
Provide a basic test case to validate the tool's functionality.
No response
Virtual environments affected

[ ] Ubuntu 16.04
[ ] Ubuntu 18.04
[ ] Ubuntu 20.04
[ ] macOS 10.15
[ ] macOS 11
[x] Windows Server 2016
[X] Windows Server 2019
[X] Windows Server 2022

Can this tool be installed during the build?
No response
Tool installation time in runtime
No response
Are you willing to submit a PR?
No response

Hello, @krokofant
We already pre-installed DACFx - https://github.com/actions/virtual-environments/blob/main/images/win/scripts/Installers/Install-DACFx.ps1
sqlpackage.exe util exists C:\Program Files\Microsoft SQL Server\150\DAC\bin\sqlpackage.exe

@al-cheb Aha! Could this be made clearer in the readme?
The Ubuntu18.04 lists SqlPackage but the Windows ones does not. 😕

@al-cheb Aha! Could this be made clearer in the readme?
The Ubuntu18.04 lists SqlPackage but the Windows ones does not. 😕

It's part of DacFx 15.0.5164.1.

@al-cheb I get what you're saying, I just think it's not especially clear.

Getting error on windows-latest and windows-2019

An error occurred trying to start process 'C:\Program Files\PowerShell\7\pwsh.EXE'
with working directory 'C:\Program Files\Microsoft SQL Server\150\DAC\bin\'.
The directory name is invalid.

It worked before. Last time was January 13, 2022.

Getting error on windows-latest and windows-2019

An error occurred trying to start process 'C:\Program Files\PowerShell\7\pwsh.EXE'
with working directory 'C:\Program Files\Microsoft SQL Server\150\DAC\bin\'.
The directory name is invalid.

It worked before, last time was January 13, 2022.

Fixed with https://github.com/marketplace/actions/setup-sqlpackage which has run
C:\ProgramData\Chocolatey\bin\vswhere.exe -find **\SQLDB\**\15*\SqlPackage.exe

and found sqlpackage at
C:\Program Files (x86)\Microsoft Visual Studio\2019\Enterprise\Common7\IDE\Extensions\Microsoft\SQLDB\DAC\150\sqlpackage.exe


Missing country flags

The following reserved ISO-3166-1 country codes do not have the according flag Emoji.
As other reserved country codes have their respective flag included, I'd like to ask for these also being added.
AN (Netherlands Antilles) 🇦🇳
BU (Burma) 🇧🇺
CS (Serbia and Montenegro) 🇨🇸
EZ (Eurozone)
FX (France, Metropolitan) 🇫🇽
NT (Saudi Arabian–Iraqi neutral zone) [maybe half Saudi Arabia, half Iraq] 🇳🇹
SF (Finland) 🇸🇫
SU (USSR) 🇸🇺
TP (East Timor) 🇹🇵
UK (United Kingdom) 🇺🇰
YU (Yugoslavia) 🇾🇺
ZR (Zaire) 🇿🇷

DD and YD are officially deleted and can be re-assigned, so I'd not add them.
QO, QU and ZZ are user-assigned codes so could mean different things, so I'd not add them.
Regarding UK and SF, they are both in neither of the sections in the link you provided, but anyway they are exceptionally reserved codes, so I keep them in the list.
You are right about EZ though, so I added it to the list.

You are right that most of these are just aliases for other entries, yet in my opinion it would make sense to support them. If you e. g. have a software like Discord, that just searches for the matching file, it cannot show the correct flag without a manual mapping that every user of twemoji would have to implement himself. I think it would make more sense if twemoji just also has these flags present like other reserved cases then the user of the lib does not need to do anything special to use them.


[backport - newton-14.0] IT-3581 Add export to RUN_TEMPEST_OPTS and TESTR_OPTS

This is so the openstack_tempest_gate.sh script picks up
these variables when invoked.
Connects https://github.com/rcbops/u-suk-dev/issues/1680
(cherry picked from commit 6591baef015d6be5d541d92b2a1acb39b67161e7)

recheck_cit_ceph
recheck_cit_xenial

recheck_cit_ceph
recheck_cit_xenial

recheck_cit_ceph
recheck_cit_xenial

UPDATE:
Ready for review.


Cannot find package "encoding"….

Hello,
When I try to "make" I get the following error and not sure how to proceed (I'm not a developer - at all…lol). I do not have an "encoding" folder anywhere.
Thanks for any help!
Rob
root@jerSite:~/go/src/github.com/siddontang/go-mysql-elasticsearch# make
godep go build -o bin/go-mysql-elasticsearch ./cmd/go-mysql-elasticsearch
Godeps/_workspace/src/github.com/BurntSushi/toml/encoding_types.go:10:2: cannot find package "encoding" in any of:
/usr/src/pkg/encoding (from $GOROOT)
/root/go/src/github.com/siddontang/go-mysql-elasticsearch/Godeps/_workspace/src/encoding (from $GOPATH)
/root/go/src/encoding
godep: go exit status 1
make: *** [build-elasticsearch] Error 1

encoding is the standard lib in go, do you set GOROOT correctly? e.g, export GOROOT=/usr/local/go or other?


Unable to import owner lookup fields.

Describe the bug
Unable to import owner lookup fields.
To Reproduce
If you include an owner field (for example ownerid on queue) you can't map it to any field on a team (only user) and it does not even map to the default teamid (error when importing).  If you include owneridtype you get an error saving the schema:

Expected behavior
Default mapping to teamid/systemuserid based on value of owneridtype field.  Ability to map owner fields to both user and team fields dependent on value of owneridtype field.
Additional context
Trying to import Team owned Queues.

hi @simes1  we are looking investigating this issue.

Hi @simes1, sorry for the late response. I have actually looked at this issue and you are getting the popup message because you selected the owneridtype attribute while generating the schema file. We currently set the type for this attribute within the generated schema to "Unknow". Hence the reason we display a popup to let you know we are unable to map this attribute type.
My question will be, do you need this field in the schema file. Will the Owner attribute not be sufficient for your schema?
Please let me know if this is satisfactory. We will most likely change the display message to something like - Unable to map attribute EntityNameType for more clarity.
See https://github.com/Capgemini/xrm-datamigration-xrmtoolbox/blob/master/Capgemini.Xrm.CdsDataMigrator/Capgemini.Xrm.CdsDataMigratorLibrary/Core/AttributeTypeMapping.cs
and

For the default mapping: If selecting only owerid will map ownerid's that are either systemuser or team records automatically based on the appropriate systemuserid/teamid that's fine but I think at the moment this only works for users not teams.
For a custom mapping: I need to be able to pick the fields to map to on both Team and User entities.  At the moment I'm only presented with a list of fields for the User entity and not the Team entity but the record could be a User or a Team

Sorry for the delayed update.
Thinking more about this trying to use your tool again today the fundamental problem is that the schema controls what is exported.  If you use a JSON file you have information on the type of entity the lookup refers to but if you use CSV (because it is far easier to manipulate) you are stuck.

hi @simes1  thank you.
your assessment is spot on. we are currently working on a solution for this.

@simes1  the latest fix should address the issue. please let me know it the issue is now fixed.


openroad detailed router crash

Description
Crash at detailed routing.
Environment
python3 ./env.py issue-survey

Kernel: Linux v4.19.0-18-cloud-amd64
Distribution: debian 10
Python: v3.7.3 (OK)
Container Engine: docker v20.10.8 (OK)
OpenLane Git Version: 2022.02.16_01.55.24
pip:click: INSTALLED
pip:pyyaml: INSTALLED
pip:venv: INSTALLED
---
PDK Version Verification Status: OK
---
Git Log (Last 3 Commits)

5a443b5 2022-02-16T02:50:41-08:00 Revert "Remove manual tech mapping of muxes and get abc to map them (#873)" - kareem -  (HEAD -> master)
169346f 2022-02-15T17:15:02+02:00 Remove catch around PDN environment variables (#924) - Anton Blanchard -  (tag: 2022.02.16_01.55.24, origin/master, origin/HEAD)
74b9e10 2022-02-14T22:46:40+02:00 Changes PDK recipe dependency to be order-only (#922) - Teodor-Dumitru Ene -  (tag: 2022.02.15_02.01.39)

Reproduction Material
openroad_issue_reproducible.tar.gz automatically created by openlane.
Expected behavior
An actual error message.
Logs
A section of the detailed router log:
[INFO DRT-0036] via3 guide region query size = 0.
[INFO DRT-0036] met4 guide region query size = 0.
[INFO DRT-0036] via4 guide region query size = 0.
[INFO DRT-0036] met5 guide region query size = 0.
[INFO DRT-0179] Init gr pin query.
[INFO DRT-0185] Post process initialize RPin region query.
Stack trace:
 0# 0x0000000000FD1FE9 in openroad
 1# 0x00007F780053C400 in /lib64/libc.so.6
 2# fr::io::Parser::initRPin_rpin() in openroad
 3# fr::io::Parser::initRPin() in openroad
 4# triton_route::TritonRoute::init(bool) in openroad
 5# triton_route::TritonRoute::main() in openroad
 6# detailed_route_cmd(char const*, char const*, char const*, char const*, char const*, char const*, bool, int, char const*, char const*, int, double, char const*, char const*, int) in openroad
 7# 0x000000000193DC4E in openroad
 8# 0x00007F78034CFEB2 in /lib64/libtcl8.5.so
 9# 0x00007F780351436C in /lib64/libtcl8.5.so
10# TclObjInterpProcCore in /lib64/libtcl8.5.so
11# 0x00007F78034CFEB2 in /lib64/libtcl8.5.so
12# 0x00007F780351436C in /lib64/libtcl8.5.so
13# 0x00007F780351C647 in /lib64/libtcl8.5.so
14# TclEvalObjEx in /lib64/libtcl8.5.so
15# 0x00007F780355727F in /lib64/libtcl8.5.so
16# 0x00007F78034CFEB2 in /lib64/libtcl8.5.so
17# 0x00007F780351436C in /lib64/libtcl8.5.so
18# 0x00007F780351C647 in /lib64/libtcl8.5.so
19# TclEvalObjEx in /lib64/libtcl8.5.so
20# 0x00007F78034D71D0 in /lib64/libtcl8.5.so
21# 0x00007F78034CFEB2 in /lib64/libtcl8.5.so
22# 0x00007F780351436C in /lib64/libtcl8.5.so
23# 0x00007F780351C647 in /lib64/libtcl8.5.so
24# TclEvalObjEx in /lib64/libtcl8.5.so
25# 0x00007F78034DAF00 in /lib64/libtcl8.5.so
26# 0x00007F78034CFEB2 in /lib64/libtcl8.5.so
27# 0x00007F780351436C in /lib64/libtcl8.5.so
28# TclObjInterpProcCore in /lib64/libtcl8.5.so
29# 0x00007F78034CFEB2 in /lib64/libtcl8.5.so
30# 0x00007F780351436C in /lib64/libtcl8.5.so
31# TclObjInterpProcCore in /lib64/libtcl8.5.so
32# 0x00007F78034CFEB2 in /lib64/libtcl8.5.so
33# 0x00007F78034D0F1E in /lib64/libtcl8.5.so
34# Tcl_EvalEx in /lib64/libtcl8.5.so
35# Tcl_Eval in /lib64/libtcl8.5.so
36# sta::sourceTclFile(char const*, bool, bool, Tcl_Interp*) in openroad
37# ord::tclAppInit(Tcl_Interp*) in openroad
38# Tcl_Main in /lib64/libtcl8.5.so
39# main in openroad
40# __libc_start_main in /lib64/libc.so.6
41# 0x0000000000FCE8B7 in openroad
[ERROR]: during executing openroad script /openlane/scripts/openroad/droute.tcl

openroad_issue_reproducible.tar.gz

looking into it

After some debugging here is what I've got:
The problem is in the following nets:

vccd1 ( user1_vssd_lvclamp_pad VCCD1 ) ( user1_vccd_lvclamp_pad VCCD1 ) + USE SIGNAL ;
vccd2 ( user2_vssd_lvclamp_pad VCCD1 ) ( user2_vccd_lvclamp_pad VCCD1 ) + USE SIGNAL ;
vssd1 ( user1_vssd_lvclamp_pad VSSD1 ) ( user1_vccd_lvclamp_pad VSSD1 ) + USE SIGNAL ;
vssd2 ( user2_vssd_lvclamp_pad VSSD1 ) ( user2_vccd_lvclamp_pad VSSD1 ) + USE SIGNAL ;

These nets seem to be power and ground supply nets that are passed to tritonroute through the def as signal nets. TritonRoute does not route power and ground nets. And they should be special nets.These nets should be handled by pdn.
However, I think this problem can be detected in io with an error if that is needed.

Thanks for tracking it down. I will check what went wrong in generating the def. If this is easily detectable, exiting with an error message would be much more helpful.

On second thoughts, I wonder why it crashed in the first place. I agree that it's odd for these nets to be found in the nets section but if, for instance, these nets aren't routable by tritonRoute, shouldn't openroad report that ?

The problem here is that the nets are ill defined. They should be supply nets with the proper use defined. But here they are signal nets having power/ground pins connected to them.
TritonRoute should be able to route signal nets but here it's not really a signal net.
However, if you change the use of the nets to power and ground nets without making them special, it will also crash which should be fixed.

@osamahammad21 please fix the crash you mentioned and also add a warning for any net to be routed that is connected to a mterm that has USE pwr/gnd (presumably that happens in this case).


Respect TRACKER_SCRIPT_NAME while generating tracking code

I love the ability to override the tracker script name via the environment variable TRACKER_SCRIPT_NAME. It works as expected if we manually just replace umami.js with the new name. Wouldn't' it make more sense if we click the button Get tracking code that the generated link respects to the environment variable?
If so, the API should probably also be extended to include the respective tracker script name

I also think it's a good idea, currently I don't know if I gave the name of the script correctly

The problem the app UI does not have access to environment variables. It's only available at build time or through the server functions. I think we can make an API call to get the tracker name if it's really an issue.
@HowWof just run the app and load your tracker by the new name, http://www.yourserver.com/tracker_name.js. If it loads then it works.

The problem the app UI does not have access to environment variables. It's only available at build time or through the server functions.

Is the tracker link generated in the front end? If so, maybe one can introduce kind of a settings api endpoint to receive globalsettings? Or maybe just store this setting in the database instead of an environment variable? The latter approach would also have the benefit that we might be able to change the script name for each website individually.
What do you think?

Fixed in v1.37.0.


☂ [GEP-20] Highly Available Seed and Shoot Clusters

How to categorize this issue?

/area high-availability
/kind enhancement
What would you like to be added:
This is an umbrella issue to track the implementation of GEP-20 Highly Available Shoot Control Planes.

[x] provider-vsphere: https://github.com/gardener/gardener-extension-provider-vsphere/pull/321, released with v1.23.0
[x] provider-aws: https://github.com/gardener/gardener-extension-provider-aws/pull/645, released with v1.41.0
[x] provider-gcp: https://github.com/gardener/gardener-extension-provider-gcp/pull/521, released with v?
[x] provider-azure: https://github.com/gardener/gardener-extension-provider-azure/pull/599, released with v1.33.0
[x] provider-alicloud: https://github.com/gardener/gardener-extension-provider-alicloud/pull/545, released with v1.43.0
[x] networking-cilium: https://github.com/gardener/gardener-extension-networking-cilium/pull/138, released with v1.20.0
[x] networking-calico: https://github.com/gardener/gardener-extension-networking-calico/pull/222, released with v1.28.0
[x] shoot-networking-filter: https://github.com/gardener/gardener-extension-shoot-networking-filter/pull/41, released with v0.9.0
[x] shoot-networking-problem-detector: https://github.com/gardener/gardener-extension-shoot-networking-problemdetector/pull/37, released with v0.9.0
[x] os-ubuntu: https://github.com/gardener/gardener-extension-os-ubuntu/pull/72, released with v1.20.0
[x] os-gardenlinux: https://github.com/gardener/gardener-extension-os-gardenlinux/pull/70, released with v0.16.0
[x] os-suse-chost: https://github.com/gardener/gardener-extension-os-suse-chost/pull/76, released with v1.20.0
[ ] os-coreos: https://github.com/gardener/gardener-extension-os-coreos/pull/52, released with v?
[x] shoot-dns-service: https://github.com/gardener/gardener-extension-shoot-dns-service/pull/170, released with v1.28.0
[x] shoot-cert-service: https://github.com/gardener/gardener-extension-shoot-cert-service/pull/138, released with v1.27.0
[x] shoot-oidc-service: https://github.com/gardener/gardener-extension-shoot-oidc-service/pull/75, released with v0.15.0
[x] runtime-gvisor: https://github.com/gardener/gardener-extension-runtime-gvisor/pull/66, released with v0.7.0
[x] registry-cache: https://github.com/gardener/gardener-extension-registry-cache/pull/5, released with v0.1.0
[x] auditlog-extension: kubernetes/auditlog-extension#388, released with v?

[ ] Drop support for alpha.control-plane.shoot.gardener.cloud/high-availability annotation

https://github.com/gardener/gardener/pull/6998
Remove annotation entirely from code after v1.63 got released

[x] https://github.com/gardener/gardener/pull/7403
[ ] Support control-plane migration for HA shoots
[x] https://github.com/gardener/gardener/issues/7224

Future Work

Promote HAControlPlanes feature gate as soon as CPM is supported.

/assign
/assign @timuthy

[ ] Introduce shoot spec field for enabling HA control planes
Add validations for updating the shoot.spec.controlPlanes field

[ ] Allow non-HA shoot -> HA shoot
[ ] Only allow non-HA -> multi-zone if assigned seed is multi-zonal
[ ] Single-zone HA shoot <-> multi-zone HA shoot must not be allowed
[ ] HA shoot -> non-HA shoot must not be allowed (until etcd scale-down is implemented)

@unmarshall  shall work on this as -- It needs changes and then a test. So we need to relook at the efforts.
Seed needs changes which are not yet part of GEP -> GEP enhancement PR | Implementation--> Review  (5 Days)
We reprioritized --

[ ] Support zone-pinning for single-zone control HA planes (via GRM mutating webhook)
@timuthy  shall be working

Below bullet points highlight the api contract for introducing HA control planes  via -
  controlPlane:
    highAvailability:
      failureTolerance:
        type:  <node|zone>

non-HA shoots can be scheduled on non-HA or HA(multi-zone) seeds.
single-zone (faultTolernaceType: node ) shoots can be scheduled on non-HA or HA(multi-zone) seeds.
multi-zone(faultTolernaceType: zone ) shoots can only be scheduled ONLY on HA(multi-zone) seeds.
non-HA shoots can be upgraded to single-zone(faultTolernaceType: node )  on non-HA or HA seeds **
non-HA shoots can be upgraded to multi-zone(faultTolernaceType: zone ) with minimal disonly on HA **
single-zone shoots can not be upgraded to multi-node shoots and shall be stopped at the time of shoot validation.

**  this can lead to a short disruption|downtime when etcd sts is rolled

Legend:
non-HA shoot : any shoot which is currently running without the faultTolerance yet defined
single-zone shoot: any shoot which has faultTolerance defined as type node
multi-zone shoot: any shoot which has faultTolerance defined as type zone
non-HA seed: any seed which has worker pools for etcd/cpu running only on a single availability zone
HA seed: any seed which has worker pools for etcd/cpu defined across 3 availability zones

Wrt to Enhance Pod eviction in case of zone outage (delete Pods in Terminating state): for Deployments the kube-controller-manager behaviour is to create new Pods right away when the old Pods are Terminating.
Example:

Expand to see the Deployment!
apiVersion: apps/v1
kind: Deployment
metadata:
  name: nginx-deployment
  labels:
    app: nginx
spec:
  replicas: 1
  selector:
    matchLabels:
      app: nginx
  template:
    metadata:
      labels:
        app: nginx
    spec:
      terminationGracePeriodSeconds: 60
      containers:
      - name: nginx
        image: centos
        command: ["/bin/sh"]
        args: ["-c", "sleep 3600"]
        ports:
        - containerPort: 80

Above we have a Deployment. Its container does not handle SIGTERM and it will hang in Terminating until it is force killed after terminationGracePeriodSeconds.
$ k get po
NAME                                READY   STATUS    RESTARTS   AGE
nginx-deployment-746759f465-z95lj   1/1     Running   0          11m

$ k delete po nginx-deployment-746759f465-z95lj
pod "nginx-deployment-746759f465-z95lj" deleted

$ k get po
NAME                                READY   STATUS              RESTARTS   AGE
nginx-deployment-746759f465-z95lj   1/1     Terminating         0          11m
nginx-deployment-746759f465-ztz65   0/1     ContainerCreating   0          2s

$ k get po
NAME                                READY   STATUS        RESTARTS   AGE
nginx-deployment-746759f465-z95lj   1/1     Terminating   0          12m
nginx-deployment-746759f465-ztz65   1/1     Running       0          54s

Above you can see that when old replica is deleted, the new one is created right away.

I suspect that in the experiments of @unmarshall (ref https://github.com/gardener/gardener/pull/6287#discussion_r942324110) there was a webhook preventing creation of new Pods (for some unknown reason) or kube-controller-manager was down (for some unknown reason). These are the 2 potential things that could explain https://github.com/gardener/gardener/pull/6287#discussion_r942324110.
Anyways, I will try to simulate a zone outage and check why KCM does not create the new Pods when the old one are terminating.

We had a sync @unmarshall and we able to confirm that in a simulation of zone outage (simulated via network acl that denies all ingress and egress traffic for a zone) the recovery for a multi-zone control plane worked as outlined in https://github.com/gardener/gardener/issues/6529#issuecomment-1253517049:

For Deployments kube-controller-manager creates new replicas right away when the old replicas are terminating. The new replicas start successfully on a healthy zone.
We also found that the garbage-collector already delete

We had a sync @unmarshall and we are able to confirm that in a simulation of zone outage (simulated via network acl that denies all ingress and egress traffic for a zone) the recovery for a (multi-zone) control plane worked well as outlined in https://github.com/gardener/gardener/issues/6529#issuecomment-1253517049:

For Deployments kube-controller-manager creates new replicas right away when the old replicas are terminating. The new replicas start successfully on a healthy zone.
I think during @unmarshall's simulations kube-controller-manager was down for some reason. I also revised the webhooks we deploy and whether we could have a deadlock situation that could block new Pod creation but I didn't see anything abnormal.

PS: We also found that the existing garbage-collector (shoot-care-controller of gardenlet) already deletes Terminating pods in the Shoot's control plane after 5min.
https://github.com/gardener/gardener/blob/24b667c39f4ff1c6e733ce98816e4f6127a2476f/pkg/operation/care/garbage_collection.go#L85-L93
But this is not a recovery mechanism and does not bring to the recovery. For Deployments kube-controller-manager already creates the new replicas. For StatefulSets, even when the old Terminating replicas are forcefully deleted, this does not lead to a recovery as the new StatefulSet Pods fail to be scheduled - they have scheduling requirements that cannot be satisfied during the zone outage (etcd Pod to run on the outage zone or loki/prometheus Pods to run on the outage zone because their volume is already on provisioned on this zone).
TL;DR: We will resolve the corresponding item as completed as nothing has to be done. Let us know if you have additional comments on this topic. We have to update GEP-20 with the new learnings.

Great to hear! Thank you!

I added another item Support control-plane migration for HA shoots since this doesn't seem to work out of the box. We should create a separate issue once we have more certainty and details and find a proper way to support this use-case.
cc @plkokanov @vlerenc

/assign @rfranzke
for the tasks related to

Configure high-availability settings for {seed system, shoot control plane, shoot system} components

(except for the Remainders/special cases)

All related PRs in gardener/gardener have been merged.
/unassign

/assign @plkokanov @ishan16696
for tasks related to

Support control-plane migration for HA shoots

/assign @plkokanov @ishan16696
for tasks related to

Please see the approaches possible to achieve CPM in multi-node etcd: https://github.com/gardener/etcd-druid/issues/479#issuecomment-1365793557

All tasks have been completed.
/close


hello, i am using johnny-five and the problem is how to close the serial port which is already opend?

What are the steps to reproduce?
What happens?
What do you expect to happen?
Please tell us about your environment:

[x] Node-RED version:
[x] node.js version:
[ ] npm version:
[ ] Platform/OS:
[ ] Browser:

Node-RED version: v0.18.2
10 Feb 10:36:31 - [info] Node.js  version: v8.9.3

10 Feb 10:38:17 - [info] Server now running at http://<IP_ADDRESS>:1880/
10 Feb 10:38:17 - [info] Starting flows
1518239297361 Connected COM6
10 Feb 10:38:17 - [info] Started flows
1518239300312 Repl Initialized

10 Feb 10:38:33 - [info] Stopping flows
10 Feb 10:38:33 - [info] Stopped flows
10 Feb 10:38:33 - [info] Starting flows
1518239313152 Connected COM6
10 Feb 10:38:33 - [info] Started flows
1518239313157 Error Opening COM6: Access denied
(node:12788) UnhandledPromiseRejectionWarning: Unhandled promise rejection (rejection id: 1): Error: Unhandled "error" event. ([object Object])
(node:12788) [DEP0018] DeprecationWarning: Unhandled promise rejections are deprecated. In the future, promise rejections that are not handled will terminate the Node.js process with a non-zero exit code.
1518239323160 Device or Firmware Error A timeout occurred while connecting to the Board.

Please check that you've properly flashed the board with the correct firmware.
See: https://github.com/rwaldron/johnny-five/wiki/Getting-Started#trouble-shooting
If connecting to a Leonardo or Leonardo clone, press the 'Reset' button on the board, wait approximately 11 seconds for complete reset, then run your program again.
10 Feb 10:38:43 - [red] Uncaught Exception:
10 Feb 10:38:43 - Error: Unhandled "error" event. ([object Object])
at Board.emit (events.js:186:19)
at Board.log (C:\Users\om\Desktop\custom nodes\node_modules\johnny-five\lib\board.js:630:8)
at Board.(anonymous function) [as error] (C:\Users\om\Desktop\custom nodes\node_modules\johnny-five\lib\board.js:641:14)
at Board. (C:\Users\om\Desktop\custom nodes\node_modules\johnny-five\lib\board.js:385:14)
at ontimeout (timers.js:475:11)
at tryOnTimeout (timers.js:310:5)
at Timer.listOnTimeout (timers.js:270:5)

this error popped out when I redeploy the node red flow

Hi, thanks for raising an issue. However this is not an issue with the core of Node-RED.
If you check out our contribution guidelines you'll see we prefer to handle this sort of thing on the mailing list, slack team or you could ask a question on Stack Overflow and tag it node-red. That way the whole Node-RED user community can help, rather than rely on the core development team.
Thanks!


Create Prachis First File

This file is created to understand and learn the use of Git and Github
I am now trying to understand the Create pull request

I am now trying to confirm the merge


Non-Deterministic CSS ordering for extracted CSS in an SSR App

Version
2.5.17
Reproduction link
https://github.com/brophdawg11/vue-ssr-css-ordering
Steps to reproduce
Reproduction steps are outlined in the README in the github repo.
What is expected?
In both development and production builds, the extracted CSS stylesheets should be loaded in a deterministic order.
I believe from reading various semi-related github issues that the order corresponds with the import order via webpack.  If that is the case for SSR as well, I would expect the order to be app.css -> home.css -> about.css since the App.vue file is loaded statically, and Home.vue and About.vue are loaded dynamically via routes in that order.
Either way, I would expect global styles from App.vue to always be loaded first, followed by dynamic-route styles, allowing for a proper cascade.
What is actually happening?
I think there are two issues at play:
Primary Issue: In development mode, the app.css file is incorrectly loaded after the about.css file, breaking the cascade for contents of About.vue.
Secondary Issue: In production mode, the app.css file is properly loaded first, but then about.css is loaded prior to home.css even though they are imported in the reverse order and even when SSR-ing the home page.

Additional Notes
I'm trying to determine what feels like the optimal solution, and I think there are a few options, in a loose descending order of "optimal", and likely increasing order of feasibility:

Global styles from the root App.vue component would always be loaded first, followed by the only the styles for the component matched for the current route.  Additional route-specific styles would be loaded on demand when routing.  I understand this is likely beyond the scope of the bundle renderer and potentially something to be implemented by the application itself.
Global styles from the root App.vue component would always be loaded first, followed by styles for the current route-component, followed by styles for additional route-components.
Global styles from the root App.vue component would always be loaded first, followed by styles for route-level components, in import-order (i.e., in route-declaration order)

It is also worth noting that my specific scenario in my larger app is slightly different, but I wasn't able to quite reproduce it exactly in this minimal repo, and I'm not quite sure why.  In my specific app case, I have an App.vue and 3 dynamic routes defined in the order:

Home
Page 1
Page 2

In development mode, my stylesheets are included in the order:   page1, app, home, page2.
In production mode, my stylesheets are included in the order:   home, page1, page2, app
So in the demo repo, the production build is correct insofar as it doesn't break the cascade for either route, and the development build is incorrect for only one of the routes.
In my actual app, the development mode only breaks the cascade for the page1 route, while the production build breaks it for all routes.

I think the only workaround available at the moment is to set inject:false on the bundle renderer and manually insert these into the template in the proper order by reading them from the client manifest?  I assume that even using renderStyles from https://ssr.vuejs.org/guide/build-config.html#manual-asset-injection would result in the same ordering issues?

VUE-SSR does not seem to support CSS asynchronous chunk loading

that problem was fixed in v2.5.18-beta.0 - #7902

Non-Deterministic CSS ordering for extracted CSS in an SSR App

I have the same issue in 2.5.22

This seems to have been resolved for me in 2.5.22 but another issue has surfaced.  I have updated the reproduction repo to show the new issue.

The prior commit (https://github.com/brophdawg11/vue-ssr-css-ordering/commit/94fbd4dcc02d3666ee9434babc407c8b1f3911d4) had the issue of dev builds breaking the cascade by loading app.css after the route-specific CSS chunk.
That specific issue seems to be fixed by upgrading to 2.5.22, so running the newer commit (https://github.com/brophdawg11/vue-ssr-css-ordering/commit/11d32d0531c8156f685bb125d3a3a0fb40498591) doesn't suffer that problem.

However, on 2.5.22, the bundle renderer includes 2 <link type="stylesheet"> tags for app.css in dev builds.  We're seeing this in our app locally, however we're getting 2 app.css files in both dev and production builds on 2.5.22.
I am going to upgrade the reproduction repo to the latest 2.6 release now and see if that changes anything.

Still seeing the same issue in 2.6.6 - the dev builds include two <link rel="stylesheet"> tags for app.css.  See https://github.com/brophdawg11/vue-ssr-css-ordering/commit/2b2acf3a0ee17d298d2fbd12d6d15e4376d99183.
I will need to dig in further as to what's different in my app such that the bundler renderer gives us two app.css tags in both dev and prod builds.

@brophdawg11
I also encountered the same problem, this bug has been fixed in<EMAIL_ADDRESS>see https://github.com/vuejs/vue/pull/9677


Expose decode in the public API

Based on #111.

Codecov Report

Merging #112 (6cc3c5d) into master (05435af) will decrease coverage by 0.56%.
The diff coverage is 100.00%.

@@            Coverage Diff             @@
##           master     #112      +/-   ##
==========================================
- Coverage   95.03%   94.46%   -0.57%
==========================================
  Files           6        6
  Lines         705      705
==========================================
- Hits          670      666       -4
- Misses         35       39       +4

Impacted Files
Coverage Δ

src/ur.rs
100.00% <100.00%> (ø)

src/fountain.rs
91.64% <0.00%> (-0.99%)
:arrow_down:

:mega: Codecov can now indicate which changes are the most critical in Pull Requests. Learn more


Linear Algebra Data Types

Does TiKV support Vector data for Linear algebra.
I'm evaluating whether we could use TiKV/TiSpark/TiDB for serving queries from our machine learning models. We do alot of vector based similarity searching etc, using things like cosine similarity over vectors, matrices etc.
We use Apache MadLib with Postgres, and PrestoDB for serving these types of queries also.
Regards

@mickdelaney I'm not quite familiar with ML stuff.
What concrete type did you use for PrestoDB or PG cases? Is it an Array?
If so, I think the best of hope for now is using blob type with UDF to unpack it to an array. After reading, the rest of the part works like native.

We use an array of Array of double & we initially used the consine_similarity function here: https://prestodb.io/docs/current/functions/math.html
but ended up with our own function:
reduce(
zip_with(
ARRAY{target_vector_array_str},
vector,
(x, y) -> x * y
),
0.0,
(s, x) -> s + x, s -> s
)

target_vector_array_str something like:
ARRAY[0.498103843558768,0.08470424978456259,0.2631435350302188,0.3934188650368525,0.4179578779765668,0.22149724486477518,0.36467130787458213,0.29915134858963544,0.3102449968870319,0.10450888521174573,0.1144633380455341,0.7249993533682562,0.9376279741266519,0.8435073548308901,0.08656169804061176,0.7983901865864684,0.34760616480970263,0.711228375236424,0.6067116548656752,0.1671451046068596,0.5238343261772648,0.768364552959512,0.22740564425593668,0.9923396498847372,0.4820261494378488,0.7814718321813844,0.4859395897077362,0.5109053056286057,0.8920726571156377,0.6613205707775118,0.2994844672509577,0.6775766385619625,0.0524254302557402,0.17000252715590747,0.08279853272694337,0.7976964895507386,0.2586232578193133,0.5407438889952781,0.6549528116330233,0.6585051307117313,0.6694116153560906,0.11112823968034669,0.6929745773941535,0.7625513030032638,0.30362664611197454,0.993784304510347,0.5039916460429245,0.30495787424884246,0.922660665443317,0.5822732264340533,0.9978645334148264,0.8966122463756533,0.745005421888669,0.40052658053165513,0.1727340595716318,0.21089643062392915,0.41589151111196954,0.21585434572326423,0.8212737710293209,0.895693583478337,0.1814341729865825,0.19243925728357913,0.5249868201575476,0.23593429840540492,0.25936553278656527,0.13798700336230074,0.09717785695559777,0.5745907963176073,0.6079362603124165,0.8535843809645556,0.325915063211921,0.7878862046579876,0.710991150012541,0.33941332216043274,0.671156071596836,0.8025884125600424,0.015486353786243634,0.40600149308076705,0.9545291636519525,0.3101664816405325,0.16285335602143713,0.08193663493110792,0.6321133051709148,0.33324381318595475,0.05323827043132834,0.700759092635583,0.08080693076042611,0.3369350769502475,0.5190947234732006,0.2243534811686967,0.5104501621908052,0.3554355426136493,0.12142208071098515,0.3513549797305152,0.9311402509631613,0.8545331855812813,0.894939905279927,0.03778353645036603,0.7235491785936249,0.16761646130080254]

@ilovesoup does the above make sense to you ? is it something you think might be wrapped into the TI* products ?

thanks for clarifying.
regards


DevOps: upload project to PyPi

Make the project publicly installable with pip, by uploading the project to PyPi

Add:

[ ] Instructions for installation in README
[ ] Add more project details to setup.cfg


Simulate Gas for Inputs, and deduct fees when swapping using the MAX button [500 USDC Reward!]

🐛 Bug Bounty: Fix Needed! 🛠
Reward: 🏆 500 USDC 🏆
We are excited to announce a bug bounty for third-party developers! If you've got the skills and know-how, here's your chance to earn some 💸 and contribute to our project.
Issue Description 📄
Improve the existing fee estimation method by integrating on our inputs Keplr's gas simulation implementation or something similar. It should leverage the gas and fee configuration to precisely calculate the necessary transaction fee, taking into account input values. This enhancement aims to offer a more accurate and efficient way to estimate transaction costs, providing a better experience for users.
Requirements

Integrate Keplr Gas Simulation: Use Keplr's gas simulation to compute the gas costs based on the current gas and fee configurations. Ensure compatibility with our existing system.
Handle Input Values: Adapt the function to consider input values in the fee estimation. Evaluate how these values might affect the transaction cost and incorporate them into the calculation.
Provide Documentation: Update existing inline documentation (TSDoc) to reflect the changes and new functionalities. Include examples and use cases to assist developers in utilizing the enhanced function.
Acceptance Criteria

Successful integration of Keplr's gas simulation or something similar into the fee estimation process.
Accurate calculation of transaction fees, considering input values and configurations.
Compatibility with existing functionality and systems.
Comprehensive documentation for the new implementation.

Risks/Considerations

Potential compatibility issues with Keplr's gas simulation.
Complexity in handling various input values and configurations.
Ensuring that the enhancement doesn't introduce unexpected behaviors in existing functionalities.

Dependencies

Access to Keplr's GasSimulator class.
Use GasConfig and FeeConfig to seamlessly handle conversion between gas and fee.

Examples

Keplr's useIBCTransferConfig to see how GasSimulator can be used with AmountConfig.
Keplr's IBC transfer implementation to see how to handle loading states with the gas simulator

Possible Integration Steps

Update our existing individual account stores to include new methods named makeTx. These methods will be responsible for composing a transaction. The composed transaction object should offer flexibility by providing both simulate and send functions, allowing developers to decide the desired operation on the transaction.
In other words, the makeTx the method will create a transaction object, and within that object, developers will have the option to either simulate the transaction to see potential outcomes or send it to execute the actual transaction. This dual functionality within the composed transaction object provides greater control and flexibility.

Look for all useFakeFeeConfig  and update the configs to use the gas simulator.

Handle loading states by setting a loading indicator when users press max/half.

Requirements for the Bounty 🏁
Submit a pull request with a verified fix to the issue.
The fix should not introduce any new bugs or vulnerabilities.
Code should follow our project's style and contribution guidelines.
Your solution will be reviewed by our team, and the bounty will be awarded upon approval.
How to Claim Your Bounty 💰
Fork our repository.
Create a new branch for your fix.
Submit a pull request to our main branch.
Include detailed information about your fix and how it addresses the issue.
Once reviewed and merged, the 500 USDC will be transferred to your wallet.
We look forward to your contributions and thank you for helping improve our project!
Please Note: All bounty claimants must undergo a KYC (Know Your Customer) process with our finance team to receive the reward. This is a mandatory step to ensure compliance with financial regulations.
PLEASE ALLOW 1 MONTH FOR PAYMENT TO BE RENDERED.

@MaxMillington Can I work on this?

@Temidayo32 of course! Thanks!

Hey, I see this bounty is not assigned, I have relevent experience in the past and would like to work on this bounty

@skushagra9 feel free! Thanks !

Hey @MaxMillington is this bounty and the others still available?

@ManyRios still available

@MaxMillington
this work is still available?

@forbesus this one was completed. I'll close now. Thanks!


chore: Update package.json

Preview: https://react-component-groups-pr-component-groups-501.surge.sh


Request for an API similar to onFocus to track focus events within the editor

I wonder if there has an API that  can allow developers to listen for focus events that occur within the editor and provide information such as the focus position and surrounding context.

You can build your own plugin for that purpose and tap into the Lexical API. The core plugin does something similar for the selection, you can start tracing the logic from here.


Could you please update your tutorial for ros integration?

the demo is using ros1, turtlebot1 and python 2.7,  which are all out of date.
By using miniconda env based on python2.7, you even can not properly install igibson2!!

iGibson in its current form is not compatible with Python 2.7. We are looking into re-enabling backwards compatibility, but are you able to switch to a Python 3 version of ROS? Would updating the tutorial to work with that be helpful for you?

that would be of great favor for me.

@cgokmen and @MRWANG995 We have integrated ROS noetic (Python 3) with igibson 2. We are able to run the robot with move_base ROS navigation stack (Turtlebot and Fetch). Let us know if you need any help. We will happy to share our learnings with you :) . It may also help you to update the tutorial. Let us know :)

Hi @vbalaji21 , please, try the new version we just released and tell us whether it presents any problem with you. Thanks!

The release has not gone through yet - we'll push today. Will update here.

@roberto-martinmartin and @cgokmen . Thanks a lot for letting me know. Please update me once it is pushed, I will try it out.
This week, I had some problems with loading Pedestrians. I made some fixes and it is working now. I am not sure whether that is also taken into account in the new release. If not, I can share you the fixes I did. My aim (along with Prof. Rachid and Phanu Teja in LAAS, CNRS) is to study human aware social navigation and later extend with learning capabilities.
My next 2 steps are -

Check VR immersion of human and arm (head data) to conduct user studies with our planner
Import a UAV into iGibson

We are considering iGibson as our potential future platform for most of our development. We are hoping to do the above tasks as soon as possible and continue our development. We would be very happy to get any information or help on these 2 tasks.

We definitely have well-maintained and functional VR capability right now (this is the feature we ourselves have used the most). You can try the VR demo in https://github.com/StanfordVL/iGibson/blob/master/igibson/examples/vr/vr_simple_demo.py using a SteamVR-installed computer (this demo was tested using a HTC Vive headset and Valve Index controller but I believe we support most devices).
As for the UAV we also have https://github.com/StanfordVL/iGibson/blob/master/igibson/robots/legacy/quadrotor_robot.py but this is a not-so-realistic quadrotor that used to be functional but is currently not maintained (e.g. it will probably take some code editing to make it work with the new Robot interface). Should be simple enough - the above file should end up looking like this one: https://github.com/StanfordVL/iGibson/blob/master/igibson/robots/ant.py

Oh, also https://github.com/utiasDSL/gym-pybullet-drones has some interesting pybullet-based UAV simulation stuff (dynamics, control) that perhaps you could try using on top of iGibson (most of the code should be compatible and not too hard to hook up)

We have just cut the release for iGibson 2.2.0 - please let us know if you need anything else, and feel free to reopen this thread if you have any further questions.

Thanks a lot for the update and suggestions regarding UAV and VR.
I have 2 questions -

How to make any robot visible in REGISTERED_ROBOTS? I haave attached a screenshot of this error. Please let me know.

I tried importing UAV hector_quadcopter https://github.com/tu-darmstadt-ros-pkg/hector_quadrotor yesterday from here.
It is on ROS kinetic but tried porting it for ROS noetic.
I found that the controller classes for UAV needs to be ported.
I did not find controller classes for UAV in iGibson 1.0 as well.
I saw that you are using locomotion robot class and basecontroller for UAV if I am correct.

Does your comment on the realistic/functionality of Quadrotor mean that it doesn't work properly in iGibson 1.0 or the controller is primitive to make the Quadrotor work realistically ?

Thanks a lot for your comment about the Quadrorot/UAV suggestion. It will save a lot of time for us in the decision :)

Hi @vbalaji21 , please, try the new version we just released and tell us whether it presents any problem with you. Thanks!

@roberto-martinmartin and @cgokmen , I tried the new version by installing iGibson in the compiling from source method but it failed to build in pip install -e .   com

Let me know
mand.
I have attached the error log screenshot below.

could it be that you didn't git clone recursively?

@roberto-martinmartin Thank you the problem was indeed I didn't do git clone recursively.
I have another doubt, I followed the instructions but I did not understand about the Python Path step as it has 4 paths and I don't know in which file I need to update them. Can you please let me know ?
I think I am facing this problem with the path (Python path).
I have attached the screenshot below.


'JavaScript is required'

When I attempt to run the source code I get the error 'JavaScript is required'. This occurs for both the server and the Client

The client makes heavy use of TypeScript. Make sure you have compiled the scripts (run tsc in the TableturfBattleClient directory) and the build was successful. This will create the main JavaScript file that the app uses. It will also be necessary to create config/config.js with contents similar to this one and provide the assets/external directory (favicon and fonts) which isn't included in this repository because of copyright.
Also make sure your browser is one of the supported browsers, it's reasonably up to date, and it isn't blocking JavaScript. Supported browsers are Chrome, Edge, Firefox, Safari and Opera. Notably, Internet Explorer is not supported.
Though, how are you running the server? That's a .NET app and doesn't use JavaScript at all.

I realize now that I accidentally ran the client twice. I have built the client with the tsc command but I still get the same error. Also, how can I run the server? Thanks.

The server is a .NET application, so you can run it using the dotnet run command. By default, it listens on localhost only; for testing purposes, you can use the --open command line argument to listen on all IP addresses. However, the live server is run through an Nginx reverse proxy.
You can check the console in your browser's developer tools to see whether there are still errors loading the client. It could mean that config/config.js or another asset is missing. You can use the live server as an example for that.


Adds the missing avg_zero consolidation method

Codecov Report

Merging #2342 into master will decrease coverage by 0.02%.
The diff coverage is 0%.

@@            Coverage Diff             @@
##           master    #2342      +/-   ##
==========================================
- Coverage   79.55%   79.52%   -0.03%
==========================================
  Files          85       85
  Lines        8863     8866       +3
  Branches     1899     1901       +2
==========================================
  Hits         7051     7051
- Misses       1551     1553       +2
- Partials      261      262       +1

Impacted Files
Coverage Δ

webapp/graphite/readers/utils.py
95.38% <0%> (-4.62%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update c96420c...d62b863. Read the comment docs.

There is an existing PR for this #2338, see the commentary there for what else is needed if you want to expand this PR


[FBcode->GH] Fix pytorch/vision/test:torchvision_models test_maskrcnn_resnet50_fpn_cuda

Summary:
This test is consistently failing or being skipped / omitted: https://www.internalfb.com/intern/test/562949978742689?ref_report_id=0
Some models are known to be flaky with autocast so we just ignore the check, as with other models
Reviewed By: fmassa
Differential Revision: D27791576

@NicolasHug Closing because it is not possible to merge manually on fbsync branch. Also the changes you are trying to bring in are already available on the fbsync by https://github.com/pytorch/vision/commit/e1b9ae2122b22f17e90899733fe39031ff3a64c7
If your intention for this PR was to merge to master, please reopen and change the target branch.

@NicolasHug It's worth closing this PR and opening a new one by starting with master and cherrypicking the specific hash commit from fbsync (check wiki guide for details)... This PR seems bodged as it tries to modify ~500 files.


'BigUInt' is ambiguous for type lookup in this conte

From @zyqiong on August 31, 2018 11:48
after pod update,this error is shown:'BigUInt' is ambiguous for type lookup in this conte
Copied from original issue: BANKEX/web3swift#218

Beta version of CocoaPods doesn't work for me. Ended up using this:
import struct BigInt.BigUInt
instead of:
`import BigInt

Seems that everything is ok, so its closed


fix: fix a problem with Kotlin type inference and the serialization of the Any type

This PR fixed a problem related to the machinery created in order to let Kotlin infer a default type when the platform doesn't use a specific type like State or Communication.
val platform = pulverizationPlatform(config) {
  sensorsLogic(DeviceSensors(), ::deviceSensorLogic)
  actuatorsLogic(DeviceActuators(), ::deviceActuatorLogic)
  // Other configs
}

The code above fails to compile due to the extensions method that lets Kotlin infer the suitable types. This approach fixes the default type on the first method call and, in this example, the actuatorsLogic could not be invoked.
This PR relaxes the automatic inference machinery, forcing the user to specify the default type (likely Any because Nothing can't be inlined) and resolve the issue where the Any type cannot be serialized; but since the default type is not used by the platform, give Any as default type is safe.
With this PR the code above should be changed as:
val platform = pulverizationPlatform<Any, Any, Int, Double, Unit>(config) {
  sensorsLogic(DeviceSensors(), ::deviceSensorLogic)
  actuatorsLogic(DeviceActuators(), ::deviceActuatorLogic)
  // Other configs
}

Codecov Report

Merging #90 (ab2d0b0) into master (e6e0410) will increase coverage by 2.09%.
The diff coverage is 78.04%.

@@            Coverage Diff             @@
##           master      #90      +/-   ##
==========================================
+ Coverage   68.22%   70.31%   +2.09%
==========================================
  Files          22       22
  Lines         343      347       +4
  Branches       56       57       +1
==========================================
+ Hits          234      244      +10
+ Misses         91       85       -6
  Partials       18       18

Flag
Coverage Δ

unittests
70.31% <78.04%> (+2.09%)
:arrow_up:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

...tion/runtime/componentsref/ComponentsRefManager.kt
42.85% <0.00%> (ø)

...rization/runtime/componentsref/CommunicationRef.kt
50.00% <25.00%> (ø)

...li/pulverization/runtime/componentsref/StateRef.kt
55.55% <25.00%> (ø)

.../pulverization/runtime/dsl/PulverizationRuntime.kt
84.04% <92.85%> (+7.37%)
:arrow_up:

.../nicolasfarabegoli/pulverization/core/Behaviour.kt
85.71% <100.00%> (ø)

...olasfarabegoli/pulverization/core/Communication.kt
50.00% <100.00%> (ø)

...n/it/nicolasfarabegoli/pulverization/core/State.kt
50.00% <100.00%> (ø)

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more


Fix :dir selectors with nested custom elements

Fixes #4966

@kevinpschaaf fixes case where other-element:dir(rtl){} was being rewritten to other-:host([dir="rtl"]) element{}


Suggestion: support finding references in MDX

It's be great if knip supported .mdx files which are used by Storybook and other documentation generators. In our project, there are a few internal-facing exports that are referenced only in our docs but don't (currently) have runtime code accessing them.
A good example of this is a color palette, where we export categories of colors (reds, greens, etc.) so our dev docs can show a well-arranged palette page in the docs for our team members to choose from. But no actual code in our project imports greens. Instead, we import individual colors. But greens is not an unused export, because it's used by our docs.
Other than for documentation, AFAIK MDX is also sometimes used more generally as a low-cost way to generate mostly-static content.

There's a built-in compiler for MDX files, but it's currently limited to being auto-enabled only if @mdx-js/mdx or astro is in the list of dependencies (source code).
I guess we can add a dependency to the list of "enablers" here. What should that be? Some Storybook plugin?
To enable it today (without waiting for a fix in v4). In Knip v3, this was how you had to add it explicitly, and this should still work in v4:
https://knip.dev/v3/features/compilers#mdx
You can use any MDX compiler instead of the suggested one in the example (or even a regex like the other examples on the same page). Or copy the regex from Knip source code.

It looks like Storybook supports MDX without the need of any subpackage, so the dependency to add could just be storybook.

Going to close this one:

the mdx compiler is auto-activated if @mdx-js/mdx or astro is listed
Writing stories directly in MDX was removed in Storybook 8

There's still the option to use different/custom compiler.

@webpro Writing stories in MDX was removed but writing docs for you storybooks in MDX is very much still in place.

Currently the mdx compiler has only two "enablers": @mdx-js/mdx and astro (https://github.com/webpro-nl/knip/blob/main/packages/knip/src/compilers/mdx.ts). Please open a pull request if you think that list should be extended, so more users can benefit.
The manual option is to add the one from your project: https://knip.dev/features/compilers
Not familiar with any context/project, so here's a pseudo example (can be sync or async function):
import { compile } from 'lib-that-has-the-mdx-compiler';

export default {
  mdx: (text: string, filePath: string) => compile(text)
}

@webpro
I figured out a way to manually enable the built-in MDX compiler:
// knip.config.ts
import mdx from 'knip/dist/compilers/mdx';

const config: KnipConfig = {
  // Manually enable built-in MDX compiler
  compilers: {
    mdx: mdx.compiler,
  },
};

Also created https://github.com/webpro-nl/knip/pull/875 to update the doc and the dependency list

I figured out a way to manually enable the built-in MDX compiler:

Ha cool hack, let's get rid of it with the next release, really appreciate your PR!


NO_SYS_TYPES_H isn't defined anywhere, stop using it as a guard

This is a vestige from pre-1.1.0 OpenSSL

Subtitle:  Oh looky here what I found!

Merged.
master: b379fe6cd0
1.1.0: 568a5210e0


Please add dark theme feature for webpages too

@ganesh903 as part of the Contribution guidelines state this belongs to Github Discussions.
There's also a discussion there about this very topic https://github.com/duckduckgo/Android/discussions/1180, so I'll close this one out.