Triggers are getting blocked permanently

Dear Quartz Team,
We are using Quartz 2.2.1 in clustered-mode with JDBC job store to schedule jobs marked as @DisallowConcurrentExecution.
We have observed that occasionally triggers are getting stuck in trigger state BLOCKED without ever recovering automatically. Looking into the job store DB tables, the pattern is always the same:

The TRIGGER_STATE on <PREFIX>_TRIGGERS is in state BLOCKED

There is no corresponding record in <PREFIX>_FIRED_TRIGGERS

Obviously org.quartz.impl.jdbcjobstore.JobStoreSupport.clusterRecover(Connection, List<SchedulerStateRecord>) will not recover such triggers, so the only way to get out of this inconsistent state is to manually set the TRIGGER_STATE back to WAITING.
It is not yet clear under which circumstances this error occurs. However, our log files indicate that jobs getting stuck coincides with temporary database problems.
Below you can find an example of a NullPointerException in org.quartz.impl.jdbcjobstore.JobStoreSupport.triggersFired(List<OperableTrigger>). The exception itself was caused somewhere in the JDBC driver (Sybase jConnect) when trying to invoke rollback() on a JDBC connection. The log entry’s timestamp correlates exactly with the time the trigger got stuck.
2017 05 01 20:20:02#+00#ERROR#org.quartz.core.QuartzSchedulerThread##anonymous#ItOpScheduler_Clustered_QuartzSchedulerThread#Runtime error occurred in main trigger firing loop.java.lang.NullPointerException: while trying to invoke the method com.sybase.jdbc4.tds.TdsCursor.setRowNum(int) of a null object loaded from field com.sybase.jdbc4.tds.CurInfo3Token._cursor of an object loaded from local variable 'this'
	at com.sybase.jdbc4.tds.CurInfo3Token.getMetaInformation(CurInfo3Token.java:85)
	at com.sybase.jdbc4.tds.CurInfoToken.<init>(CurInfoToken.java:130)
	at com.sybase.jdbc4.tds.CurInfo3Token.<init>(CurInfo3Token.java:45)
	at com.sybase.jdbc4.tds.Tds.nextResult(Tds.java:3239)
	at com.sybase.jdbc4.tds.Tds.readCommandResults(Tds.java:4459)
	at com.sybase.jdbc4.tds.Tds.doCommand(Tds.java:4444)
	at com.sybase.jdbc4.tds.Tds.endTransaction(Tds.java:2602)
	at com.sybase.jdbc4.jdbc.SybConnection.rollback(SybConnection.java:1953)
	at sun.reflect.GeneratedMethodAccessor492.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.sap.core.persistence.jdbc.trace.TraceableBase$1.invoke(TraceableBase.java:44)
	at com.sun.proxy.$Proxy17.rollback(Unknown Source)
	at com.sap.core.persistence.jdbc.trace.TraceableConnection.rollback(TraceableConnection.java:239)
	at org.apache.commons.dbcp.DelegatingConnection.rollback(DelegatingConnection.java:368)
	at org.apache.commons.dbcp.DelegatingConnection.rollback(DelegatingConnection.java:368)
	at org.apache.commons.dbcp.PoolingDataSource$PoolGuardConnectionWrapper.rollback(PoolingDataSource.java:323)
	at sun.reflect.GeneratedMethodAccessor492.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.quartz.impl.jdbcjobstore.AttributeRestoringConnectionInvocationHandler.invoke(AttributeRestoringConnectionInvocationHandler.java:73)
	at com.sun.proxy.$Proxy143.rollback(Unknown Source)
	at org.quartz.impl.jdbcjobstore.JobStoreSupport.rollbackConnection(JobStoreSupport.java:3658)
	at org.quartz.impl.jdbcjobstore.JobStoreSupport.executeInNonManagedTXLock(JobStoreSupport.java:3817)
	at org.quartz.impl.jdbcjobstore.JobStoreSupport.triggersFired(JobStoreSupport.java:2908)
	at org.quartz.core.QuartzSchedulerThread.run(QuartzSchedulerThread.java:336)
|

Please let me know if you need additional details.
Thanks for your support,
Sebastian

I was able to reproduce the issue in the debugger.
If org.quartz.impl.jdbcjobstore.JobStoreSupport.triggerFired(Connection, OperableTrigger) throws a RuntimeException after the trigger state has been set to BLOCKED, the trigger will get stuck. The reason for this is that QuartzSchedulerThead.run() will call org.quartz.spi.JobStore.releaseAcquiredTrigger(OperableTrigger) in case of RuntimeExceptions, which will delete the record from <PREFIX>_FIRED_TRIGGERS but will not set back the trigger state from BLOCKED to WAITING.
Probably org.quartz.impl.jdbcjobstore.JobStoreSupport.releaseAcquiredTrigger(Connection, OperableTrigger) should set back the trigger state to WAITING from both ACQUIRED (which it already does) and from BLOCKED.
Best Regards,
Sebastian

Is there anyone who can verify and release this fix?
I'm using 2.2.1 also. The job got stuck for same reason.

Actual bug for me too.
And no visible solution.
We are going to change quartz.

👍 looks like there's a PR to fixit

We're having this same issue.  Any idea when this will get approved and get a patch out?  It seems pretty significant.

As we can see that this has been around for a while now and this bug is fixed in dot net libraries of quartz. I t will be helpful for us to know on when this will be fixed, as we are affected by this.
(This pull request has been raised to address that on 22 May 2017 https://github.com/quartz-scheduler/quartz/pull/146)

I am facing the same issue with 2.2.1, Is there a fix provided by Quartz for this ?

@MSudheer87 we reduced frequency of this problem when we created sepatared db.
Before we had only one DB for App and Quartz.

@AntonSemenovKazan Thanks for your reply.
you mean to say you have created a separate schema for Quartz alone, correct ?
Let me give you few more details about my issue,

I have integrated Quartz with Spring Batch (The actual batch processing happens in Spring Batch,
Scheduling alone is being taken care by Quartz)
I have a single schema where i have Spring batch tables and Quartz specific tables.
I am facing this issue only in clustered environment (4 node cluster), while i am running on a single/
two node cluster, it works very well.

based on above facts, Do you suspect anything else other than separating out the DB Schema ? Please provide your suggestions, Thank you.

Case 1:
We have only one DB scheme where tables of our Application and Quartz tables live.
We have noticed that triggers become blocked when SQLException (like SQL Timeout exception) happened or transaction become disconnected.
These problems happen when SQL Server has long hard operations wih App data.
So we decided to move Quartz tables to their own separate scheme.
Also we thought about to move to separate node (SQL Server).
For example, you also can take sources and extend logging.
May be you can notice something special.
But all my team think that Quartz is a little bit strange and we quite often have some troubles.
But sometimes everything OK.
We have written monitoring system to control Quartz behavour.

Going by @shelmling fix, a work-around for Spring managed datasource till his PR is merged:

Create a CustomJobStore class that extends LocalDataSourceJobStore and override releaseAcquiredTrigger(Connection conn, OperableTrigger trigger)
Create a CustomSchedulerFactory class that extends StdSchedulerFactory and override initialize(Properties props)
Set schedulerFactoryClass during SchedulerBean creation

public class CustomSchedulerFactory extends StdSchedulerFactory {

	@Override
	public void initialize(Properties props) throws SchedulerException {
		props.put(StdSchedulerFactory.PROP_JOB_STORE_CLASS, CustomJobStore.class.getName());
		super.initialize(props);
	}
}

public class CustomJobStore extends LocalDataSourceJobStore {

	public CustomJobStore() {
		super();
	}

	@Override
	protected void releaseAcquiredTrigger(Connection conn, OperableTrigger trigger) throws JobPersistenceException {
		try {
			getDelegate().updateTriggerStateFromOtherState(conn, trigger.getKey(), STATE_WAITING, STATE_ACQUIRED);
			getDelegate().updateTriggerStateFromOtherState(conn, trigger.getKey(), STATE_WAITING, STATE_BLOCKED);
			getDelegate().deleteFiredTrigger(conn, trigger.getFireInstanceId());
		} catch (SQLException e) {
			throw new JobPersistenceException("Couldn't release acquired trigger: " + e.getMessage(), e);
		}
	}
}

SchedulerFactoryBean scheduler = new SchedulerFactoryBean();
...
scheduler.setSchedulerFactoryClass(CustomSchedulerFactory.class);

This should unblock you as of now 👍

Going by @shelmling fix, a work-around for Spring managed datasource till his PR is merged:

Create a CustomJobStore class that extends LocalDataSourceJobStore and override releaseAcquiredTrigger(Connection conn, OperableTrigger trigger)
Create a CustomSchedulerFactory class that extends StdSchedulerFactory and override initialize(Properties props)
Set schedulerFactoryClass during SchedulerBean creation

public class CustomSchedulerFactory extends StdSchedulerFactory {

	@Override
	public void initialize(Properties props) throws SchedulerException {
		props.put(StdSchedulerFactory.PROP_JOB_STORE_CLASS, CustomJobStore.class.getName());
		super.initialize(props);
	}
}

public class CustomJobStore extends LocalDataSourceJobStore {

	public CustomJobStore() {
		super();
	}

	@Override
	protected void releaseAcquiredTrigger(Connection conn, OperableTrigger trigger) throws JobPersistenceException {
		try {
			getDelegate().updateTriggerStateFromOtherState(conn, trigger.getKey(), STATE_WAITING, STATE_ACQUIRED);
			getDelegate().updateTriggerStateFromOtherState(conn, trigger.getKey(), STATE_WAITING, STATE_BLOCKED);
			getDelegate().deleteFiredTrigger(conn, trigger.getFireInstanceId());
		} catch (SQLException e) {
			throw new JobPersistenceException("Couldn't release acquired trigger: " + e.getMessage(), e);
		}
	}
}

SchedulerFactoryBean scheduler = new SchedulerFactoryBean();
...
scheduler.setSchedulerFactoryClass(CustomSchedulerFactory.class);

This should unblock you as of now 👍

Thank you @shelmling for the PR! It's now merged!

I cannot see this issue 145 to be fixed in any release at https://github.com/quartz-scheduler/quartz/releases .
Does this mean it is not fixed or there has never been a bug?

I should say that eventually we changed Quartz to Hangfire and now we live happily.
We found out that Quartz stuck when HDD had high I/O operations.
We easily reproduced that case.
So then we compared Hangfire+MS SQL with high I/O operations and it worked without problems.
So ... we changed Quartz and now we have been using Hangfire more than one year.

I cannot see this issue 145 to be fixed in any release at https://github.com/quartz-scheduler/quartz/releases .
Does this mean it is not fixed or there has never been a bug?

@carstenartur It is fixed in 2.3.1+ as part of pull request #146
see commit: https://github.com/quartz-scheduler/quartz/pull/146/commits/3f65b28fc04dd00b46b9befb4fc16d79bf561eb5

For those who are still seeing this issue and if you implemented the JobListener interface, make sure you handle the exception yourself within jobWasExecuted method as quartz does not handle exception thrown in that method and that could leave your job state in BLOCKED and never get recovered. We experienced it with Quartz version 2.3.0

For those who are still seeing this issue and if you implemented the JobListener interface, make sure you handle the exception yourself within jobWasExecuted method as quartz does not handle exception thrown in that method and that could leave your job state in BLOCKED and never get recovered. We experienced it with Quartz version 2.3.0

After 6 hours trying to find a solution I bumped into your answer and it was exactly what was happening in my code.
Thank you

For those who are still seeing this issue and if you implemented the JobListener interface, make sure you handle the exception yourself within jobWasExecuted method as quartz does not handle exception thrown in that method and that could leave your job state in BLOCKED and never get recovered. We experienced it with Quartz version 2.3.0

Most of these blocked triggers change the trigger state from BLOCKED to WAITING automatically since added the JobListner and upgrade quartz from 2.3.0 to the latest version 2.3.2.
But still exists one or two BLOCKED triggers in my case.

@AntonSemenovKazan and @MSudheer87 our team was noticing issues similar to yours.  The quartz queries on SQL Server would slow down significantly to the point of timing out when the database was under heavy load and waits started to increase (either CPU, Memory, or Disk).
One of the things we noticed was the query plans for quartz queries were very inefficient.  When we deep dived we found something like the following query was being executed on the DB:
exec sp_executesql N'SELECT TRIGGER_NAME FROM test_localhost_TRIGGERS WHERE SCHED_NAME = ''QuartzScheduler_test_localhost'' AND TRIGGER_NAME = @P0 AND TRIGGER_GROUP = @P1',N'@P0 nvarchar(4000),@P1 nvarchar(4000)',N'Trigger.AnExampleTrigger',N'test_localhost'
The issue with the above is that parameters @P0 and @P1 are being passed to SQL Server as nvarchar, but the columns on the tables are actually varchar.  This can cause the database to use very inefficient query plans when running queries.
We found we were using the SQL Server JDBC driver, and it has a setting for setSendStringParametersAsUnicode which defaults to on.  This causes all string parameters to be sent as nvarchar, even if the column is varchar.
The quartz tables don't have any nvarchar columns, and based on Microsofts own documentation:

For optimal performance with the CHAR, VARCHAR, and LONGVARCHAR JDBC data types, an application should set the sendStringParametersAsUnicode property to "false"

We only recently found this out and deployed it to our production environment.  I don't know if it will fully fix the quartz issues we have seen but we haven't had any issues since we made this switch last month, so I thought I would post it out incase it helps anyone else.  The fix was simply setting the sendStringParametersAsUnicode on the jdbc url for the quartz connection pool.

Our team has deployed latest version 2.3.2 quartz JAR last Friday in prod server.  But we are still immediately experiencing BLOCKED triggers in the qrtz_triggers table for our email notification after catalina restart.  Is there any followup/advice for this behavior?  Would enabling TRACE logging on "org.quartz" package help?  We have a clustered option set in the quartz.properties and the quartz tables are in the same db schema as our app tables.

I encountered a similar issue in our team's new project. We have two app servers, but we only deployed the war file, which includes the Quartz job, on app A. In the related cluster configuration on the Quartz job XML, we set it to false.
Initially, the scheduled jobs functioned properly, but at certain times, they would become "blocked" and fail to resume.
We observed that only the jobs related to updating the status in the database would rerun and return to normal functioning. However, we couldn't find any relevant error logs on the app server. Does anyone have any insights into this issue?
On the other hand, we previously implemented the same configuration (two app servers, war file hosted only on app A) in another project without encountering similar issues. It's worth noting that the previous project used MSSQL, while the new project uses MYSQL.


Issue with ls command in Docker container

I am trying to install Node.js version 8.4.0 in a Docker container, I get this error:
export NVM_DIR="$HOME/.nvm"
[ -s "$NVM_DIR/nvm.sh" ] && \. "$NVM_DIR/nvm.sh"  # This loads nvm
Downloading and installing node v8.4.0...
Downloading https://nodejs.org/dist/v8.4.0/node-v8.4.0-linux-x64.tar.xz...
######################################################################## 100.0%
Computing checksum with sha256sum
Checksums matched!
nvm is not compatible with the npm config "prefix" option: currently set to "/usr"
Run `npm config delete prefix` or `nvm use --delete-prefix v8.4.0` to unset it.
ls: unrecognized option: q
BusyBox v1.26.2 (2017-06-11 06:38:32 GMT) multi-call binary.

Usage: ls [-1AaCxdLHRFplinsehrSXvctu] [-w WIDTH] [FILE]...

The code that generated this error is:
#!/usr/bin/env bash

curl -o- https://raw.githubusercontent.com/creationix/nvm/v0.33.2/install.sh | bash

export NVM_DIR="$HOME/.nvm"
[ -s "$NVM_DIR/nvm.sh" ] && . "$NVM_DIR/nvm.sh" # This loads nvm

npm config delete prefix
nvm install 8
npm config delete prefix
nvm use 8

the above bash script was called from the Dockerfile like so:
RUN<EMAIL_ADDRESS>

Looks like the ls you have in your image lacks the -q option. Are you using https://github.com/creationix/nvm/blob/master/Dockerfile ?

nah I am not, I tried to get NVM to install on Alpine Linux, and the whole thing sucked lol

Ah, alpine linux is missing a ton of things in its default install; iow, it's not POSIX-compliant that way, and nvm won't work on it.

@ORESoftware may I ask if you installed few packages as our readme suggests?
The ls issue can be simply fixed, but as @ljharb says, there are ton of things need to be dealing with to make it working properly, this (ls fix) won't be enough :)

@PeterDaveHello thanks yeah, currently put that work aside, there reason I was messing with Alpine is because of the docker:dind image which uses Alpine. If you know of another dind image that doesn't use Alpine, I would love to be the first to know lol.

If you don't mind to expose the socket to the upper layer container, it won't be too hard to implement a workaround docker-in-docker container, alpine is awesome in many different points, just too tiny, the the trade off is the different behavior.

@ORESoftware i've edited your comment to remove the inappropriate language; i'll delete this reply shortly as well.


feat: make schedule input modal

^^

hey ryu please come early classroom tomorrow. i always keep an eye on you anywhere.


Broken hostnames on fox in dashboard display - probable underlying issue

I'm about 100% certain this is not a problem with the dashboard because the old dashboard has the same problem as the new one:

The host names are mangled here.  I don't see any problems in the output from sonalyze so this could be a problem with naicreport, but this is TBD.

This is at least a bug in the output from sonalyze jobs as run by naicreport:
jobs --user - --fmt=json,host,user,classification,end --from 1d -remote https://naic-monitor.uio.no -cluster fox -auth-file ...

contains legitimate merged hosts but also
"c1-[72810-11,14-16,21,,].fox"

clearly a bug.

Lucky for me, the error is the same when running with -data-dir as when running with -remote, because this means that it's almost certainly not the caching logic.

Unsurprisingly, hostglob.CompressHostnames returns the correct result (hence what we see from parse).

This is a bug in the very last step of the jobs printing code for host (sonalyze/jobs/print.go:392).  What happens is that this printer applies compression to the node names of the records in the node, but this breaks down when the node names are already compressed.  The Go code is just a transliteration of the Rust code, and it's possible that it was correct at some point, but that compression was added elsewhere to make it wrong.

As the test cases were all developed on the ML nodes, where there are no cross-node jobs, we have no good tests for this.  We should add some, to avoid this type of issue.


mullvad-browser: fix desktop item name

Description of changes
Generally filenames of desktop files need to match the binary, which wasn't the case for Mullvad Browser since the binary name was changed a while ago.
Things done

Built on platform(s)

[ ] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
24.05 Release Notes (or backporting 23.05 and 23.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

Add a :+1: reaction to pull requests you find important.

@ofborg eval

While it builds for me locally, it segfaults on launch. It isn't related to this change, though.
Must be some other change on master that causes it.


Check what the states of a navigation item look like currently

What
Check what the active state of a navigation item looks like currently.
Identify what the navigation item looks like if there:

is no href (link)
is an active state
is a current state

Why
In order to determine when to suggest applying different visual styles to the navigation item.
Done when

[ ] all states have been recognised
[ ] design suggestions made

What the navigation item looks like with no href (link)
Navigation item text is black and no longer a link.

Design Suggestion for an unlinked active state
I'm wondering if we can add a conditional style for .govuk-service-header__navigation-item--active when there is no hrefto change the border bottom to a border-color of #0b0c0c.

cc: @querkmachine

We also have an explanation of the matrix of all the different paramaters in Add conditional styles for different active states of the navigation items which builds on top of the findings in this issue.


Ligatures related with * does not work

VSCode Version: 1.8.1
OS Version: Windows 10 x64 RS2

Steps to Reproduce:

Install a font with ligature support, like Iosevka and Fira Code
Enable Ligatures
Type <* or <*>

Expected Result:
Ligatures work. For Fira Code, the * is enlarged. For Iosevka, it is centered.
Actual Result:
Ligatures do not works.
Additional Information:
May related with electron/electron#8405.
The same ligature in Chrome itself works.

I think it is fixed in 1.12. Closed.


Removes polling

Problem
The polling code has been sitting around for a while and is never used. Whilst refactoring to fix it up for rubocop it complained a lot about the code.
Solution
Remove it.

:cake:


RDKTV-17958: After waking TV from standby Audio not routed to eArc.

Reason for Change: eArc not enabled due to delayed HPD event
Test Procedure: As per Jira
Risks: Low
Signed-off-by: shashankkumarc<EMAIL_ADDRESS>

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

Creating new request from 2208 sprint


Ensure any public method cannot be actioned if the component is disabled

We have a number of public methods that can be called external processes (e.g. events) that perform the actions on the class.
However, these actions should not work if the component is disabled.
Also, events shouldn't emit if the component is disabled (unless the component is a Moment Process which has it's own way of dealing with disabled components)

Additionally we need to look into whether it makes sense to emit some events OnDisable and reset/change state of the component. Otherwise it could result in unexpected behavior once we have that isActiveAndEnabled "filtering" in.


Height always take up entire body

Describe the bug
The height of the editor will always take up the entire height of the body.
To Reproduce
<link rel="stylesheet" href="node_modules/suneditor/dist/css/suneditor.min.css">

<style>
    body {
        background-color: black;

        height: 1000%;
    }
</style>

<textarea id="myEditor"></textarea>

<script src="node_modules/suneditor/dist/suneditor.min.js"></script>

<script>
    const myEditor = SUNEDITOR.create('myEditor', {
        resizingBar: false,

        width: '100%',
        height: '400px',
    });
</script>

Expected behavior
The height of the editor will be 400px.
Screenshots
None
Desktop (please complete the following information):

OS: Linux Mint 21.1
Browser Firefox Developer Edition
Version 2.44.3

Smartphone (please complete the following information):

Device: LG V20
OS: Android
Browser Fennec
Version 2.44.3

Additional context
None

This issue is not reproduced.
Check the code such as whether the height value is being entered in the generated html.

2.44.6 and it does show the height is added to the element in the browser.
<link rel="stylesheet" href="node_modules/suneditor/dist/css/suneditor.min.css">

<style>
    body {
        background-color: black;

        height: 1000%;
    }
</style>

<textarea id="myEditor"></textarea>

<script src="node_modules/suneditor/dist/suneditor.min.js"></script>

<script>
    const myEditor = SUNEDITOR.create('myEditor', {
        resizingBar: false,

        width: '100%',
        height: 400,
    });
</script>


Ubuntu 16.04 build fail

==== Building Baikal (release_x64) ====
clw_scene_controller.cpp
In file included from ./SceneGraph/clwscene.h:24:0,
                 from ./Controllers/clw_scene_controller.h:34,
                 from Controllers/clw_scene_controller.cpp:1:
./Kernels/CL/payload.cl:102:20: error: member ‘RadeonRays::float4 Baikal::ClwScene::_Material::<anonymous union>::<anonymous struct>::kx’ with constructor not allowed in anonymous aggregate
             float4 kx;
                    ^
./Kernels/CL/payload.cl:122:20: error: member ‘RadeonRays::float4 Baikal::ClwScene::_Material::<anonymous union>::<anonymous struct>::base_color’ with constructor not allowed in anonymous aggregate
             float4 base_color;
                    ^
Makefile:150: recipe for target 'obj/x64/Release/clw_scene_controller.o' failed
make[1]: *** [obj/x64/Release/clw_scene_controller.o] Error 1
Makefile:36: recipe for target 'Baikal' failed
make: *** [Baikal] Error 2

May be is because I`m using nvidia-cuda-toolkit for opencl headers.

The same failure happened in my side as well.

Yes, with this patches I can compile too.

@JammyZhou , thanks for fixing it. I have merged your pull request and slighly changed naming afterwards here: https://github.com/GPUOpen-LibrariesAndSDKs/RadeonProRender-Baikal/commit/23fb3653e0af12796ba3675833d78ba911b428bc
@lieff @JammyZhou guys, could you please verify if it works for you and close the issue

Yep, works for me.

Closing as verified


Allowing to add notes from foundry

Would be great to add notes from within foundry. Both gm notes that are hidden, but also to players when they have "limited" permission to the journal entry. As in, there might be a location entity, and the players want to write down the facts they know about the location as a note through foundry

Interesting idea.
One of the main reasons for the 2.0.0 update (or the changes in it) was, that this enables me to allow people to change an entries (or parts thereof) in foundry and sync them back to Kanka. So one way to go about this would be to allow the creation of new notes (that are saved in Kanka) from within foundry.
That being said, I currently only allow the GM to really interact with the Kanka API (mainly because the GM is the only one to configure their access key, which authenticates the module as their user).
So the current idea is, that the GM sets the correct permissions for data and gives players access accordingly, so that they can see what they need to know. Obviously this doesn't support a lot of variation between different players (so beyond the difference between observer / owner there is no way to show specific information to specific players).
Another approach would be to allow notes that are only saved in foundry itself. There might actually be modules out there that do this (I think there is at least a GM notes one). Maybe there is a way to add support for such a module without having to do this myself.
This one is a bit more special compared to the other ideas you posted, so I won't promise anything on this one, but I will look into this.

I think the idea with having kanka as the one true source of information is a sound idea, so if possible creating notes in kanka I think that would be preferable to creating them in foundry.
You can use sockets in foundry to make sure only the GM account is interacting with foundry, i.e. when a player would create a note, it would send out a request over sockets, the GM window would pick this up, check permissions and then interact with kanka. The downside here however, is that this would only work if the GM is logged in to foundry.

Well, the bigger problem imho would be, that the note would be created via the GMs Kanka account. And I'm pretty sure I don't have full control over Kankas permission system, so I wouldn't be able to read / write notes that are only visible / owned by specific players - unless I add my own meta-data somehow (maybe hide it within the notes HTML, which could work depending on what Kanka would strip out from the HTML - but that would be a pretty unreliable mechanism).
I will put this feature on hold for now. I do want to implement certain write operations in the future (though currently I'm only planning GM only write access), so I probably have a better idea and understanding of what is possible here and maybe I can leverage those features to come closer to a solution for this request.

Sounds very exciting!

Just started using this and my immediate thought was that a write back option would be nice :)
Here´s how I would imagine it. Player writes Session journal in Foundry and saves it when done. GM syncs it back to Kanka and sets the desired permissions within kanka if necessary.

I'm not aware of the limitations this might have but a way to quickly add something in foundry while in a session and have it update/add something in Kanka would be nice.


Should we set up publishing of design tokens(?) for android and iOS apps?

lets have a chat with @ab-gnm


SCM history: allow to show/hide dynamically

I want to use the history feature, but would love to bring it in ad-hoc without having to change the setting. I think I am very much used to the changes view being empty when I am done with my change and populated otherwise. With the timeline showing lots of things, it makes me feel I need to review:

Some ideas:

allow to collapse the view
make it a real view to toggle?
have a action to show/hide

Another idea is to allow toggling between history and graph view via the gearwheel menu. At the moment this always offers history-mode settings, even when graph has been enabled:

Closing this issue as the "Incoming/Outgoing" section has been removed.


Using OHEMSampler for negative mining in Two stage Detectors

Using OHEM in Two stage Detectors
Motivation
I have seen that OHEM can provide better results and would like to use it for an application. Is this feature supported?
I believe it was in an earlier version but no longer? Can we still use it somehow? I am using the Cascade DCONV detector.

You can refer to https://github.com/open-mmlab/mmdetection/blob/master/configs/faster_rcnn/faster_rcnn_r50_fpn_ohem_1x_coco.py


Add form to delete placeholders

I tested it, and it works for me, but it is pretty aggressively deleting data so be careful with it.
I'm not sure how to style this form, so I left it pretty minimal:

The delete form is hidden behind the <details> element so that it requires two clicks:

I added two other commits with this PR because I was getting a crash on Ebook::GetProjects()
NOTICE: PHP message: PHP Fatal error:  Uncaught Exceptions\DatabaseQueryException: Error when executing query: SQLSTATE[23000]: Integrity constraint violation: 1052 Column 'Created' in order clause is ambiguous. Query:
                                                     SELECT *
                                                     from Projects
                                                     inner join Ebooks
                                                     using(EbookId)
                                                     where EbookId = ?
                                                     order by Created desc

I believe the query worked until you added the order by Created desc, but even when it works it logs warnings like:
NOTICE: PHP message: PHP Deprecated:  Creation of dynamic property Project::$Identifier is deprecated in /standardebooks.org/web/lib/Traits/Accessor.php on line 81
NOTICE: PHP message: PHP Deprecated:  Creation of dynamic property Project::$WwwFilesystemPath is deprecated in /standardebooks.org/web/lib/Traits/Accessor.php on line 81
etc.

because all the fields are returned together in one big row and associated with Project.
But now I see that you are intending to do a multi-table select, and my commits are probably breaking your multi-table select. I don't quite understand how that works, but I'd like to. It would come in handy now it would be convenient to get Ebook and EbookPlaceholder objects from a multi-table select for the wanted list.

Sorry for the spam. I looked closer into how multi-table select is supposed to work. In the case of Projects and Ebooks, I think it's not working. For example, in www/projects/index.php, there's a call to:
$inProgressProjects = Project::GetAllByStatus(Enums\ProjectStatusType::InProgress);

that runs
SELECT * from Projects inner join Ebooks using (EbookId) where Projects.Status = 'in_progress' order by Title asc

but then the Accessor for Ebook::Get() is still kicking in and running
SELECT * from Ebooks where EbookId = ?

for each Ebook. So the multi-table select didn't populate the Ebook objects like it looks like it should.

Sorry again for the spam. I figured out how to get multi-table select working, as shown in this hacked up commit:
https://github.com/colagrosso/se-web/commit/9774b3a02a1582f5f4deba414527dc0760999eb7
There are three small changes:

Add a pass-through function, Db::MultiTableSelect()
In Project::GetAllByStatus(), call Db::MultiTableSelect() instead of Db::Query()
In Project::FromMultiTableRow(), check a different EbookId for null

After those changes, I confirmed that the multi-table select executed, and there were no follow-up Ebook queries. Pretty cool!
I dropped the commits where I modified Ebook::Projects(), Ebook::GetProjectInProgress(), and Ebook::GetPastProjects().  They will still need to be converted to Db::MultiTableSelect(), but not as part of this PR.

Great, yes, you definitely solved the problem. I copied and pasted that code in from a different project but forgot to include the MultiTableSelect bits. Entirely my fault. Thanks!

One thing that comes up is that if we delete the last ebook in a collection, the collection remains, but is empty. We should also delete the collection in that case.

I've fixed the multi select issues so just pull from master for those fixes.

Thanks for all the follow up fixes to the delete form!

One thing that comes up is that if we delete the last ebook in a collection, the collection remains, but is empty. We should also delete the collection in that case.

Yep, agreed. I'll get on that.
We did something similar in Artwork.php to delete artists that were no longer associated with any artworks:
https://github.com/standardebooks/web/blob/b4003b30e2d2ec8345d12848a48a2af14785e16e/lib/Artwork.php#L822-L829


Trying to filter out security groups using the ec2 schema, but I get a TypeError

Here is my policy
policies:

name: security-group-test
resource: ec2
comment: |
EC2 instances that have SSH access from everywhere
filters:

type: security-group
key: cidr
value: <IP_ADDRESS>/0
value_type: cidr
op: equal

And the error output I get is this
Traceback (most recent call last):
  File "/home/anant/cc/cc/src/c7n/c7n/policy.py", line 211, in run
    resources = self.policy.resource_manager.resources()
  File "/home/anant/cc/cc/src/c7n/c7n/resources/ec2.py", line 89, in resources
    return super(EC2, self).resources(query=query)
  File "/home/anant/cc/cc/src/c7n/c7n/query.py", line 284, in resources
    return self.filter_resources(resources)
  File "/home/anant/cc/cc/src/c7n/c7n/manager.py", line 86, in filter_resources
    resources = f.process(resources, event)
  File "/home/anant/cc/cc/src/c7n/c7n/filters/related.py", line 98, in process
    return [r for r in resources if self.process_resource(r, related)]
  File "/home/anant/cc/cc/src/c7n/c7n/filters/related.py", line 84, in process_resource
    if self.match(robj):
  File "/home/anant/cc/cc/src/c7n/c7n/filters/core.py", line 385, in match
    v, r = self.process_value_type(self.v, r)
  File "/home/anant/cc/cc/src/c7n/c7n/filters/core.py", line 444, in process_value_type
    v = parse_cidr(value)
  File "/home/anant/cc/cc/src/c7n/c7n/utils.py", line 318, in parse_cidr
    if '/' not in value:
TypeError: argument of type 'NoneType' is not iterable
2017-04-12 01:15:27,987: custodian.commands:ERROR Error while executing policy security-group-test, continuing
Traceback (most recent call last):
  File "/home/anant/cc/cc/src/c7n/c7n/commands.py", line 178, in run
    policy()
  File "/home/anant/cc/cc/src/c7n/c7n/policy.py", line 569, in __call__
    return PullMode(self).run()
  File "/home/anant/cc/cc/src/c7n/c7n/policy.py", line 211, in run
    resources = self.policy.resource_manager.resources()
  File "/home/anant/cc/cc/src/c7n/c7n/resources/ec2.py", line 89, in resources
    return super(EC2, self).resources(query=query)
  File "/home/anant/cc/cc/src/c7n/c7n/query.py", line 284, in resources
    return self.filter_resources(resources)
  File "/home/anant/cc/cc/src/c7n/c7n/manager.py", line 86, in filter_resources
    resources = f.process(resources, event)
  File "/home/anant/cc/cc/src/c7n/c7n/filters/related.py", line 98, in process
    return [r for r in resources if self.process_resource(r, related)]
  File "/home/anant/cc/cc/src/c7n/c7n/filters/related.py", line 84, in process_resource
    if self.match(robj):
  File "/home/anant/cc/cc/src/c7n/c7n/filters/core.py", line 385, in match
    v, r = self.process_value_type(self.v, r)
  File "/home/anant/cc/cc/src/c7n/c7n/filters/core.py", line 444, in process_value_type
    v = parse_cidr(value)
  File "/home/anant/cc/cc/src/c7n/c7n/utils.py", line 318, in parse_cidr
    if '/' not in value:
TypeError: argument of type 'NoneType' is not iterable

What seems to be the issue?  @kapilt @jaredsmith

@srinivas-anant - use triple backquotes for a multi-line snippet.
The error message isn't very helpful, but the problem is that the key cidr does not exist in the information returned.  Here is the relevant subset of info I got back when I tried your policy:
 u'IpPermissions': [{u'FromPort': 22,
                     u'IpProtocol': 'tcp',
                     u'IpRanges': [{u'CidrIp': '<IP_ADDRESS>/0'}],
                     u'Ipv6Ranges': [],
                     u'PrefixListIds': [],
                     u'ToPort': 22,
                     u'UserIdGroupPairs': []}],
 u'IpPermissionsEgress': [{u'IpProtocol': '-1',
                           u'IpRanges': [{u'CidrIp': '<IP_ADDRESS>/0'}],
                           u'Ipv6Ranges': [],
                           u'PrefixListIds': [],
                           u'UserIdGroupPairs': []}],

Thank you @scotwk.


mDNS doesn't work

Finding SignalK using mDNS doesn't work in TWatchSK!
Also when user connects to WiFi for first time, TWatchSK could automatically try to find SignalK server in connected network.

After little digging I've found the issue. SignalK WS mDNS service name must start with underscore. If I change it in code I'm able to find Signal K correctly.
const char *service_name = "_signalk-ws";
const char *service_proto = "_tcp";

Will do PR hopefully in couple of days.

Fixed in commit https://github.com/JohnySeven/TWatchSK/commit/0c07760b8310f76ba8b2991883e8632c6752c7b7, closing.


Inserting an image (base64)

Hi @bramkn,
I'm trying to insert some images in a document. I run n8n in docker with libreoffice installed. So far everything works great, except images. I already opened an issue with easy-template-x. But perhaps there is something in n8n to take care of.
Do you have any idea, what I'm doing wrong?
EDIT, forgot the pictures:

in code:
{"_type":"image","format":"image/jpeg","source":{"type":"Buffer","data":[117,...,217]},"width":200,"height":200}
Whenever I execute this, I get Error: Binary type 'Object' is not supported.

Hi,
Sorry I have no idea and do not offer free support on the node or n8n.


Fix bug: Omega_m -> omega_m

Two bugs happened in the previous PR merged:

Omega_m should be omega_m
timesteps for powerspec should +1

Harini has checked. Merge!


chore(main): release protocol 1.3.0

:robot: I have created a release beep boop
1.3.0 (2024-04-08)
Features

protocol: allow bridge to fail a message by the owner without retrying it (#16669) (dce651e)
protocol: use 35000 as gas limit for sending Ether in Brdge (#16666) (4909782)

Bug Fixes

protocol: add GovernorSettingsUpgradeable (#16687) (eba82ba)
protocol: check invocation gas limit also in retryMessage (#16660) (8209a43)
protocol: check no loops in multi-hop in Bridge (#16659) (447cd52)
protocol: fix potential 1271 signature replay if proposers are smart contracts (#16665) (2b27477)

This PR was generated with Release Please. See documentation.

It seems this PR didn't pick up the latest commit...


[OAP-1460][rpmem-shuffle]Bug fix to support decision support query

The shuffle behavior of Spark3.0 has some changes due to https://issues.apache.org/jira/browse/SPARK-25341, it's used to better support rolling back a shuffle map stage and recover environment.
Some interfaces of RPMem shuffle plugin needs to be changed correspondingly.
This PR has been tested by 500GB decision support benchmark

Looks good.


Split into multiple libraries/packages

Many of the components here are likely useful on their own.
Splitting up into multiple packages would support re-usability and having well defined APIs.
Proposed split (based off existing tools):

[ ] stl: STL and STL parser
[ ] blustl: Python version of Blustl
[ ] diary: Diagnosis and repair

The packages can all still be in this repo.

Split into resp. folders. Can address having different setup.pys once things stablize


Simplify IP address logic.

Match the reported websocket href to the requested host.

@dhylands Fixed.


THRIFT-3833 haxe http php server implementation (embeding into php web server)

support of TSimpleServer.runOnce (run till input EOF)
TWrappingServerTransport wraps TTransport into TServerTransport
README.md - notes about integration into PHP web server
tests
update tutorial with http support

make tutorialserver_php_http
make tutorialclient_http

Looks nice, good work! Only a few things ... ;-)

I've filed issue to the haxe https://github.com/HaxeFoundation/haxe/issues/5264


Gpu problem

I run your code in my GPU server,but my GPU server has four K80 card, I want use two cards only.
How can I achieve it?
Thank you very much!

If you just want to use GPU 0 and 1, you can add "export CUDA_VISIBLE_DEVICES=0, 1" into your training shell script.

@ICTwangbiao
yes，Thank you very much！

In addition to what @ICTwangbiao said, using a second GPU won't speed things up, so "export CUDA_VISIBLE_DEVICES=0" is fine if you want to use your other GPUs for something.


Add new WorkerPoolHash calculation to rotate nodes on OSCKey change

How to categorize this PR?
/area control-plane
/kind enhancement
What this PR does / why we need it:
Based on #9846, please review that PR first
This PR implements version 2 of the gardener node agent secret name calculation, as proposed in #9699. Version 2 of the name calculation moves most fields that were included in the WorkerPoolHash calculation to the name calculation of the OperatingSystemConfig. These fields are removed from the WorkerPoolHash calculation and are replaced with a field OSCHash that includes the just mentioned secret name. This allows Gardener to trigger a node pool roll if there are relevant changes in the OperatingSystemConfig. In addition, it is possible in the future to include further node roll triggers without requiring changes to the provider extensions.
The secret name uses gardener-node-agent-hash(worker.CRI, machineType, volume type+size, worker.Machine.Image.Name+Version, minorKubernetesVersion, credentialsRotationStatus, nodeLocalDNS, kubeReserved, evictionHard.Memory, cpuManagerPolicy)[:16]-<worker.Name>-<suffix>. For kubeReserved currently all fields are included. For evictionHard, I've so far only included memory, although we could also add the FS-based limits.
The PR also includes a new feature gate WorkerPoolHashV2. This is necessary, as the provider extensions first have to vendor the new Gardener code, before the new hash calculation for the OperatingSystemConfig can be used. Thus, the OSCHash field must remain unused until the provider extensions are able to interpret it to prevent node rolls when upgrading the extension.
Which issue(s) this PR fixes:
Part of #9699
Fixes https://github.com/gardener/gardener/issues/9265 (see https://github.com/gardener/gardener/issues/9265#issuecomment-2099907212 regarding the cpuManagerPolicy field)
Special notes for your reviewer:
Based on #9846, please review that PR first
To test the changes locally, enable the feature gate first. Then reconcile the shoot once to ensure that the pool-hashes secret (from #9846) is up to date.
diff --git a/example/gardener-local/gardenlet/values.yaml b/example/gardener-local/gardenlet/values.yaml
index 063ef2b12..ab2bd1288 100644
--- a/example/gardener-local/gardenlet/values.yaml
+++ b/example/gardener-local/gardenlet/values.yaml
@@ -45,6 +45,7 @@ config:
     # Seed config. Only when this is set, gardenlet's behavior changes.
     IPv6SingleStack: true
     ShootManagedIssuer: true
+    NewWorkerPoolHash: true
   etcdConfig:
     featureGates:
       UseEtcdWrapper: true

[ ] I think that the changed hash calculation and switching between the versions should be E2E tested. However, I'm unsure how to proceed here. Create a new E2E test? Extend an existing one? In particular, the feature gate would have to be enabled, which probably isn't the case right now for the E2E tests?

Release note:

The function `github.com/gardener/gardener/extensions/pkg/controller/worker/WorkerPoolHash` now expects separate additional data for version 1 and 2 of the hash calculation. Version 2 does not include extension provider specific fields by default. Add those to the additional data for version 2 if necessary.

Version 2 of the WorkerPoolHash calculation now takes the current name of the OperatingSystemConfig into account. Its usage is controlled by the gardenlet feature gate `NewWorkerPoolHash`. All provider extension must be upgraded before enabling this feature gate. The new calculation also ensures that changes of the fields kubeReserved, evictionHard and cpuManagerPolicy in the kubelet config of a worker pool result in node rolls.

FYI: I've partially addressed the feedback and will try to address the remainder in the next days. The PR is also rebased on the current version of https://github.com/gardener/gardener/pull/9846 (but it will obviously require another rebase once that PR is merged).

https://github.com/gardener/gardener/pull/9846 is merged now :)

/cc @timebertt @ScheererJ
Can you please also take a look (and perhaps try/verify it locally)? I think this is a critical change and we must be absolutely sure that this doesn't cause unintended node rollouts.
Thank you!

/ok-to-test

/assign

I've added a small check to the e2e upgrade test to verify that the shoots from the previous Gardener version end up using hash version 1.

/retest

I've fixed the handling of the worker pool name in the hash calculation and also the E2E tests, PTAL.

The release note section in the PR description now also includes an entry that describes the WorkerPoolHash changes.

Could you please adapt the release note to use the new feature gate name?

I've fixed the release note.

Thanks.
/lgtm

/assign

I'm sorry but I won't make it to review this PR this week due to sick leave and other conflicting topics.

I've rebased the PR to fix the merge conflicts in the feature gates documentation/code.

/retest

/retest


link to the account page

Fixes links

The registration page should actually be / because it's a NextLink which knows about the basePath (hence the test failure), but since the page doesn't work and will be disabled it doesn't really matter

It's the account validated test that's failing, so have fixed that


feat: added acm: config sync and policy controller

Triggering the test:
Error: Error deleting FeatureMembership: googleapi: Error 409: unable to queue the operation
Details:
[
  {
    "@type": "type.googleapis.com/google.rpc.ResourceInfo",
    "resourceName": "projects/eab-fleet-non-production-2aca/locations/global/features/configmanagement"
  }
]
}

Triggering the test:
Error: Error deleting FeatureMembership: googleapi: Error 409: unable to queue the operation
Details:
[
  {
    "@type": "type.googleapis.com/google.rpc.ResourceInfo",
    "resourceName": "projects/eab-fleet-non-production-2aca/locations/global/features/configmanagement"
  }
]
}

Looks like it was a flake

Look like a flakey build, re-triggering

Error: Error deleting FeatureMembership: googleapi: Error 409: unable to queue the operation

Error: Error deleting FeatureMembership: googleapi: Error 409: unable to queue the operation

Let's see if we can retry these automatically: https://github.com/GoogleCloudPlatform/terraform-google-enterprise-application/pull/44


Update about-admin-roles.md

Added monitoring service health to service support admin

@JohanFreelancer9 Please copy review

Issue#https://github.com/MicrosoftDocs/microsoft-365-docs/issues/4579


No strong SecureRandom implementation present

Running code that calls java.security.SecureRandom.getInstanceStrong() throws "No strong SecureRandom impls available: NativePRNGBlocking:SUN"

I'm guessing there's either a native method we are missing for SecureRNG, or we need to set a magic system property pointing to a class that implements secure RNG.

@ianopolous Can you submit a minimal Java class with a public static void main that exhibits this issue?

The system property is "securerandom.strongAlgorithms" It's of the following format:
/*
* Entries are alg:prov separated by ,
* Allow for prepended/appended whitespace between entries.
*
* Capture groups:
*     1 - alg
*     2 - :prov (optional)
*     3 - prov (optional)
*     4 - ,nextEntry (optional)
*     5 - nextEntry (optional)
/
private static Pattern pattern =
Pattern.compile(
"\s([\S&&[^:,]])(\:([\S&&[^,]]))?\s*(\,(.*))?");

This should be sufficient. My code calls it deep in Peergos, but this is equivalent:
import java.security.*;

class test {
  public static void main(String[] args) {
    java.security.SecureRandom.getInstanceStrong();
  }
}```

Interesting. This code works under Node on my Mac because it simply reads /dev/urandom. :)
The system property contains the following data:
#
# A list of known strong SecureRandom implementations.
#
# To help guide applications in selecting a suitable strong
# java.security.SecureRandom implementation, Java distributions should
# indicate a list of known strong implementations using the property.
#
# This is a comma-separated list of algorithm and/or algorithm:provider
# entries.
#
securerandom.strongAlgorithms=NativePRNGBlocking:SUN

It looks like to do this the "proper way", we'd have to have a DoppioSecurityProvider that provides RNG for the browser, and register that with the browser.
I'm making a small change right now to move doppio.jar generation and classes from the doppio_jcl repository into this repository, which will make it easy to add custom Doppio classes like these in the future.

The best cross browser (and node) code I'm aware of for finding a secure random source is from the end of:
https://github.com/dchest/tweetnacl-js/blob/master/nacl.js (public domain)
  // Initialize PRNG if environment provides CSPRNG.
  // If not, methods calling randombytes will throw.
  var crypto;
  if (typeof window !== 'undefined') {
    // Browser.
    if (window.crypto && window.crypto.getRandomValues) {
      crypto = window.crypto; // Standard
    } else if (window.msCrypto && window.msCrypto.getRandomValues) {
      crypto = window.msCrypto; // Internet Explorer 11+
    }
    if (crypto) {
      nacl.setPRNG(function(x, n) {
        var i, v = new Uint8Array(n);
        crypto.getRandomValues(v);
        for (i = 0; i < n; i++) x[i] = v[i];
        cleanup(v);
      });
    }
  } else if (typeof require !== 'undefined') {
    // Node.js.
    crypto = require('crypto');
    if (crypto) {
      nacl.setPRNG(function(x, n) {
        var i, v = crypto.randomBytes(n);
        for (i = 0; i < n; i++) x[i] = v[i];
        cleanup(v);
      });
    }
  }

Committed in https://github.com/plasma-umass/doppio/commit/f23922ab733cc831943bd6b3808ab3afc0982a46, but the CI build is broken for some unknown reason (it stalls on running Java to generate unit test data).
Keeping this open until that gets cleared up...

Alright, my change works!
Small note: crypto is not available in WebWorkers in Firefox until Firefox 48 hits, causing Travis-CI failures in that browser. This is outside of our control, so I am marking this as "closed".


Failed to execute 'importScripts' on 'WorkerGlobalScope' error while fetching scripts from extension

Does this issue occur when all extensions are disabled?: Yes/No

VS Code Version: 1.95.1
OS Version: MacOS 14.6.1 (23G93)

Steps to Reproduce:

Open Postman VS Code extension (in logged in state)
Send a request to www.google.com
Notice the response is not formatted
Open developers tool
Notice the following error

This was working in the previous release (1.94) but started failing from this release. On further investigation, it appeares that the new version has Chrome v128. This seems to be an issue in the said Chrome version as evident from here https://issues.chromium.org/issues/356827071

@deepak1556 Any updates on this. This issue is affecting the core feature of the extension. Can we please expedite it.

@deepak1556 The workaround shared by Electron team https://github.com/electron/electron/issues/43556

You can use the feature flag when launching vscode --disable-features=PlzDedicatedWorker and it should be respected.

@deepak1556 I have opened a PR for this. Feel free to leverage it if it makes sense

@deepak1556 Any updates on this?

Here are some details from the runtime trace, the error from https://source.chromium.org/chromium/chromium/src/+/main:third_party/blink/renderer/core/workers/worker_global_scope.cc;l=247-249? can happen for csp violation or network loading failure. It is definitely not the former as there are no logs related to csp errors.
With PlzDedicatedWorker enabled and using the following trace categories to get some more details on the loading browser,renderer,blink,blink.net,blink.resource,blink.worker,disabled-by-default-network,loading,disabled-by-default-loading"

Zooming on one of the failing resource html.worker.js, we do see a resource request start hence confirms there are no csp issues. This is were it gets interesting, we see the async stack ResourceLoad return a success result

But the number of bytes transferred doesn't make sense, right after which URLLoader cancels the resource request

I will add some more logs to the runtime to track the issue. Also, @pankajk07 if you can isolate a minimal version of your extension specifically just loading the web worker editor it would helpful.
For 1.96 I will disable the PlzDedicatedWorker feature.


Button shows styling on prod not on dev

Currency Exchange button shows styling on prod, but not on dev. Why?

Hi @ankushdharkar ,
I think it's something related to className mismatch between Client and Server for the CustomButton @styles-components.

The bug seems to also appear and discussed @nextjs:
https://github.com/vercel/next.js/issues/7322


[Backport to main] add exclude nodes setting (#813)

Description
Backport PR #813 to main branch
Issues Resolved
[List any issues this PR will resolve]
Check List

[ ] New functionality includes testing.

[ ] All tests pass

[ ] New functionality has been documented.

[ ] New functionality has javadoc added

[ ] Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Codecov Report

Merging #816 (ea36b28) into main (35dc179) will increase coverage by 0.01%.
The diff coverage is 78.37%.

:mega: This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more
@@             Coverage Diff              @@
##               main     #816      +/-   ##
============================================
+ Coverage     85.08%   85.09%   +0.01%
- Complexity     1612     1626      +14
============================================
  Files           135      135
  Lines          5973     6005      +32
  Branches        570      580      +10
============================================
+ Hits           5082     5110      +28
+ Misses          649      648       -1
- Partials        242      247       +5

Flag
Coverage Δ

ml-commons
85.09% <78.37%> (+0.01%)
:arrow_up:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

...rg/opensearch/ml/plugin/MachineLearningPlugin.java
98.82% <ø> (ø)

.../java/org/opensearch/ml/task/MLTaskDispatcher.java
32.94% <0.00%> (ø)

...h/ml/action/unload/TransportUnloadModelAction.java
77.10% <25.00%> (-1.91%)
:arrow_down:

...org/opensearch/ml/cluster/DiscoveryNodeHelper.java
95.23% <83.33%> (-3.25%)
:arrow_down:

...n/java/org/opensearch/ml/model/MLModelManager.java
78.92% <90.90%> (+0.29%)
:arrow_up:

.../org/opensearch/ml/settings/MLCommonsSettings.java
100.00% <100.00%> (ø)

...va/org/opensearch/ml/task/MLPredictTaskRunner.java
82.14% <100.00%> (ø)

... and 2 files with indirect coverage changes
Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.


add_sum! cleanup

Considering that add_lincomb! now can take more than two terms, the function add_sum! seems a bit redundant. There seems to be an opportunity to remove code. I think we should

Go through all the uses of add_sum! and see if it can be changed to add_lincomb!
Consider removing the function add_sum
Consider adding a function expand_sum(graph,node): Take essentially the code in add_sum. It can take a :lincomb node and expands it as a sum each sum containing two terms.
Consider removing generators/bigraph.jl (which was needed when we only had two-term version of BLAS-calls)

Point 3 should only be done if we feel it is really needed. Less is more.

I'm closing this for now. Can be reopened if we need expand sum.


Version File in .meta Directories

~The new maintainer dashboard tool expects to find version info for each exercise in its exercises/slug/.meta/version.~
EDIT: Actually the dashboard tool can be set to read the version from any place.
If this track decides to continue on the path of using the .meta/version file to store this information, then should probably be added to the exercises here.
Additionally, I have made a script called bin/version-sync which has been merged.  If contributors wish to continue the currently-not-universal convention of placing the version in the test file, then the helper script will automatically create or update the version file when run after changes.

This is a list of all exercises regarding the presence of version info in the tests file with the following format:
;; Tests adapted from `problem-specifications/canonical-data,json [version number]

[ ] accumulate
[ ] acronym
[x] affine-cipher
[ ] allergies
[ ] all-your-base
[ ] anagram
[ ] armstrong-numbers
[ ] bob
[ ] collatz-conjecture
[ ] difference-of-squares
[ ] etl
[ ] gigasecond
[ ] grains
[ ] grep
[ ] hamming
[ ] hello-world
[x] isogram
[ ] leap
[ ] list-ops
[ ] meetup
[ ] nucleotide-count
[ ] perfect-numbers
[ ] phone-number
[ ] raindrops
[x] reverse-string
[ ] rna-transcription
[ ] roman-numerals
[ ] say
[ ] scrabble-score
[ ] two-fer
[ ] word-count

Neat - thanks for doing this.


Stars duplicity

Stars are not persistent, I can give star to one post many times if I want to (is this time to write a bot to exploit this?)

this is not a bug, it is meant to work that way from the very beginning


can tensorflow/compiler/aot/libruntime.so be renamed?

Describe the problem
linking -lruntime is a bit too generic (and prone to conflicts) for a large project
for instance -lxla_compiled_cpu_function
for
/tensorflow/compiler/tf2xla/libxla_compiled_cpu_function.so
is already more acceptable
In general would be useful for any library required to be linked in user applications to have a more descriptive name that associate it to tensorflow

Thank you for your post. We noticed you have not filled out the following field in the issue template. Could you update them if they are relevant in your case, or leave them as N/A? Thanks.
Have I written custom code
OS Platform and Distribution
TensorFlow installed from
TensorFlow version
Bazel version
CUDA/cuDNN version
GPU model and memory
Exact command to reproduce

Nagging Assignee @tatatodd: It has been 15 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignee @tatatodd: It has been 14 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignee @tatatodd: It has been 50 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignee @tatatodd: It has been 65 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignee @tatatodd: It has been 80 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignee @tatatodd: It has been 95 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignee @tatatodd: It has been 110 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignee @tatatodd: It has been 110 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignee @tatatodd: It has been 125 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignee @tatatodd: It has been 140 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignee @tatatodd: It has been 155 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignee @tatatodd: It has been 170 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignee @tatatodd: It has been 14 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignee @tatatodd: It has been 30 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignee @tatatodd: It has been 45 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignee @tatatodd: It has been 60 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Hi @VinInn,
As per the latest Tensorflow doc, all file names under tensorflow/tensorflow/compiler/aot/ are specific to functions. Thank you!


Print a warning when no spec dummy database.yml exists

When running tests locally for the common gem, the default warning doesn't reference the path
where the database.yml file is missing.
This error message loads from spec_helper.rb and stops the specs
unless the file exists. It also references where the database.yml file should be placed.

cc @lindgrenj6


SARIF Viewer causes VS Code to crash with "The window has crashed (reason: 'oom', code: '-536870904')"

Several users are reporting that launching the SARIF viewer results in:

Disabling the SARIF viewer resolves the issue.

What was the issue here? Was there a fix determined?

@karsharm The linked PR #409 should be the best explanation.


Cannot read property 'kind' of undefined

I am getting this error when running a query. I have never seen this error before and cannot workout what is different.
Any idea what causes 'kind' to be undefined and how I can try and trace the error?

We need more information on your issue like actual error traces and a runnable reproduction.

I get same thing:
vue.esm.js?a026:1741 TypeError: Cannot read property 'kind' of undefined
    at checkDocument (getFromAST.js?e703:15)
    at addTypenameToDocument (transform.js?ff04:94)
    at InMemoryCache.transformDocument (inMemoryCache.js?71f3:202)
    at QueryManager.startGraphQLSubscription (QueryManager.js?96af:594)
    at ObservableQuery.subscribeToMore (ObservableQuery.js?caca:194)
    at SmartQuery.subscribeToMore (vue-apollo.esm.js?522d:928)
    at SmartSubscription.executeApollo (vue-apollo.esm.js?522d:1089)
    at SmartSubscription.start (vue-apollo.esm.js?522d:517)
    at SmartSubscription.autostart (vue-apollo.esm.js?522d:434)
    at DollarApollo.addSmartSubscription (vue-apollo.esm.js?522d:1276)

This is when adding subscribeToMore option to a manually added query (is fine before adding subscribeToMore):
      this.$apollo.addSmartQuery('navSatFixMessage_' + api, {
        client: api,
        query: navSatFixQuery,
        manual: true,
        result: function (data, key) {
          this.navSatFixData[key] = data
          console.log(`key: ${data}`)
        },
        subscribeToMore: navSatFixSubscription
      })

Found the issue for me, it was caused by having a query wrapped in an if statement.
As for this template I pass in things and id is not always set, I thought wrapping in if statement would prevent it from running.
        apollo: {
            data: {
                query() {
                   if(this.id && this.id !== ''){
                    return gql`{}`; // example query
                   }
                },
            }
        },

Turns out there is a skip method designed for this:
        apollo: {
            data: {
                query() {
                    return gql`{}`; // example query
                },
                skip() {
                    return this.id && this.id === ''; // reversed the statement as we want skip to be false
                }
            }
        },


RFC: contrast coding

This PR introduces a system for contrast coding, or controlling how categorical variables are converted into columns in a ModelMatrix.  The basic interface is that the ModelFrame constructor takes an optional keyword argument contrasts, which is a Dict mapping column name symbols to contrasts, specified as subtypes of AbstractContrast or instances thereof.  This addresses (at least partially) #757 and #788.
The code could be cleaned up quite a bit and refactored, but I wanted to get feedback on the general approach so far.  It also still doesn't address the problem of needing to switch contrast coding based on whether or not lower-order effects are also present (also raised in #757), but I'm planning on also implementing those checks.

This is really timely as the issue of contrast coding came this weekend when talking with the folks at Dato about their DataFrame -> Matrix conversion tools.
Excited to review this.

Thanks, this is quite nice! I've only made superficial comments, but the global strategy sounds good to me -- though I'm not a specialist of this code at all.
A feature I've been dreaming of for some time, and which R doesn't have, would be to have the ability to compute the redundant/omitted coefficient after the model has been estimated. This would be extremely useful to print tables for publications. For example, for treatment contrasts, to get the name of the reference level, and the associated coefficient (0). For sum contrasts, it would consist in getting the name of the omitted level, with the coefficient equal to the sum of all coefficients estimated in the model for other levels. A method for each contrasts type could provide this information.

I've updated this PR with the following two big changes:

Split off a ContrastMatrix type that is a contrasts + data and holds the levels, term names, and the actual matrix of contrast codes. The subtypes of AbstractContrast are now just containers for settings that don't depend on the data (e.g., the base index for the contrast).
Introduce checking for non-redundant terms in model matrix construction, and "promote" non-redundant categorical variables to have full rank (#757)

@johnmyleswhite @dmbates Any opinions about our discussion above?

Hm, this PR completely got off the radar. Anybody willing to review?

@kleinschmidt What's the state of this PR? Since nobody else seems to have time to review this, I think we should go ahead with the design we consider as the best one. Would you have time to resume starting on it?

Oof, yeah this did totally fall of the radar (mine included). I might have some time to look at this over the weekend.

I think I now see the appeal of being able to specify the levels directly in the contrast instances (vs. the ContrastMatrix. It would make the code a little messier (and would slightly muddy the currently clear distinction between AbstractContrast subtypes that are independent of data, and ContrastMatrix instances that depend on data), but might improve the interface from the user's point of view. This is related to the suggestion to specify the base level, rather than the base index. It would also allow for things like re-ordering contrast levels in fitting models, or limiting to only certain levels. That might be too clever for its own good though. I'll try this out and see how it feels.
Other than that, the only substantive thing was the possibility of storing contrasts in Terms (from Formulas). But those ultimately get ingested into ModelFrames so that's something that's best tackled separately.
Finally, there are some cosmetic issues: how to format term names, renaming the internal cols function something more descriptive, and possibly other things I've missed.
I think it's worth getting this merged. Currently the generation of model matrices from formulas with categorical variables is broken and this fixes the biggest problems.

Sorry for the delay. This looks really cool, though I've made a lot of comments. I still need to continue reading it to see the bigger picture.

While we're at it, I think we should remove the ModelMatrix type and simply return a NamedArray. Returning an array without any way of identifying columns is a very bad API IMHO.

Thanks for the super thorough review, @nalimilan. I've addressed a lot of your suggestions in the commits I just pushed. There's still a bit more to do in settling on and documenting the names for things, although I might not get around to that till the weekend.

Sorry for the delay. I'll try to find the time review this again, but I think we're coming close.

Do you think you'll be able to fix the remaining points? Let's not leave this PR rot again for months. ;-)

Sorry to let this slide a bit. I'm writing my dissertation at the moment. I'll try to squeeze this in but I'm pretty swamped for the next few weeks.

On Jun 3, 2016, at 10:56 AM, Milan Bouchet-Valat<EMAIL_ADDRESS>wrote:
Do you think you'll be able to fix the remaining points? Let's not leave this PR rot again for months. ;-)
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or mute the thread.

No worries -- I know what this means...

Do you think the PR could be merged in its current state, or maybe with only minimal fixes? Then we could address stylistic comments and performance improvements later. It would be a shame to let this blocked by details.

I think we should hold off on merging this in light of #1017. Also, as discussed on the juliastats list, it's not clear whether DataFrames.jl is the best home for this functionality. On the one hand, it seems more natural to define how to turn categorical variables into model matrix columns in the packages that define the categorical types themselves. On the other hand, I think its good to define the different contrast types themselves in a way that's agnostic to the underlying categorical data representation. Moreover, there are issues in constructing a whole modelmatrix with categorical data that go beyond converting individual categorical variables into columns (e.g., checking for redundancy with lower-order terms). So there's at least some aspects of this PR that should, I think, be included here, and yet others that might be factored out into a contrasts-specific package that others can use to convert categorical data into matrices without needing to put them in a Data/ModelFrame.
Thoughts? @nalimilan @dmbates @ararslan

I was just thinking about this the other day. The modeling stuff (including formulas) seem out of place here; there's nothing inherently statistical about a data frame. IMO a package for data frames should provide the data frame type, which other packages can then extend for particular purposes. See also #1003.

Right. I'm starting to think it makes sense to have something like a
DataFrameModels package that requires little self-contained packages for
Formulas and Contrasts, in addition to DataFrames, and defines the
DataFrameRegressionModel etc. types.
On Thu, Jul 21, 2016 at 3:19 PM, Alex Arslan<EMAIL_ADDRESS>wrote:

I was just thinking about this the other day. The modeling stuff
(including formulas) seem out of place here; there's nothing inherently
statistical about a data frame. IMO a package for data frames should
provide the data frame type, which other packages can then extend for
particular purposes. See also #1003
https://github.com/JuliaStats/DataFrames.jl/issues/1003.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/JuliaStats/DataFrames.jl/pull/870#issuecomment-234355686,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAIS8PRdRLD6PNv_EefvbgElfVfre2wCks5qX8YqgaJpZM4GApdq
.

--
Dave Kleinschmidt
Brain and Cognitive Sciences, University of Rochester
http://www.bcs.rochester.edu/people/dkleinschmidt

@kleinschmidt Agree re small packages used by DataFramesModels, although I might emphasize the role of ModelMatrix rather than the DataFrames aspect of things.  What the whole formula/data representation is about is transitioning from a formula specification plus some kind of associative structure mapping names to vectors to a model matrix of some form.  In R formulas ended up being used for other purposes but I think in modeling the vast majority of uses are for creating a model matrix from a formula.  You don't need a DataFrame specifically for that.  You could construct from a database table or a feather file directly.

I've opened an issue #1018 to discuss this; let's move this discussion there?

I think we should finish and merge this and #1017, and then move the code (preserving git history) to another package as discussed at #1018.

That seems reasonable to me, @nalimilan. I'll wait until #1017 is merged, update this, fix the outstanding issues, and then we can merge this and think about refactoring.

I'm in the process of reconciling this with #1017 before I finish the last few things we talked about here. But I wanted to make a note that I'm more and more convinced that we should be storing contrast information on the Terms object itself. It would substantially clean up the model matrix construction; the strategy from #1017 could be used basically without modification if we annotate the terms/evaluation terms with the contrast information (including whether particular evaluation terms need to be promoted to full-rank dummy contrasts). This would require modifying the Terms object itself when constructing a ModelFrame, and would also (potentially) make the ModelFrame itself kind of redundant, so it's probably something to hold off on until we refactor the modeling stuff out of DataFrames.

I think this is about ready to merge. The last thing to settle is whether to be more specific about types in a few places (I've replied to line comments about that above). @nalimilan, want to take one more look?

(Test failures on appveyor are unrelated, I think; failing in RDA.jl)

I won't have the time to review this again, but since you addressed my comments, I think this can be merged. Do you think you could squash this into a few meaningful separate commits, or would it be too much work?

Okay, thanks for all your careful attention to this! I'll merge tomorrow unless anyone else objects. @johnmyleswhite, @ararslan, @dmbates, speak now or forever hold your peace.

My peace will forever be held. Looks good to me! Great work here!

 Is it okay to use the autosquash "Squash and merge" option?

Yes, that's fine since all changes are logically related.

I just wanted to say thanks for doing such an impressive job with this, @kleinschmidt. This was one of the most impressive PR's I've ever seen in a JuliaStats repo.

Thanks, it was my pleasure! Lots more to work on here :)


association/attribute override

http://www.doctrine-project.org/jira/browse/DDC-964
#218
Hi guys
This patch adds support for AssociationOverride and AttributeOverride.
All drivers are available and some code are changed.
Please take a look again. =)
Thanks

What about overriding the attribute type? It is the developer's responsibility to be careful with it right? :+1:

This doesn't merge new attributes with the existing attribute mapping, which can make for a bit of confusion when using this for the first time.


Problem with RVIZ[BUG]

After loading the PointCloud Map and selecting the NDT Matching, when I open the RVIZ it opens this way.

And I can not see the generated map.
How can I solve this?

Firs make sure the pcd is loaded at 100%. Then, when you open rviz, click on Add -> By topic and select /points_map -> PointCloud2.
When you launch ndt matching as well, use the default rviz config file located at Aslan/src/aslan_tools/rviz/default.rviz.

You said :
"When you launch ndt matching as well, use the default rviz config file located at Aslan/src/aslan_tools/rviz/default.rviz"
How do I do that?

On rviz, click on File -> Open Config and choose the rviz configuration mentioned above

When I run this rviz config file, I cant see the vehicle and the reflections. It seems it is not connected to Aslan anymore.
When I run RViz through the button rviz on the bottom it opens Rviz as the picture I sent and if I add  "Add -> By topic and select /points_map -> PointCloud2." this way I can only see the reflections. But not the generated map.
How to solve it. Because in the Tutorial, the guy just click on Rviz and it shows everything correctly. But this is not the reality.

I assume you are on the step where you are looking to extract the waypoints. In order to do that you need:

A rosbag with recorded topic /points_raw, either from simulation data or the vehicle when driving it manually.
A pcd extracted from this rosbag using ndt_mapping.

Now to extract the waypoints, step by step:

Make sure you don't have anything selected on Aslan and that the simulation is not launched
Select the rosbag on the tools tab. Click on play and then immediately pause to set the /use_sim_time to true
Configuration tab -> Click TF
Perception tab -> Choose your pcd file and wait until it loads to 100%
Perception tab -> Click TF and then select Voxel Grid
Perception tab -> Select NDT Matching
Open rviz and load the default.rviz file. You should not be seeing anything since the rosbag is not running!
Unpause the rosbag. Now you should be seeing the /points_raw from the rosbag and the /points_map from the pcd on rviz. Pause the rosbag again so you can launch the waypoints saver on the next step.
Planning tab -> Click on config next to Waypoints Saver and choose your preferred file path for the waypoints to be saved.
To visualize the waypoints on Rviz: Go to Add -> By Topic -> MarkerArray

Hope this helps!

Hello there,
I am having the same issue, when I un-pause the rosbag I am not able to see points_raw from the rosbag, are there any steps in between? Could you please elaborate?

Can you try the steps again using the rosbag and pcd provided in the project?
If these work, can you confirm that when extracting the pcd and the rosbag, you had TF (Configuration tab) clicked?

I am having a lot of problems to match the position.
My simulation starts with the Twizy in front of the garage door. Then the map was generated.
When I load the map again in a new simulation, with the vehicle in Gazebo in the position as the previus simulation, The Twizy is in a completely different Position in Rviz.

How can I solve it? 2D pose estimate does not do anything.

2D pose estimate is what we are using to move the robot around in rviz, on the localization step. Make sure you click on the car and drag it to the position you want.
The world you are using doesn't have enough features by the looks of it, so the extracted map is not very good. The world you are using a low-cost world for the user to familiarize with the robot and the environment. But it will probably be challenging for mapping and localization.
Please use Default Park instead.

Hello there,
I am facing problems loading the waypoints path, when I ran the file, the path is not loading up, and instead the vehicle is moving, the path is not visible throughout the entire rosbag loading up.

Hi @parth3153,
Please give me more information on the following:

Aslan version, branch, ROS kinetic/melodic, OS
When the vehicle is moving, is it only moving in rviz or also in Gazebo?
Which waypoints file are you using?
Which world did you use to extract it?
Can you share the pcd and the csv?
Have all the steps up until the waypoint loader one, completed correctly? Can you see the car localizing in rviz with ndt matching?

I saved already more than 10 times the same path using WayPoints saver.
But when I load it, it is a completely different Path.
How can I solve this?

This issue was solved after our chat yesterday:
Ndt needs to have enough points to localise with, else it will not work. Waypoints saver will not produce the correct waypoints if localization has an error.  Ndt is a pointcloud scan matching technique, so in order to successfully match the pointclouds, it needs to have enough points. Do not try ndt matching on open space areas, as it will not work. This will also be the case when you try it on the car.
I will open a feature request for improving/debugging the worlds in Gazebo.
Links to #28 #29


Release metatensor-rust v0.1.3

Same as #508 but for the rust crate
Contributor (creator of pull-request) checklist

[ ] ~Tests updated (for new features and bugfixes)?~
[ ] ~Documentation updated (for new features)?~
[ ] ~Issue referenced (for PRs that solve an issue)?~

Reviewer checklist

[x] CHANGELOG updated with public API or any other important changes?

📚 Documentation preview 📚: https://metatensor--509.org.readthedocs.build/en/509/

Given that we need a new release of metatensor-rust for every release of metatensor-core, it might make sense to split the packages differently. A possibility would be to introduce a metatensor-sys package that only builds/find an existing metatensor C library, and keep metatensor as the one with a nice Rust API.


I'm getting 0 for my upload speed

Did some research and saw this was a problem in the past. What's the current recommended fix?
Running on a Raspberry Pi connected directly to my router.

Try the following branch, I believe you should see an improvement:
https://raw.githubusercontent.com/sivel/speedtest-cli/modularize-2/speedtest.py

I installed with PIP and have no idea how to find and/or update that file. :/
Any tips?

Just download it and run it.
wget https://raw.githubusercontent.com/sivel/speedtest-cli/modularize-2/speedtest.py
python speedtest.py

Thanks

While that works... is there a way I can call speedtest-cli like usual, but using that .py file?

pip install -I git+https://github.com/sivel/speedtest-cli.git@modularize-2#egg=speedtest_cli

Sorry for all the questions ... getting an error
copying build/lib.linux-armv7l-2.7/speedtest.py -> /usr/local/lib/python2.7/dist-packages
error: [Errno 13] Permission denied: '/usr/local/lib/python2.7/dist-packages/speedtest.py'

Cleaning up...
Command /usr/bin/python -c "import setuptools, tokenize;file='/tmp/pip-build-WrzdPC/speedtest-cli/setup.py';exec(compile(getattr(tokenize, 'open', open)(file).read().replace('\r\n', '\n'), file, 'exec'))" install --record /tmp/pip-GJRrMw-record/install-record.txt --single-version-externally-managed --compile failed with error code 1 in /tmp/pip-build-WrzdPC/speedtest-cli
Storing debug log for failure in /home/pi/.pip/pip.log

Sounds like you need to run pip via sudo as it is installed in a place unprivileged users don't have access to.
Additionally, I am locking this thread.  This is not the place for linux administration questions.


Desktop Library | Desktop Automation Keywords - Setup and Teardown

Open application keyword modified from AppiumLibarary
Maximize Window keyword added
Documentation generated
A few tests added
Quit and capture screenshot worked as intended so no addition needed

Pull Request Test Coverage Report for Build 146

14 of 32 (43.75%)  changed or added relevant lines in 1 file are covered.
No unchanged relevant lines lost coverage.
Overall coverage decreased (-3.5%) to 96.525%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

src/Zoomba/DesktopLibrary.py
14
32
43.75%

Totals

Change from base Build 143:
-3.5%

Covered Lines:
500

Relevant Lines:
518

💛  - Coveralls

BOOM! Alright back to 100% code coverage.


String operation simplifications

Adds String simplifications (and tests) suggested in #2
String.slice n n string
--> ""

String.slice 0 n string
--> String.left n string

String.slice n 0 string
--> ""

String.slice a z ""
--> ""

String.left 0 string
--> ""

String.left -1 string
--> ""

String.left n ""
--> ""

String.right 0 string
--> ""

String.right -1 string
--> ""

String.right n ""
--> ""

String.slice 1 2 "abc"
--> "b"

String.left 2 "abc"
--> "ab"

String.right 2 "abc"
--> "bc"

There rest is minor changes like "a empty" → "an empty"

Yes, let's add
String.slice 1 2 "abc" --> "b"
String.left 2 "abc" --> "ab"
String.right 2 "abc" --> "bc"

Okay. I'm a bit more wary about these ones but I think it's okay to have them. Do beware of not messing things with Unicode characters though :/
Also, could you add a test for String.slice 0 0 n?

Do beware of not messing things with Unicode characters though

bit confused... How can that be possible? Something to do with how elm-syntax parses things into Literal?
case Maybe.map2 Tuple.pair (Evaluate.getInt checkInfo start) (Evaluate.getInt checkInfo end) of
    Nothing ->
        []

    Just ( startInt, endInt ) ->
        [ let
            sliced =
                String.slice startInt endInt nonEmptyString
            in
            Rule.errorWithFix
            { message = "The call to String.slice will result in \"" ++ sliced ++ "\""
            , details = [ "You can replace this slice operation by \"" ++ sliced ++ "\"." ]
            }
            checkInfo.fnRange
            [ Fix.replaceRangeBy
                checkInfo.parentRange
                sliced
            ]
        ]

bit confused... How can that be possible? Something to do with how elm-syntax parses things into Literal?

I don't know. And that's the problem :sweat_smile:
I can imagine that there could be differences with unicode characters (where a character is in practice 2 characters) or with escaped characters (\" for instance). I'd love a few more tests to make sure we're not changing the result :/

Well you were definitely correct (again). My naiive approach can't work because one of below is true

Literal parsing doesn't un-escape, so writing in elm "\u{000D}" will give you an elm String "\\u{000D}". Slicing this would be lethal
Literal parsing un-escapes, slicing works as expected but we have to re-escape because the sliced Strings might not be valid in elm (like " or control characters). That means figuring out which Chars are printable, returning hex, \ escaping, ... (https://github.com/avh4/elm-format/blob/main/elm-format-lib/src/ElmFormat/Render/Box.hs#L1948)

Not sure which of the 2 is what actually happens but both are a breaker in terms of effort etc.
I think it still makes sense to at least cover cases identity and always "" for String operations.
For List.take,drop it's a different picture, tho

I think it makes sense to (at least in this PR, we can always revisit) not try to compute the result of String.slice based on the value of the string. Let's keep it at looking at the index values and checking whether the string is empty.
We can still have String.slice 10 4 str be simplified to str, since 10 < 4. But let's not evaluate String.slice 4 10 "some literal".

Yeah that'swhat I was trying to say in the last sentence :)


Installation process not clear: Zeromq npm package does not get working, build fails

Inside a docker container i installed zeromq.
The process to install it is here.
But when I install nodejs zeromq package, it does not find build.
Indeed, if I run node-gyp rebuild inside the zmq folder, the build process fails.
 System Linux 3.13.0-66-generic
gyp ERR! command "/usr/local/bin/node" "/usr/local/bin/node-gyp" "rebuild"
gyp ERR! cwd /tmp/app/node_modules/@bitliner/generic-ajax-crawler/node_modules/@bitliner/zmq-producer-wrapper/node_modules/zmq
gyp ERR! node -v v4.2.2
gyp ERR! node-gyp -v v3.2.1
gyp ERR! not ok

Apparently the installation process fails when zmq is a dependency of another module.
Indeed, if I install zmq directly, then everything works fine.
If I install module A that depends on zmq, then the installation of zmq fails.

I found a way to fix it:

upgrade to<EMAIL_ADDRESS>(I was using<EMAIL_ADDRESS>install node-gyp inside the container
cd into each folder containing a zmq npm module
run manually node-gyp rebuild in each folder

I am using node 0.12 (not sure if it works with other versions of node.js).
Maybe using that specific version of zmq and that specific version of node is a solution also for this issue


npm install 0.12.0-beta2

I was wondering why my components were not working locally but perfectly on JSFiddle :
npm install vue

Installs the 0.12.0-beta2 version instead of 0.11.10

0.12 brings some breaking changes (see release notes: https://github.com/yyx990803/vue/releases)
You can just pin it to a specific version: npm install<EMAIL_ADDRESS>

I've also tagged 0.11.10 as the default installed version.

That's exactly what I did, once I figured out what happened, but I thought it would be useful to warn you the newbies (like me) may be messed up with the doc ;)
Now I see the release notes and I wonder what are the official replacements for v-component and v-with which I beacome to be fond of.
By the way, thank you so much for this awesome library !

0.12 is still in development, you can follow along the discussion here: https://github.com/vuejs/Discussion/issues/158


[meta] Reduce dependencies and on-disk footprint

This is a meta ticket to track our on-disk footprint.  We want to:

[ ] reduce our dependencies, including not requiring regex
[ ] graph our on-disk size after stripping, etc (perhaps using PerfHerder, if we can integrate against it from Travis CI/AppVeyor)

See also @thomcc's initial analysis at https://mail.mozilla.org/pipermail/sync-dev/2018-June/001661.html.

I'd also argue for putting tolstoy behind #[cfg(feature = "tolstoy")] (at least until we think we want to use it in production). I think that was one the largest single change I made to reduce the size.


Finish framework support for REAL_MULTIDIM_ARRAYS

Run related CoreCLR tests to verify that it works.

@MichalStrehovsky Could you please take a look?

LGTM otherwise. Thank you for finishing this! I was procrastinating this for too long. You can add "fixes #1103" to the commit message.


Needs cursed annotations

@Init
@PostInit
@Mod
@ClientInit
@ServerInit

how too click clothes on someone else's issue

they're optional @coderbot16, so don't worry. They're planned to be converted by an annotation processor at compile time to non-cursed stuff.

that makes them honestly less cursed than the forge ones, i think they still runtime scan for those

OnlyIn and Dist instead of Environment and  EnvType

This will be moved to a separate project. Expect the unused annotations to be removed from cursed-fabric-loader in a future release

This issue has been closed as invalid

pensieve


How to parse data from a text message ?

I would like to fetch all possible information from a text message. Can someone please suggest which algorithm to use ?.
For Example 1 : If the text message is "Dear Customer, You have made a Debit Card purchase of INR 962.00 on 26 Oct. Info.VPS*Brown House. Your Net Available Balance is INR 584.58."
Card Type : Debit
Transaction type : purchase
Spend Currency : INR
Spend Amount : 962.00
Merchant's Name : Brown House.
Balance Currency : INR
Balance Amount : 584.58
Example 2 : If the text message is "Txn of INR 535 made on Kotak Debit card XX3688 on 09-11-2016 23:13:57 at Namdhari Agro Fresh.Combined balance in A/c XX4827 is INR 3903"
Card Type : Debit
Transaction type : Txn
Spend Currency : INR
Spend Amount : 535
Merchant's Name : Namdhari Agro Fresh
Account Number :  XX4827
Balance Currency : INR
Balance Amount : 3903
P.S : I have very limited knowledge of NLP.

Are these text messages machine generated? As in, are they always going to follow certain patterns? If so, you can probably just get away with using a regular expression (see http://regexr.com/ for some examples).

@skystrife : Yes these messages are machine generated. And yes they do follow the certain pattern but varies whenever sender changes. But all senders try to convey the same message.

@skystrife : Could you please suggest something better than regex ?

95% sure that you could get most of the way there with just a regular expression (or a series of regular expressions), but if you want to feel more "academic" I guess you can get more complicated.
An alternative approach would be to do some kind of sequence modeling using e.g. a conditional random field. This is essentially the field of information extraction.


In-progress upgrade of genetics-app to updated typescript/react/etc.

As a developer I want to be able to build on the genetics app in a strongly typed way leveraging updated features from different libraries because it increases developer velocity, reduces bugs, provides IDE support and allows me to take advantage of new features that make coding more convenient. It also reduces the chances of the app falling out of support eventually, if it falls too far behind on major releases of dependencies.
Background
Provide any necessary background information to provide context on the issue.
I have started an in-progress migration of the genetics-app to updated versions of:

React
MUI
react-router
etc.

and added typescript as well. My fork is here: https://github.com/riyavsinha/open-targets-genetics-app-ts.
I'm seeking feedback on whether this is something that that you would like to keep separate, or if there's interest in eventually merging it back in or using it canonically. Thank you!

Hello @riyavsinha.
We appreciate your effort in migrating the genetics app to Typescript. Unfortunately, we are no longer maintaining the genetics app repository. We migrate the codebase of our two applications to a Monorepo (https://github.com/opentargets/ot-ui-apps), and we are also recently scoping to migrate our components to Typescript (https://github.com/opentargets/issues/issues/2871).
If you are willing to move your current refactor to the monorepo, we'll be more than happy to review it and eventually merge it into our code base.

Ah, thank you for the update!
It may be helpful to update the link here: https://genetics-docs.opentargets.org/technical-pipeline/github-repositories :)


[Green City] Overlapping elements in the header "UBS courier" button and "Search" when to reduce window change by 25%

Environment: IOS Chrome.
Reproducible: always.
https://ita-social-projects.github.io/GreenCityClient/#/ubs
Steps to reproduce

Go to 'https://ita-social-projects.github.io/GreenCityClient/#/ubs'
Click on 'Green City' button

[https://ita-social-projects.github.io/GreenCityClient/#/](u

rl)

no overlapped elements when reduce window change by 25%

20.04.2022 The defect was not fixed
While resizing the page 'UBS courier' label overlaped with the 'Search' icon

I delete Tips*Tricks from Header (another task) and everything started to work!

The bug has been fixed.


Level select should start with the current level selected

The level select always seems to open with the very first level selected, but the default selected item should be the current level.
It seems like this could be a regression from PS Plus? I played at least one game which remembered your position (https://pancelor.itch.io/like-a-hot-knife-through-butter)

I'll take this as a bug.
Fixed. But needs testing.

I can confirm this is fixed on dev-branch. level-select in Wriggle (example project) now launches to display the current-level.