No warning when deleting a dataset used in dashboard native filters

It's helpful that Superset will tell you when you go to delete a dataset, "this is used in 2 charts that appear in 3 dashboards."  But it doesn't report on usage in dashboard filters.  When replacing one dataset with another, the native filter usage needs to be replaced, too, and Superset should alert if deleting the dataset will break filters.
How to reproduce the bug

Create a dashboard and use a dataset column in a filter
Delete the dataset
View the dashboard.  It will have a red box "Cannot load filter"

Expected results
When I try to delete the dataset, the statement about usage should include "and is used in X filters on Y dashboards."
Actual results
No warnings about usage in filters.  Deletion proceeds and the dashboard filters silently break.
Environment
Superset 2.0.1
Edit: I removed a related but separate and less-important part of this issue to focus on the main problem: not warning before deleting.

Related: the user should be warned if a report they try to delete is used in a scheduled report or alert (#23059).

tempted to close this as stale, but let me know your thoughts @sfirke :)

I can try to reproduce it. It was an annoying bug, I deleted a dataset and inadvertently broke a dashboard.

As nice as it would be if someone tackled this, it seems to have gone stale. Feel free to reopen if you see it in current versions and/or want to tackle it ;)

I'm fine with closing it ... it would be a nice addition, but so low priority that it doesn't help to have it linger forever on our open issues.

Exactly... while people don't like their issues closed, wouldn't it be nice to get to a number of issues where we have even a vague idea of what they are and what the priorities might be?


Bootloader not executing bleprph

A problem exists with commit 3c2179243d72731ca017a6201b559b81db7ba815:
$ newt clean nr51_boot
$ newt build nrf51_boot
Building target targets/nrf51_boot
...
Linking bin/targets/nrf51_boot/app/apps/boot/boot.elf
Target successfully built: targets/nrf51_boot

$ newt clean bleprph
$ newt build bleprph
Building target targets/bleprph
...
Linking bin/targets/bleprph/app/apps/bleprph/bleprph.elf
Target successfully built: targets/bleprph

$ newt load nrf51_boot
Loading bootloader

$ newt create-image bleprph 0.0.0
Compiling bin/targets/bleprph/generated/src/bleprph-sysinit-app.c
Archiving bleprph-sysinit-app.a
Linking bin/targets/bleprph/app/apps/bleprph/bleprph.elf
App image succesfully generated: bin/targets/bleprph/app/apps/bleprph/bleprph.img

$ newt load bleprph
Loading app image into slot 1

$ newt debug nrf51_boot

...
(gdb) monitor reset halt
target halted due to debug-request, current mode: Thread
xPSR: 0xc1000000 pc: 0x000000c0 msp: 0x20004000
target halted due to debug-request, current mode: Thread
xPSR: 0xc1000000 pc: 0x000000c0 msp: 0x20004000
(gdb) continue
...
Reset_Handler () at repos/apache-mynewt-core/hw/bsp/nrf51dk-16kbram-openocd/src/arch/cortex_m0/gcc_startup_nrf51.s:140
140         MOVS    R1, #NRF_POWER_RAMONx_RAMxON_ONMODE_Msk
(gdb) backtrace full
#0  Reset_Handler () at repos/apache-mynewt-core/hw/bsp/nrf51dk-16kbram-openocd/src/arch/cortex_m0/gcc_startup_nrf51.s:140
No locals.
(gdb) info registers
r0             0xffffffff       -1
r1             0xffffffff       -1
r2             0xffffffff       -1
r3             0xffffffff       -1
r4             0xffffffff       -1
r5             0xffffffff       -1
r6             0xffffffff       -1
r7             0xffffffff       -1
r8             0xffffffff       -1
r9             0xffffffff       -1
r10            0xffffffff       -1
r11            0xffffffff       -1
r12            0xffffffff       -1
sp             0x20004000       0x20004000
lr             0xffffffff       -1
pc             0xc0     0xc0 <Reset_Handler>
xPSR           0xc1000000       -1056964608

Debugging with GDB reveals: The first time, the reset handler is called (upon microcontroller startup) it runs without problems. The boot process passes through repos/apache-mynewt-core/apps/boot/src/boot.c. The boot_go() function from repos/apache-mynewt-core/boot/bootutil/src/loader.c is invoked and the flash is read. After boot_go() hal_system_start(...) is invoked and for some reason we arrive again in loader.c reading some flash. We arrive in boot.c again and then in the reset handler:

Breakpoint 4, main () at repos/apache-mynewt-core/apps/boot/src/boot.c:55
55          assert(rc == 0);
(gdb)
Continuing.

Breakpoint 1, Reset_Handler () at repos/apache-mynewt-core/hw/bsp/nrf51dk-16kbram-openocd/src/arch/cortex_m0/gcc_startup_nrf51.s:184
184         BL      _sbrkInit

The offending call can be pinpointed:
Breakpoint 6, hal_system_start (img_start=0x8020) at repos/apache-mynewt-core/hw/mcu/nordic/nrf51xxx/src/hal_system_start.c:48
48          fn();
(gdb) s

Breakpoint 5, Reset_Handler () at repos/apache-mynewt-core/hw/bsp/nrf51dk-16kbram-openocd/src/arch/cortex_m0/gcc_startup_nrf51.s:184
184         BL      _sbrkInit

fn() is the call, which performs the jump from bootloader to app image in hal_system_start():
/**
 * Boots the image described by the supplied image header.
 *
 * @param hdr                   The header for the image to boot.
 */
void
hal_system_start(void *img_start)
{
    typedef void jump_fn(void);

    uint32_t base0entry;
    uint32_t jump_addr;
    jump_fn *fn;

    /* First word contains initial MSP value. */
    __set_MSP(*(uint32_t *)img_start);

    /* Second word contains address of entry point (Reset_Handler). */
    base0entry = *(uint32_t *)(img_start + 4);
    jump_addr = base0entry;
    fn = (jump_fn *)jump_addr;

    /* Jump to image. */
    fn();
}

This means, execution fails to jump from bootloader to app.

Breakpoint 2, main () at repos/apache-mynewt-core/apps/boot/src/boot.c:55
55          assert(rc == 0);
(gdb) s
57          hal_system_start((void *)(rsp.br_image_addr + rsp.br_hdr->ih_hdr_size));
(gdb)
hal_system_start (img_start=0x17fff) at repos/apache-mynewt-core/hw/mcu/nordic/nrf51xxx/src/hal_system_start.c:40
40          __set_MSP(*(uint32_t *)img_start);
(gdb) print img_start
$1 = (void *) 0x17fff

A hard fault occurs after that line. The address 0x17fff seems off. I expected 0x8000, the start of image 0 in the linker file.

Apparently this problem is fixed with https://github.com/interoberlin/mynewt-core/commit/a54de3c134f30ef07e70cfa6e51141b63724b8a9.


New Help Command that lists by categories,

Should work as I tested it. Also please just update the repo, also @MihirBhave just downloading the handler and running it gives like 5 errors because this repo is outdated and not synced with the npm package :)

closed as this version has evertything outdated from new version


gem install (and gem rdoc) no longer installs rdoc or ri

After installing yard, neither gem install nor gem rdoc is able to install rdoc or ri, even when specifying --rdoc or --ri.  I imagine that this is not intentional, but maybe I'm missing something.
I tracked the problem down to the fact that the overridden setup/install methods in lib/yard/rubygems/doc_manager.rb is actually more restrictive than the original rubygems version.
I've created a fix that also retains the behavior where has_yardoc? == true inhibits rdoc generation, and tested that the yri, ri, and rdoc are all being generated again by gem update/install/rdoc.  I also tested that yardoc is still generated instead of rdoc when has_yardoc? == true.
Please me know what you think.

dang it, I knew that pull requests created issues, but apparently knowing is only half the battle. ;)


Ability to control voice playback speed

A few people have commented on recent demos (that I've shared) saying that the voice we've used speaks too quickly. Personally, the voice in question (Joanna) is probably the clearest one I've heard but I'll admit that it could indeed be a little slower when talking.
It would be good if Amazon Polly allowed you to control the pitch (or speed) of the voice.

It looks like you can actually control the speed of the speech is you express your text in SSML format, via the  tag, which is detailed here.

https://docs.aws.amazon.com/polly/latest/dg/voice-speed-vip.html

I tried this out on the Amazon Polly web page and it seems to work well, so perhaps this could be incorporated as a feature of AVG through a new environment variable that's a %age value?


GPUImage3 podspec not provided.

When I created a Metal.framework based render pod library, the .metal files include other custom .h files. Then I pod lib lint, it reports error: metal_stdlib not found. So I don't know how GPUImage3 handle the problem I encountered.
Here is my sample project: https://github.com/MrEndlesswhy/DeviceOnlyMetalPod
Many thanks!

Unfortunately, I can't see the linked project, and I don't fully understand the question asked. I don't use CocoaPods myself, so I don't know much about the process.

@BradLarson I've already found a solution, thank you. I'm sorry the link is invalid.
For example, in OperationShaderTypes header file, I added #if __METAL_MACOS__ || __METAL_IOS__ to wrap shader header file, it's ok.
#if __METAL_MACOS__ || __METAL_IOS__

#include <metal_stdlib>

using namespace metal;

// Luminance Constants
constant half3 luminanceWeighting = half3(0.2125, 0.7154, 0.0721);  // Values from "Graphics Shaders: Theory and Practice" by Bailey and Cunningham

struct SingleInputVertexIO
{
    float4 position [[position]];
    float2 textureCoordinate [[user(texturecoord)]];
};

struct TwoInputVertexIO
{
    float4 position [[position]];
    float2 textureCoordinate [[user(texturecoord)]];
    float2 textureCoordinate2 [[user(texturecoord2)]];
};

#endif /* __METAL_MACOS__ || __METAL_IOS__ */

Oh, OK. It was automatically trying to compile the header files independently of Metal. I wonder if there is a way to prevent that aside from the ifdefs.


[BACKLOG-5353] Remove deprecated ThinDriver and related classes from kettle core

Remove Thin* classes
Move org.pentaho.di.core.sql and org.pentaho.di.core.jdbc leftovers to pdi-dataservice-plugin as they are used both in pdi-dataservice-plugin and pdi-dataservice-server-plugin
@hudak please check if my changes in SlaveServerConfig are correct please. I didn't find a place where we use getServices/setServices and removed them so TransDataService class and it's dependencies may be removed as well.

Ideally this should be merged after https://github.com/pentaho/pdi-dataservice-plugin/pull/63 (allowing pdi-dataservices-plugin and pdi-dataservices-server-plugin be compiled) and https://github.com/pentaho/pentaho-platform-ee/pull/921

http://<IP_ADDRESS>:8080/job/wingman/24/

Build Commands:
Build:

ant -Dtestreports.dir=bin/reports/unit-test -Djunit.jvmargs=-XX:PermSize=256m -f core/build.xml clean-all resolve jacoco && ant -Dpentaho.coding.standards.version=1.0.4 -Dtestreports.dir=bin/reports/integration-test -Djunit.jvmargs=-XX:PermSize=256m -f core/build.xml jacoco-integration checkstyle publish-local
ant -Dtestreports.dir=bin/reports/unit-test -Djunit.jvmargs=-XX:PermSize=256m -f engine/build.xml clean-all resolve jacoco && ant -Dpentaho.coding.standards.version=1.0.4 -Dtestreports.dir=bin/reports/integration-test -Djunit.jvmargs=-XX:PermSize=256m -f engine/build.xml jacoco-integration checkstyle publish-local

Cleanup:
rm -r ~/.ivy2/local || echo no publish local to remove
Changed files:
core/src/org/pentaho/di/core/jdbc/FieldVariableMapping.java
core/src/org/pentaho/di/core/jdbc/FoundClause.java
core/src/org/pentaho/di/core/jdbc/RowsResultSet.java
core/src/org/pentaho/di/core/jdbc/ThinConnection.java
core/src/org/pentaho/di/core/jdbc/ThinDatabaseMetaData.java
core/src/org/pentaho/di/core/jdbc/ThinDriver.java
core/src/org/pentaho/di/core/jdbc/ThinParameterMetaData.java
core/src/org/pentaho/di/core/jdbc/ThinPreparedStatement.java
core/src/org/pentaho/di/core/jdbc/ThinResultSet.java
core/src/org/pentaho/di/core/jdbc/ThinResultSetMetaData.java
core/src/org/pentaho/di/core/jdbc/ThinServiceInformation.java
core/src/org/pentaho/di/core/jdbc/ThinStatement.java
core/src/org/pentaho/di/core/jdbc/ThinUtil.java
core/src/org/pentaho/di/core/jdbc/TransDataService.java
core/src/org/pentaho/di/core/sql/IifFunction.java
core/src/org/pentaho/di/core/sql/SQL.java
core/src/org/pentaho/di/core/sql/SQLAggregation.java
core/src/org/pentaho/di/core/sql/SQLCondition.java
core/src/org/pentaho/di/core/sql/SQLField.java
core/src/org/pentaho/di/core/sql/SQLFields.java
core/src/org/pentaho/di/core/sql/SQLLimit.java
core/src/org/pentaho/di/core/sql/ServiceCacheMethod.java
core/test-src/org/pentaho/di/core/jdbc/SQLTest.java
core/test-src/org/pentaho/di/core/jdbc/ThinDatabaseMetaDataTest.java
core/test-src/org/pentaho/di/core/jdbc/ThinPreparedStatementTest.java
core/test-src/org/pentaho/di/core/jdbc/ThinUtilTest.java
core/test-src/org/pentaho/di/core/sql/IifFunctionTest.java
core/test-src/org/pentaho/di/core/sql/SQLConditionTest.java
core/test-src/org/pentaho/di/core/sql/SQLFieldTest.java
core/test-src/org/pentaho/di/core/sql/SQLFieldsTest.java
core/test-src/org/pentaho/di/core/sql/SQLFieldsUnitTest.java
core/test-src/org/pentaho/di/core/sql/SQLTest.java
engine/src/org/pentaho/di/www/SlaveServerConfig.java
Unit test coverage change:
org.pentaho.di.core.Condition:

Branch Change : -11.07%
Complexity Change : -20.41%
Instruction Change : -18.61%
Line Change : -20.72%
Method Change : -53.85%

org.pentaho.di.core.Const:

Branch Change : -.19%
Complexity Change : -.27%

org.pentaho.di.core.exception.KettleSQLException:

Complexity Change : -25.00%
Instruction Change : -25.00%
Line Change : -25.00%
Method Change : -25.00%

org.pentaho.di.core.jdbc.FoundClause:

Complexity Change : -100.00%
Instruction Change : -100.00%
Line Change : -100.00%
Method Change : -100.00%

org.pentaho.di.core.jdbc.RowsResultSet:

Branch Change : -20.00%
Complexity Change : -3.86%
Instruction Change : -7.50%
Line Change : -6.54%
Method Change : -2.60%

org.pentaho.di.core.jdbc.ThinDatabaseMetaData:

Branch Change : -23.33%
Complexity Change : -6.63%
Instruction Change : -53.73%
Line Change : -37.66%
Method Change : -6.63%

org.pentaho.di.core.jdbc.ThinPreparedStatement:

Branch Change : -15.56%
Complexity Change : -18.39%
Instruction Change : -29.87%
Line Change : -26.19%
Method Change : -20.97%

org.pentaho.di.core.jdbc.ThinResultSetMetaData:

Branch Change : -11.76%
Complexity Change : -12.82%
Instruction Change : -17.65%
Line Change : -20.45%
Method Change : -16.67%

org.pentaho.di.core.jdbc.ThinStatement:

Complexity Change : -3.64%
Instruction Change : -3.12%
Line Change : -5.97%
Method Change : -4.26%

org.pentaho.di.core.jdbc.ThinUtil:

Branch Change : -82.95%
Complexity Change : -73.65%
Instruction Change : -90.95%
Line Change : -89.04%
Method Change : -93.10%

org.pentaho.di.core.row.RowMeta.RowMetaCache:

Branch Change : -5.56%
Complexity Change : -5.88%
Instruction Change : -1.20%
Line Change : -2.38%

org.pentaho.di.core.row.ValueMetaAndData:

Complexity Change : -16.67%
Instruction Change : -4.49%
Line Change : -7.69%
Method Change : -30.77%

org.pentaho.di.core.sql.IifFunction:

Branch Change : -38.89%
Complexity Change : -33.33%
Instruction Change : -54.55%
Line Change : -57.45%
Method Change : -50.00%

org.pentaho.di.core.sql.SQL:

Branch Change : -80.00%
Complexity Change : -50.91%
Instruction Change : -76.48%
Line Change : -61.16%
Method Change : -45.71%

org.pentaho.di.core.sql.SQLAggregation:

Complexity Change : -80.00%
Instruction Change : -93.67%
Line Change : -100.00%
Method Change : -80.00%

org.pentaho.di.core.sql.SQLCondition:

Branch Change : -65.56%
Complexity Change : -56.72%
Instruction Change : -79.33%
Line Change : -77.96%
Method Change : -59.09%

org.pentaho.di.core.sql.SQLField:

Branch Change : -70.67%
Complexity Change : -49.32%
Instruction Change : -68.19%
Line Change : -62.42%
Method Change : -45.71%

org.pentaho.di.core.sql.SQLFields:

Branch Change : -79.63%
Complexity Change : -66.00%
Instruction Change : -90.71%
Line Change : -83.33%
Method Change : -73.91%

org.pentaho.di.core.sql.SQLLimit:

Branch Change : -70.00%
Complexity Change : -54.55%
Instruction Change : -92.68%
Line Change : -83.87%
Method Change : -66.67%

org.pentaho.di.core.xml.XMLHandler:

Branch Change : -.68%
Complexity Change : -.72%
Instruction Change : -1.00%
Line Change : -.94%
Method Change : -1.52%

org.pentaho.di.core.injection.bean.BeanInjector:

Branch Change : -1.27%
Complexity Change : -2.00%

org.pentaho.di.job.entries.sql.JobEntrySQL:

Instruction Change :  + 1.64%
Line Change :  + 1.94%

org.pentaho.di.repository.kdr.KettleDatabaseRepositoryCreationHelper:

Branch Change :  + 1.64%
Complexity Change :  + .69%
Instruction Change :  + 2.43%
Line Change :  + 3.70%

org.pentaho.di.trans.step.StepMeta:

Instruction Change :  + .19%
Line Change :  + .27%

org.pentaho.di.trans.steps.excelwriter.ExcelWriterStepMeta:

Instruction Change :  + .08%

org.pentaho.di.trans.steps.sortedmerge.SortedMergeMeta:

Instruction Change : -.18%

org.pentaho.di.www.SlaveServerConfig:

Branch Change :  + 1.56%
Complexity Change :  + .66%
Instruction Change :  + .38%
Line Change :  + .42%
Method Change :  + .26%


Does the withLength method when defining a TextColumn have exclusive max?

https://pub.dev/documentation/moor/latest/moor/TextColumnBuilder/withLength.html
If I define a table column as:
TextColumn get code => text().withLength(min: 6, max: 8)();
Will I be able to insert an entity with a code of length 8?

Yes, its inclusive:
https://github.com/simolus3/moor/blob/727c30aa6bc264fd36fcbb9a305b71fd2f479079/moor/lib/src/runtime/query_builder/schema/columns.dart#L178-L181
I'll change the Dart documentation to point that out.


Release 0.0.5 for NPM

I notice my type fix PR has been merged, and it would be great if that is included in the NPM package through a release.

I've released as 0.1.0 instead as there have been feature additions since the last release.

awesome, thanks!


PyOxidizer

Project description
Rust tool for producing binaries which embed the Python runtime.
Metadata

homepage URL: https://github.com/indygreg/PyOxidizer
source URL: https://github.com/indygreg/PyOxidizer
license: mpl-2.0
platforms: all

see https://github.com/indygreg/PyOxidizer/issues/231#issuecomment-710027311 for a working shell.nix snippet

Closing this as I'm no longer interested in using PyOx with nix.

FYI, I packaged pyoxidizer in Nix, using a nixpkgs compatible approach including a python module over here: https://github.com/DLR-FT/seL4-nix-utils/blob/2963d127a04ca26991c0efe5a8aa30a1c07c9b53/pkgs/pyoxidizer.nix


Night CI 2023-07-02: Failed

action url: https://github.com/kdoctor-io/kdoctor/actions/runs/5438337461

fix #55


Update readme

Thanks for clarifying the deploy instructions!
I'm curious what this step is for: mysql -uquarry -h <trove hostname created in last step> -p < schema.sql? Surely there's no new db being created with a new deployment, so why do we have to populate the schema again?

I'm curious what this step is for: mysql -uquarry -h <trove hostname created in last step> -p < schema.sql? Surely there's no new db being created with a new deployment, so why do we have to populate the schema again?

That's a good point. I'll open a new pr and move that to the fresh install section.


[$500] Deleted IOU offline disappears after going online if it has already been paid for by another user.

If you haven’t already, check out our contributing guidelines for onboarding and email<EMAIL_ADDRESS>to request to join our Slack channel!

Version Number: 1.4.13-0
Reproducible in staging?: y
Reproducible in production?: y
If this was caught during regression testing, add the test name, ID and link from TestRail:
Email or phone of affected tester (no customers):
Logs: https://stackoverflow.com/c/expensify/questions/4856
Expensify/Expensify Issue URL:
Issue reported by: Applause - Internal Team
Slack conversation:
Action Performed:

Open New Expensify app or https://staging.new.expensify.com/
Log in with separate accounts in the main testing device and a secondary device
In the main testing device create an 2 IOU with a user
Disable the internet connection in the main testing device
On the main test device (offline), cancel one of the sent IOU
In the secondary device (online), mark all IOU as paid with the "Pay elsewhere" option.
Enable the internet connection in the main testing device
On the main device, delete the error "Unexpected error deleting the money request, please try again later" in the IOU report

Expected Result:
Once the error has been removed, the primary device should display the paid IOU that failed to be removed.
Actual Result:
Deleted IOU offline disappears after going online if it has already been paid for by another user.
Workaround:
Unknown
Platforms:

Which of our officially supported platforms is this issue occurring on?

[x] Android: Native
[x] Android: mWeb Chrome
[x] iOS: Native
[x] iOS: mWeb Safari
[x] MacOS: Chrome / Safari
[x] MacOS: Desktop

Screenshots/Videos
Add any screenshot/video evidence
https://github.com/Expensify/App/assets/93399543/365287d2-bc64-4924-b913-8054641bfa9b
View all open jobs on GitHub
Upwork Automation - Do Not Edit

Upwork Job URL: https://www.upwork.com/jobs/~01fed1ad1953a51e12
Upwork Job ID:<PHONE_NUMBER>511918592
Last Price Increase: 2023-12-15

Proposal
Please re-state the problem that we are trying to solve in this issue.
Deleted IOU offline disappears after going online if it has already been paid for by another user
What is the root cause of that problem?
In here we only clear errors in the reportAction the pendingAction still delete
So the IOU will hide because this condition
https://github.com/Expensify/App/blob/e23eebe20262439c1eae2d5c7d826cc61652b4ba/src/components/OfflineWithFeedback.tsx#L92
What changes do you think we should make in order to solve the problem?
We should remove the pendingAction when clear the error message too.
What alternative solutions did you explore? (Optional)

Dupe of 26511
Closing

@abekkala hi, can you recheck this please? The issue still happens.

@abekkala bump

@hoangzinh is either proposal above sufficient? Do you have feedback for them or do we need different proposals?

PR is ready
cc: @hoangzinh

PAYMENTS FOR JAN 25

Issue reported by: Applause - Internal Team
Fix: @bernhardoj automatic offer
PR Review: @hoangzinh automatic offer


MediaWiki ouath integration work

Placeholder for the mediawiki work, see requirements doc, exact requirements here need to be fleshed out.

Media-wiki is to be scrapped so closing this as it will be irrelevant. cc @PhilipHarney


[regionOfInterest] missing signal 'editingFinished' ?

It would be interesting to have an 'editingFinished' signal for RegionOfInterest.
For example in the case of computing statistics on specific plot item and region of interest, computation can be time consuming. So if we compute it for each new anchor position it will be a nightmare.
We should only recompute those when the edition is finished.
Or maybe the emission of regionChanged signal can be changed.

Might be deep change (up to silx.gui.plot.items.core.Item ?)


[question] tools for creating graphics

Hello.
Could you tell, what tool did you use for creating such beautiful graphics?

您好，我已经收到您的周报，周报收取截止时间为每周二下午八点，八点后将截止收取，请按时发送您的周报，谢谢！

您的邮件我已收到，将尽快回复！！

the above replies translate to:
Hello, I have received your weekly report. The deadline for collecting the weekly report is 8:00 pm every Tuesday. Collection will be closed after 8:00. Please send your weekly report on time. Thank you!

I have received your email and will reply as soon as possible! !

looks like unintended messages.
to the OP: if still relevant, pls resubmit with the reference to the specific image.


Mypy errors when generating migration

Generating the migration goes well and executing works like a charm, however mypy has a few complaints:
migrations/versions/cd7033b17112_update_form_component_types_enum.py:13: error: Module "alembic_postgresql_enum" does not explicitly export attribute "TableReference"  [attr-defined]
migrations/versions/cd7033b17112_update_form_component_types_enum.py:26: error: Module has no attribute "sync_enum_values"  [attr-defined]
migrations/versions/cd7033b17112_update_form_component_types_enum.py:44: error: Module has no attribute "sync_enum_values"  [attr-defined]

I'm running mypy in strict mode btw. I suppose the first one could be fixed easily by either defining __all__  in the __init__.py or by using:
from .get_enum_data import ColumnType as ColumnType
from .get_enum_data import TableReference as TableReference

instead of:
from .get_enum_data import ColumnType, TableReference

Not sure how to go about fixing the others though.

Hi guys, I saw your PR where you seem to allow ignoring type errors?
Could you explain how this solves the issue? At least in part it is possible to solve the issue by using the suggestion above, so I don't really understand the ignore solution and how I can get rid of the errors that are already there right now.

https://github.com/Pogchamp-company/alembic-postgresql-enum?tab=readme-ov-file#configuration
You can now configure our library to add type ignore automatically


Username required, but not valid?

I installed the ourgroceries component and added the section to my configuration.yaml.
Here's how it went...
config:
ourgroceries:
  username: !secret our_groceries_username
  password: !secret our_groceries_password

error:
Invalid config for [ourgroceries]: [username] is an invalid option for [ourgroceries]. Check: ourgroceries->username. (See ?, line ?). Please check the docs at https://home-assistant.io/components/ourgroceries/
config:
ourgroceries:
  #  username: !secret our_groceries_username
  #  password: !secret our_groceries_password

error:
Invalid config for [ourgroceries]: required key not provided @ data['ourgroceries']['password']. Got None
required key not provided @ data['ourgroceries']['username']. Got None. (See ?, line ?). Please check the docs at https://home-assistant.io/components/ourgroceries/

config:
ourgroceries:
  #   username: !secret our_groceries_username
  password: !secret our_groceries_password

error:
Invalid config for [ourgroceries]: required key not provided @ data['ourgroceries']['username']. Got None. (See /home/homeassistant/.homeassistant/configuration.yaml, line 117). Please check the docs at https://home-assistant.io/components/ourgroceries/
config:
ourgroceries:
  username: !secret our_groceries_username
  password: !secret our_groceries_password

error:
Invalid config for [ourgroceries]: [username] is an invalid option for [ourgroceries]. Check: ourgroceries->username. (See ?, line ?). Please check the docs at https://home-assistant.io/components/ourgroceries/
So a username is required, but yet a username is an invalid option?  So confusing.  My username is, as required by ourgroceries in the<EMAIL_ADDRESS>format.

what version of ha?

Ouch, my apologies!
HA version: 0.96.0
component version: 81bf0cc

Weirdly enough, I started getting this today too when validating the config but when I restart home assistant, everything runs just fine. Removing these required fields makes the validator complain a required field is missing so I think this is a bug in home assistant itself.

So I just went in, un-commented everything, the did a systemctl restart rather than the HA Gui restart.  This time it was able to start up HA, but not without an interesting errors (truncated for possible security)...
ourgroceries found _session_key <session_key identifier>
and
ourgroceries found team_id <team_id identifier>

yeah ive updated that meant to out logger.debug

If I restart via the HA gui, I get the “invalid option” error.
Component version: 1.1.0

is the sensor at least showing up? should be sensor.our_groceries

I am seeing the sensor.  I tried to put it in lovelace as a "custom:list-card" but nothing shows.
- columns:
              - field: shopping_lists
                title: Shopping Lists
              - field: recipies
                title: Recipies
            entity: sensor.our_groceries
            row_limit: 20
            title: Our Groceries
            type: 'custom:list-card'

i too am seeing this issue. After you fixed the sensor not showing up at all in the last update, i am getting the same error when i "check config".
Sensor is working correctly though.

same issue for me also .. i am on 0.96.5. cant validate the config/ cant restart from gui. after system restart able to see the sensor

updated to 1.1.2 and this issue is still happening

Did you try restarting HA? I had the same issue until I restarted and tried validating

Yes, i restarted and was still getting the error. I just upgraded to 1.2.0 and issue seems resolved.


Undo Branches

One very useful feature in vim is undo branching.  I'm sure this may be a more complex feature, but it can be a real life saver.  Let's say I make some changes, undo them, and then start typing again, only to realize that I needed some of those other changes.  Without undo branches, those changes are gone.  With them, I am free from worry about losing work! :)
See: http://vim.wikia.com/wiki/Using_undo_branches

Oh, I had no idea about this feature! Cool!
But I think it would be better in atom rather than in vim-mode. I don't know if a package could do it, or if it would need to go in the core.

Yeah, it's a great feature.
I was wondering the same thing - if it's something that would be better in Core...

Opened a ticket there.  Will have to see what they say: https://github.com/atom/atom/issues/7917

As stated in the README, this package is no longer maintained and is deprecated. We recommend that people use the vim-mode-plus package instead. Because of this, we are archiving this repository and closing all issues and pull requests. Thanks very much for your support and contributions!


User login

Users to be logged in by email, not by username. Duplicated usernames issue may occur when users are registered from multiple hospitals. Emails should be unique for every hospital and no duplicate users problem should occur

We talk about different emails for different clinics, if we register for every clinic different email, it will be dificult for doctors to check every registered email for recieved messages.


Pachyderm 1.4 release blockers

These are the things that must be done before we cut the 1.4 release, in no particular order:

[x] pachctl get-logs (PR is there, needs to be merged)
[x] Load testing / benchmarks.  Ideally by the release date, we'd have CI set up such that it runs benchmarks daily, but if not, we need to at least have run the benchmarks manually on an actual cloud provider (AWS > Azure > GCE, in terms of priority) and make sure that the results don't seem too surprising.
[x] pachctl put-file pfs://path (PR is there, needs to be merged)
[x] Documentation (notably including migration docs)
[x] Run etcd as a stateful set with persistent volumes
[x] Egress support
[x] Merge with master
[x] put-file -c, and potentially make it so that start-commit repo branch succeed even if branch doesn't exist.

Following are the things that would be very nice to get done, but it's acceptable if they don't make it into 1.4.

[ ] Incremental pipelines (similar to /prev).
[ ] Make a pass at all test suites and fix them as needed.

I think another must is:

[ ] put-file -c and start-commit repo branch (#1422)

That syntax is pretty ubiquitous from what I understand.
I also think merging with master is kind of a must, for one thing it has a number of bug fixes that have been added since the last merge and it'd be pretty bad to regress on those. But also just from a development hygiene perspective I think getting everyone onto the same branch at release time is a good practice and will prevent some headaches.

I suspect that most of the "bug fixes" are for code that don't exist anymore in 1.4, but I suppose it makes sense to at least try to merge master and see if we are indeed missing important stuff.
Just to be clear though, the current master branch will need to be moved to something like a 1.3 branch anyways, right?  We talked about how we want to support both release branches for a while.
Updating the task list to reflect the discussion.

Some of the bug fixes are pretty generic stuff though, like all of the fixes I made for object store retries. There isn't a good way to distinguish between stuff that applies and stuff that doesn't other than to merge it in.
And yeah, breaking current master off into 1.3 so we can backport fixes if need be is a good idea.

The 2 remaining issues have been broken out into separate issues #1584 and #1580.


[FLINK-17284][jdbc][postgres] Support serial fields

What is the purpose of the change
This pull request allows to read and write serial fields
Brief change log
From types spec listed in https://www.postgresql.org/docs/12/datatype-numeric.html, handled serial types in  in PostgresCatalog.fromJDBCType:

serial, serial2 , serial4  as INT
bigserial, serial8 as BIGINT
smallserial as SMALLINT

Verifying this change
This change is a trivial rework / code cleanup without any test coverage.
However serial type is auto-incremented: you can write a value into it but if you try to autogenerate a value you get duplicate values until you find a value that is not already in use. However Flink does not keep track of the original field type so there's no way to warn the user that is not using this field correctly (he/she should use DEFAULT or not specify any value for such columns).
Does this pull request potentially affect one of the following parts:

Dependencies (does it add or upgrade a dependency): no
The public API, i.e., is any changed class annotated with @Public(Evolving): no
The serializers: no
The runtime per-record code paths (performance sensitive): no
Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn/Mesos, ZooKeeper: no
The S3 file system connector: no

Documentation

Does this pull request introduce a new feature? no
If yes, how is the feature documented? not documented

@flinkbot run travis
@flinkbot run azure

@fpompermaier thanks for your PR.  Can you rebase the PR and revert the decimal part?

Hi @fpompermaier , yes, your understanding in your email is right, and #12090 LGTM. Can you rebase the PR and revert the decimal part?

I'll do it after the merge of the other PR otherwise I'm always on solving conflicts

Addressed comments. Now the PR should be ok

Updated PR to resolve conflicts

Rebased again..

@wuchong or @leonardBang ? Do you have time to review this?

@wuchong or @leonardBang ? Do you have time to review this?

Thanks for the effort @fpompermaier , I'll look in this weekends. ^_^

Suggestions accepted @leonardBang

CC @wuchong +1 to merge


sigProfilerExtractor for ID(INDELS)

Hi, I am running sigProfilerExtractor for SNVs and Indels. It's running successfully for SNVs but getting error for INdels.
Below is the command I am using :
sig.sigProfilerExtractor("matrix", "SOMATIC_BloodResults_Pon_IDs_Test", "/pathtotheinput/input.ID96.txt", reference_genome="GRCh37", minimum_signatures=1, maximum_signatures=10, nmf_replicates=100)
I am getting following error after it runs 1st signature:
.local/lib/python3.7/site-packages/sigProfilerPlotting/sigProfilerPlotting.py", line 1040, in plotSBS
plt.text(0.045, 0.75, sample + ": " + "{:,}".format(int(total_count)) + " subs", fontsize=60, weight='bold', color='black', fontname= "Arial", transform=plt.gcf().transFigure)
ValueError: cannot convert float NaN to integer
Please guide me on how to run indels for matrix input and which matrix file I should use for indels ( I am using ID96.all) and how to overcome this error?

Hi @shanimalik86,
Could you please provide the JOB_METADATA.txt in the output directory?
Thanks!

Hi, Thanks for your response.
Below I copied the JOB_METADATA.txt
THIS FILE CONTAINS THE METADATA ABOUT SYSTEM AND RUNTIME
-------System Info-------
Operating System Name: Linux
Nodename: ai-hpcgpu15
Release: 3.10.0-1160.11.1.el7.x86_64
Version: #1 SMP Mon Nov 30 13:05:31 EST 2020
-------Python and Package Versions-------
Python Version: 3.7.3
SigProfilerExtractor Version: 1.1.15
SigProfilerPlotting Version: 1.3.2
SigProfilerMatrixGenerator Version: 1.2.13
SigProfilerAssignment Version: 0.0.19
Pandas version: 1.2.4
Numpy version: 1.21.6
Scipy version: 1.7.3
Scikit-learn version: 1.0.2
--------------EXECUTION PARAMETERS--------------
INPUT DATA
input_type: matrix
output: SOMATIC_SalivaResults_Pon_IDs
input_data: /hpcdata/dir/ZEESHAN/2024-03-02-mutationalsignature/SOMATIC_Saliva_Pon/SALIVA_Extractor/SALIVA_PON.ID96.txt
reference_genome: GRCh37
context_types: SBS96
exome: False
NMF REPLICATES
minimum_signatures: 1
maximum_signatures: 10
NMF_replicates: 100
NMF ENGINE
NMF_init: random
precision: single
matrix_normalization: gmm
resample: True
seeds: random
min_NMF_iterations: 10,000
max_NMF_iterations: 1,000,000
NMF_test_conv: 10,000
NMF_tolerance: 1e-15
CLUSTERING
clustering_distance: cosine
EXECUTION
cpu: 56; Maximum number of CPU is 56
gpu: False
Solution Estimation
stability: 0.8
min_stability: 0.2
combined_stability: 1.0
allow_stability_drop: False
COSMIC MATCH
opportunity_genome: GRCh37
cosmic_version: 3.3
nnls_add_penalty: 0.05
nnls_remove_penalty: 0.01
initial_remove_penalty: 0.05
export_probabilities: True
collapse_to_SBS96: True
-------Analysis Progress-------
[2024-03-11 15:37:32] Analysis started:
##################################
[2024-03-11 15:37:32] Analysis started for SBS96. Matrix size [96 rows x 79 columns]
[2024-03-11 15:37:32] Normalization GMM with cutoff value set at 9600

I got SALIVA_PON.ID96.all from Matrix script and changed  the extension to .txt and gave this file to Sigprofile extractor> I followed the same process which I did for SNVs but For ID(INDEL analysis) I get error

If you are still encountering this issue, please first update to sigProfilerPlotting v1.3.22. If the issue persists, please re-open this issue. Thanks!


Support multiple YAML documents separated by ---

Customer request to support multiple YAML documents with --- document separators.
(check that it is valid YAML though)
e.g.

---
apiVersion: v1
kind: hostEndpoint
metadata:
   ....

---
apiVersion: v1
kind: hostEndpoint
metadata:
   ...

This will be a tricky one to implement as it'll require some changes to the YAML parser.

Isn't this just part of the yaml spec (i.e. multiple documents?) http://yaml.org/spec/1.2/spec.html#id2800132


When using generate staticPaths, staticProps and then use it to get page - it always says 404. Only works for fallback: 'blocking'

Describe the bug
Hi, I'm trying to use generating static pages

Created paths

Get static props get never fired and always throws an error 404 event if path is 100% matching

Expected behavior
Path is matching and I see pre-rendered page
To Reproduce

Repository URL: Repo is private
Version

next.js: 13.0.7
nest: 8.4.4
nest-next: 10.1.0

Additional context
Add any other context about the problem here.

also using this controller code

Hey please provide a minimal reproducible sample. Keep in mind that nest is the entry point so all requests will hit a node server before being forwarded to next.

Finally can send you a repo to check this one. It's pretty simple, run:

npm i
npm run dev
Go to http://localhost:7000/apps/app1 static page render - not working
Go to http://localhost:7000/about - server side render - working well

REPO: https://github.com/NazariiStrohush/nest-next-sample/
Need to help configure how to work for both types not only SSR...

Hi there! I think the reproduction repo is very complex and requires at least some familiarity with Apollo to understand what's happening. The complexity leads me to thinking that the issue might not be lying the nest-next itself.
I'd try booting Nest (npm run dev in you repo) and Next (next dev) separately and side by side. Apollo (inside Next app) should be configured to fetch data from Nest instance (I assume required endpoints are exposed by the Nest app). If the issue persists - it certainly is not caused by nest-next. In your repo you would also need to move pages out of views dir since that is a nest-next feature.
If the issue persists, a less complex reproduction example is needed without external dependencies.

@yakovlev-alexey Ok, I even can reproduce modifying current repo examples, I will create a new one simplified and share it here


Improve mAP performance

What does this PR do?
Fixes #677
Work of @tkupek @OlofHarrysson  @twsl
First steps to get performance on par with pycocotools/numpy
Before submitting

[x] Was this discussed/approved via a Github issue? (no need for typos and docs improvements)
[x] Did you read the contributor guideline, Pull Request section?
[ ] Did you make sure to update the docs?
[ ] Did you write any new necessary tests?

PR review
Anyone in the community is free to review the PR once the tests have passed.
If we didn't discuss your PR in Github issues there's a high chance it will not be merged.
Did you have fun?
Make sure you had fun coding 🙃

The performance improvements are great and really necessary.
However, CUDA calculations are still by a factor 9-10 slower than CPU. Computations are not CUDA optimized and I don't know if it's possible (or how much effort it is).
Running metric on 10 samples on cuda:0
Total time: 8.060346603393555
Time per sample 0.8060346603393554

Running metric on 10 samples on cpu
Total time: 0.98065185546875
Time per sample 0.098065185546875

Until then, I suggest to make the mAP metric CPU only, to avoid that somebody uses the slow CUDA version.
I would move everything to CPU, as we did it with the pycocotools implementation.
@twsl @Borda @OlofHarrysson @SkafteNicki

Until then, I suggest to make the mAP metric CPU only, to avoid that somebody uses the slow CUDA version.
I would move everything to CPU, as we did it with the pycocotools implementation.

sounds reasonable to me :rabbit:

@tkupek @OlofHarrysson @twsl thanks for really trying to improve performance for this metric.
I agree that we should merge this and do a small release.
However, out hole GPU testing pipeline is down at the moment so no PRs are currently getting merged :(

@Borda please approve and merge.
Passes locally for multi-gpu support:

Pycocotools (previous implementation): 74.91s
Current implementation: 1742.07s
This branch: 140.79s
Further improvements should be done to get closer to the pycocotools benchmark.

@twsl @tkupek do you think that you can make further improvements to get speed parity with cocotooks?

Unfortunately, I don't have any concrete ideas in mind, nor the time to look at it right now.

I might give it another shot after i handed in my thesis next week. But cant promise any results or timeline


Description of (Win + arrow option) is not matched in FancyZones

Microsoft PowerToys version
'0.37.2'
Running as admin

[X] Yes

Area(s) with issue?
FancyZones
Steps to reproduce

Check 'Override Windows...' checkbox on Window behavior in FancyZones.
Check radio button.

✔ Expected Behavior
When check first radio button, override Win + Left/Right.
When check second radio button, override Win + Up/Down/Left/Right.
❌ Actual Behavior
The two explanations worked in reverse.
Other Software
No response

@taerok can you please create a bug report using the tool and attach it here?
Also, I would appreciate it if you record a video record or a gif with this behavior. It could help to investigate the problem.

Sorry,  @SeraphimaZ . I don't know path where 'bug report file' is created.
Here is recording video.
https://user-images.githubusercontent.com/8789112/121280269-fa3ea000-c910-11eb-8695-887e60f41423.mp4

@taerok, thank you for the video. As I can see there, you have 3 columns in your layout, so when you select Win + Up/Down/Left/Right, there's just no room for moving the window up or down. If you select for example grid with 4 zones, you would be able to move a window using Win + Up Arrow and Win + Down Arrow.
When the Win + Left/Right is selected, you see the standard Windows behavior using Win + Up Arrow and Win + Down Arrow.

@taerok how do you think it should work in this scenario when you have the second radio button enabled?  typically with arrows, it is for layouts where we really do have zones that are high and low.  As @SeraphimaZ stated, hitting up / down in a 3 column / priority grid layout, there are no zones above or below it.
Win+Up/Down when only overriding left/right arrows work appropriately as maximize / minimize is how Windows handles it

I had basic knowledge that is standard Windows behavior using Win + Up Arrow and Win + Down Arrow . I didn't understand the overriding behavior of FancyZones until your explanation. After understanding how is working, I think the behavior is more intuitive now.
Thank you.


Add API to update speed limits for lanes and publish LaneStates message

Requires: https://github.com/open-rmf/rmf_internal_msgs/pull/43
This PR adds two new public APIs to FleetUpdateHandle

void limit_lane_speeds(std::vector<SpeedLimitRequest> requests) : To impose speed limits on lanes where SpeedLimitRequest is a pimpled class. I'm not sure if its better to have this as a class or define it as an unordered_map<std::size_t, double>. Or even just std::vector<rmf_fleet_msgs::msg::SpeedLimitedLane>. Alternatively, would it be better to just accept std::vecotr<rmf_fleet_msgs::msg::SpeedLimitRequest> and have a single API limit and remove lane speeds?

void remove_speed_limits(std::vector<std::size_t> requests): To remove any imposed speed limits

Anytime lanes are open/closed or speed limits are changed, a LaneStates msg is published over /lane_states topic.
I've also updated the implementation in the legacy full_control adapter to include a subscription interface for SpeedLimitRequest. It still publishes the /closed_lanes topic which is technically deprecated by the newer /lane_states that includes speed limited lanes.
TODO: Update python bindings once CPP API passes review.

I'm having a bit of trouble compiling this under Humble, specifically it can't find the header for tf2_geometry_msgs.
luca@luca-jammy:~/rmf_ws$ colcon build --cmake-args -DCMAKE_BUILD_TYPE=Release --packages-select rmf_obstacle_ros2
Starting >>> rmf_obstacle_ros2
--- stderr: rmf_obstacle_ros2
/home/luca/rmf_ws/src/rmf/rmf_ros2/rmf_obstacle_ros2/src/lane_blocker/LaneBlocker.cpp:28:10: fatal error: 'tf2_geometry_msgs/tf2_geometry_msgs.h' file not found
#include <tf2_geometry_msgs/tf2_geometry_msgs.h>
         ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1 error generated.
gmake[2]: *** [CMakeFiles/lane_blocker.dir/build.make:76: CMakeFiles/lane_blocker.dir/src/lane_blocker/LaneBlocker.cpp.o] Error 1
gmake[1]: *** [CMakeFiles/Makefile2:223: CMakeFiles/lane_blocker.dir/all] Error 2
gmake: *** [Makefile:146: all] Error 2
---
Failed   <<< rmf_obstacle_ros2 [8.20s, exited with code 2]

Upon further probing I noticed that it's due to a change in the installation path, specifically due to this PR:
/opt/ros/galactic/include/tf2_geometry_msgs/tf2_geometry_msgs.h
/opt/ros/humble/include/tf2_geometry_msgs/tf2_geometry_msgs/tf2_geometry_msgs.h

It seems that the target_link_libraries / target_include_directories way of adding the dependency doesn't work anymore, instead because of this PR from Humble onwards you can just add tf2_geometry_msgs::tf2_geometry_msgs to your target_link_libraries and it works just fine.
I'm not quite sure if there is a way to keep both ways to make sure it works in both Galactic and Humble

@mxgrey if the changes here are good I can update the python bindings and try to get this merged for the release


Docs: move IRC channel from Freenode to Libera.Chat

Resolves #1643.

Coverage remained the same at 58.993% when pulling c3f6e6e5ebfda77e842dc0becf8386d357b5bcb5 on bugfix/move-from-freenode-to-libera-chat into d2c191488a476f8bfcb21ad89f4c1ac6e39e71e5 on master.


Making a request by alamofire in the forground

s there a way to make a request by alamofire in the forground, not the background. I need data from the request, before the code goes on.

Not entirely sure what you're asking. Regardless, questions like these are best suited for Stack Overflow. We use GitHub for bug reports and feature requests.
Best of luck! 🍻

From our Contribution Guidelines
Asking Questions
We don't use GitHub as a support forum. For any usage questions that are not specific to the project itself, please ask on Stack Overflow instead. By doing so, you'll be more likely to quickly solve your problem, and you'll allow anyone else with the same question to find the answer. This also allows maintainers to focus on improving the project for others.


Docs updated

Commas updated according to the mattermot style format.

Summary

Ticket Link

Hello @trishitapingolia,
Thanks for your pull request! A Core Committer will review your pull request soon. For code contributions, you can learn more about the review process here.
Per the Mattermost Contribution Guide, we need to add you to the list of approved contributors for the Mattermost project.
Please help complete the Mattermost contribution license agreement?
Once you have signed the CLA, please comment with /check-cla and confirm that the CLA check is green.
This is a standard procedure for many open source projects.
Please let us know if you have any questions.
We are very happy to have you join our growing community! If you're not yet a member, please consider joining our Contributors community channel to meet other contributors and discuss new opportunities with the core team.

/check-cla

Hi @trishitapingolia! Thank you for your PR. We do use Oxford (serial) commas in our documentation so this change would unfortunately not be applicable. Would you be open to sharing the link to the style format mentioned? I'd like to confirm that our guidelines reflect that accurately. Thank you! :)

@justinegeffen sure,
https://handbook.mattermost.com/operations/operations/company-processes/publishing/publishing-guidelines/voice-tone-and-writing-style-guidelines/documentation-style-guide

Thank you, @trishitapingolia! As per our style guide, we do use the Oxford comma in our documentation. This PR is a change that removes the Oxford commas from the content, which unfortunately does not fit our style. Although this change is not one we can accept at this time, I encourage you to take a look through our open issues for other ways to contribute. Thank you again for your contribution! :)


Fix socket.io version

livedown doesn't work with socket.io higher than 1.3.0

:heart:

And why is that?


Keyboard Management

This is very cool software! Thanks for making it open source.
I have been evaluating it for only an hour. Is there keyboard management to avoid text fields on the bottom of the view controller from being covered by the keyboard?
Along the same lines, re-centering the view if a selected field is covered by the keyboard would also be a great enhancement.
I'll try to dig in further to see if these are enhancements I can code up and submit as pull requests.
Great work! I already love this project.

Still the textfields on lower side of Page are hide behind the keyboard  in small Example


Add search metrics!

What's this PR do?
Adds "search" metrics from the searchhead.
Motivation
We want to know what's being run on the cluster!
Notes

This has been tested in prod. Works!
Please look at the metric names (gauges). Do you have any better ideas, esp for jobs?
Should we just exclude "completed" searches? I did in the search, but not the jobs.
Completed jobs have duration and other performance metrics which might be worth looking at, but I argue that an avg or percentile of timing would be kinda worthless unless normalized by duration or # records…
We can skip any of the above and keep iterating too. :)

r? @krstripe

Since we're aggregating job info over time, it probably makes sense to filter job state by "not completed" jobs, which lets us use something like jobs.in_progress or jobs.pending. I'm having trouble determining if /search/jobs is just per-search-head stats and /shcluster/captain/jobs is the summary/aggregate of all search head job data; if so, the shcluster one might be redundant, which also gets us out of having to care about the captaincy, so to speak. /search/jobs also seems to provide much more depth of information, though we may not care about most of that information.

Ok, will do.
This is a good question. I mentioned in passing yesterday that I wasn't sure about this either, and I'm glad you reached the same conclusion! Gonna do some reading over here…

Ok, from everything I've read it seems that the /shcluster/captain/jobs endpoint only returns jobs that have been sent to the captain by the scheduler. This matches my observation that these are all saved searches.
The /search/jobs endpoint returns all searches. It is a superset of those returned by /shcluster/captain/jobs.
My observations show that if you look at the entries returned by /search/jobs where isSavedSearch=true then you get the same count as as the captain's endpoint.
So I'm going to remove the /shcluster/captain/jobs endpoint, but I'm still going to only query the captain because we don't want the sum of all hosts and the captain role provides a convenient place to get this information with hard-coding an instance in the check.
That clear as mud? 😸

lgtm


Fixed the issue with back navigation button on toolbar in explore tab.

Description (required)
Fixes #4151
What changes did you make and why?
Added a setNavigationOnClickListener on toolbar that will call the method onSupportNavigateUp().
Tests performed (required)
Tested betaDebug on Pixel 3 emulator with API level 29.

Codecov Report

Merging #4175 (79036a8) into master (a47f763) will decrease coverage by 0.00%.
The diff coverage is 0.00%.

@@             Coverage Diff              @@
##             master    #4175      +/-   ##
============================================
- Coverage     10.56%   10.56%   -0.01%
  Complexity      476      476
============================================
  Files           343      343
  Lines         12924    12927       +3
  Branches       1015     1015
============================================
  Hits           1366     1366
- Misses        11490    11493       +3
  Partials         68       68

Impacted Files
Coverage Δ
Complexity Δ

...r/free/nrw/commons/contributions/MainActivity.java
0.00% <0.00%> (ø)
0.00 <0.00> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update a47f763...79036a8. Read the comment docs.

Codecov Report

Merging #4175 (79036a8) into master (a47f763) will decrease coverage by 0.00%.
The diff coverage is 0.00%.

@@             Coverage Diff              @@
##             master    #4175      +/-   ##
============================================
- Coverage     10.56%   10.56%   -0.01%
  Complexity      476      476
============================================
  Files           343      343
  Lines         12924    12927       +3
  Branches       1015     1015
============================================
  Hits           1366     1366
- Misses        11490    11493       +3
  Partials         68       68

Impacted Files
Coverage Δ
Complexity Δ

...r/free/nrw/commons/contributions/MainActivity.java
0.00% <0.00%> (ø)
0.00 <0.00> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update a47f763...79036a8. Read the comment docs.


⚠ RPC server - Binance BSCT has degraded performance

In 87ca794, RPC server - Binance BSCT ($BINANCE_BSCT_RPC_URL) experienced degraded performance:

HTTP code: 504
Response time: 10497 ms

Resolved: RPC server - Binance BSCT performance has improved in ca6fff6.


Bump pkcs1 to v0.7, pkcs8 to v0.10; MSRV 1.65

This is a blocker for some pkcs8 updates I'm doing so I'm going to go ahead and merge this and cut a prerelease.
Will wait for approval before a final release.


Benchmark Analysis

write a script that after all the benchmarks run take a look at all of the benchmarks and average and stuff

The further I get into this project the less helpful I think it is. Here are some things that I have learned
since this is an average of all of the methods called among all of our tests in addition to measuring the efficiency of azle it also measures how many instructions our tests run. As a result a comparison between versions is only helpful if it is running on the exact same methods the exact same number of times. If you introduce another method that takes a lot of instructions we are not going to be measuring an decrease in azle efficiency, we are going to be measuring an increase in azle tests.
This is particularly problematic for tests that are arbitrarily large. It very quickly overwhelms our average and make it impossible to use it any any sort of weighted global measurement without blasting away any other component of that measurement or diminishing the average to the point that it might as well not be part of the calculation.
I think it would be better if we want to get a single set of data the represents how efficient azle is to have a benchmark example that has a good representation of what we think the average usage would be and then use that exact same example for comparisons between azle versions.

We are going to try comparing only what can be compared. So if run 1 has A, B, C tests, and run 2 has A, B, C, D tests then when comparing improvements we will only take into account A, B, and C, and if run 3 has A, B, C, D then we will do D but only for comparing 2 to 3.

Hmm, yes I see how that would be good for comparing two versions, but really the thing that we are stuck on here is the making of a single number to represent that version. Having an average value be a representative for a version is not going to actually be indicative of how well the version is doing. Now if the representation was not made independent of the previous version but was the comparison of the previous version then that could be something. @lastmjs what are your thoughts


ShowMoreTextView is not available on 1.0.1 version.

Hi, Thanks for providing such a good featured solution.
I think I found some bug in 1.0.1 version.
Declaring coding.universe.showmoretextview.ShowMoreTextView in xml works well in 1.0.0 version, But not in 1.0.1
It could be my mistake.
Thanks for reading :)

@hkg5600 Thanks for reporting the issue. It has been fixed.


java script: automatically add --language:js among additional build args

The camel-quarkus-js-dsl extension should automatically set
quarkus.native.additional-build-args=--language:js

@lburgazzoli Do we still need this? This is now further complicated by the fact that from GraalVM 2.22.0, JS support is not included by default. It's an addon that needs to be installed via the gu tool.

I think it would be enough to document it.
Also, maybe it should be a JVM only extension ?

JS-DSL will be marked as deprecated in Camel 4.6.0 / CQ 3.11.0. So there's not much value in investing time here IMO.


About the problem of the parameter --text_keys

I try to run this code ,but the parameter --text_keys seems to lead a lot of error.First,I use the Pixel200K dataset,here is my parameter setting:
python3 main.py \
--config_file overall/LLM_deepspeed.yaml HLLM/HLLM.yaml \
--loss nce  \
--epochs 5 \
--dataset Pixel200K  \
--train_batch_size 16 \
--MAX_TEXT_LENGTH 256 \
--MAX_ITEM_LIST_LENGTH 10 \
--checkpoint_dir /root/HLLM/ckpt \
--optim_args.learning_rate 1e-4 \
--item_pretrain_dir ../base-model/tinyllm \
--user_pretrain_dir ../base-model/tinyllm \
--text_path /root/HLLM/information \
--text_keys '[\"title\", \"tag\", \"description\"]'

but it is happend:
nce
Unable to convert the string 'nce' to None / Bool / Float / Int, retaining the original string.
5
Pixel200K
Unable to convert the string 'Pixel200K' to None / Bool / Float / Int, retaining the original string.
16
256
10
/root/HLLM/ckpt
Unable to convert the string '/root/HLLM/ckpt' to None / Bool / Float / Int, retaining the original string.
1e-4
../base-model/tinyllm
Unable to convert the string '../base-model/tinyllm' to None / Bool / Float / Int, retaining the original string.
../base-model/tinyllm
Unable to convert the string '../base-model/tinyllm' to None / Bool / Float / Int, retaining the original string.
/root/HLLM/information
Unable to convert the string '/root/HLLM/information' to None / Bool / Float / Int, retaining the original string.
["title",
    value = json.loads(value)
json.decoder.JSONDecodeError: Expecting value: line 1 column 10 (char 9)

So i change the dataset to amazon book, the parament I change the text_key to --text_keys '[\"title\",\"description\"]',but it still have some problem:
  File "/root/HLLM/code/run.py", line 140, in <module>
    run_loop(local_rank=local_rank, config_file=config_file, extra_args=extra_args)
  File "/root/HLLM/code/run.py", line 86, in run_loop
    train_loader, valid_loader, test_loader = bulid_dataloader(config, dataload)
  File "/root/HLLM/code/REC/data/utils.py", line 60, in bulid_dataloader
    train_data = train_set_class(config, dataload)
  File "/root/HLLM/code/REC/data/dataset/trainset.py", line 123, in __init__
    self.load_content()
  File "/root/HLLM/code/REC/data/dataset/trainset.py", line 130, in load_content
    self.env = self.env[self.text_keys + ['item_id']]
  File "/root/miniconda3/lib/python3.10/site-packages/pandas/core/frame.py", line 4108, in __getitem__
    indexer = self.columns._get_indexer_strict(key, "columns")[1]
  File "/root/miniconda3/lib/python3.10/site-packages/pandas/core/indexes/base.py", line 6200, in _get_indexer_strict
    self._raise_if_missing(keyarr, indexer, axis_name)
  File "/root/miniconda3/lib/python3.10/site-packages/pandas/core/indexes/base.py", line 6252, in _raise_if_missing
    raise KeyError(f"{not_found} not in index")
KeyError: "['title', 'description'] not in index"

Strangely，I set the text_keys to --text_keys '[]' ,it seems can work,but when run to ready to train ,it still have the error:
 File "/root/HLLM/code/run.py", line 111, in run_loop
    best_valid_score, best_valid_result = trainer.fit(
  File "/root/HLLM/code/REC/trainer/trainer.py", line 342, in fit
    train_loss = self._train_epoch(train_data, epoch_idx, show_progress=show_progress)
  File "/root/HLLM/code/REC/trainer/trainer.py", line 191, in _train_epoch
    losses = self.model(data)
RuntimeError: `dual_gemm_silu_identity_mul` does not support this input: Error Misaligned Operand
Train [  0/  5]:   0%|                                | 0/63286 [00:02<?, ?it/s]

In  Pixel200K,I try the same parameter  --text_keys '[]',it also meet the same error.So I feel confused, how can I fix this problem?
About my environment:
Python==3.10
CUDA==12.1
torch==2.1.0
transformers== 4.44.2
deepspeed ==0.15.1
flash-attn==2.5.9.post1
xformers==0.0.23.post1
accelerate==0.34.2

It seems really strange, we haven't met this problem before, could you please set text_keys directly in "overall/LLM_deepspeed.yaml" and do not pass through cli.

It seems really strange, we haven't met this problem before, could you please set text_keys directly in "overall/LLM_deepspeed.yaml" and do not pass through cli.

Thanks you answer! I remove the text keys:
python3 main.py \
--config_file overall/LLM_deepspeed.yaml HLLM/HLLM.yaml \
--loss nce  \
--epochs 5 \
--dataset Pixel200K  \
--train_batch_size 16 \
--MAX_TEXT_LENGTH 256 \
--MAX_ITEM_LIST_LENGTH 10 \
--checkpoint_dir /root/HLLM/ckpt \
--optim_args.learning_rate 1e-4 \
--item_pretrain_dir ../base-model/tinyllm \
--user_pretrain_dir ../base-model/tinyllm \
--text_path /root/HLLM/information

and in  LLM_deepspeed.yaml,I keep the parameter in default :
text_keys: ['title', 'tag', 'description']
However, in Pixel200K, it still meet the same problem:
/root/HLLM/code/REC/data/dataset/collate_fn.py:43: UserWarning: An output with one or more elements was resized since it had shape [1056], which does not match the required output shape [16, 11, 6]. This behavior is deprecated, and in a future PyTorch release outputs will not be resized unless they have zero elements. You can explicitly reuse an out tensor t by resizing it, inplace, to zero elements with t.resize_(0). (Triggered internally at ../aten/src/ATen/native/Resize.cpp:28.)
  return torch.stack(batch, 0, out=out)
Traceback (most recent call last):
  File "/root/HLLM/code/run.py", line 140, in <module>
    run_loop(local_rank=local_rank, config_file=config_file, extra_args=extra_args)
  File "/root/HLLM/code/run.py", line 111, in run_loop
    best_valid_score, best_valid_result = trainer.fit(
  File "/root/HLLM/code/REC/trainer/trainer.py", line 342, in fit
    train_loss = self._train_epoch(train_data, epoch_idx, show_progress=show_progress)
  File "/root/HLLM/code/REC/trainer/trainer.py", line 191, in _train_epoch
    losses = self.model(data)
  File "/root/miniconda3/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1518, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
  File "/root/miniconda3/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1527, in _call_impl
    return forward_call(*args, **kwargs)
  File "/root/miniconda3/lib/python3.10/site-packages/lightning/fabric/wrappers.py", line 141, in forward
    output = self._forward_module(*args, **kwargs)
  File "/root/miniconda3/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1518, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
  File "/root/miniconda3/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1527, in _call_impl
    return forward_call(*args, **kwargs)
  File "/root/miniconda3/lib/python3.10/site-packages/deepspeed/utils/nvtx.py", line 18, in wrapped_fn
    ret_val = func(*args, **kwargs)
  File "/root/miniconda3/lib/python3.10/site-packages/deepspeed/runtime/engine.py", line 1899, in forward
    loss = self.module(*inputs, **kwargs)
  File "/root/miniconda3/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1518, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
  File "/root/miniconda3/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1568, in _call_impl
    result = forward_call(*args, **kwargs)
  File "/root/HLLM/code/REC/model/HLLM/hllm.py", line 194, in forward
    neg_embedding = self.forward_item_emb(neg_input_ids, neg_position_ids, neg_cu_input_lens, self.item_emb_token_n, self.item_emb_tokens, self.item_llm)
  File "/root/HLLM/code/REC/model/HLLM/hllm.py", line 160, in forward_item_emb
    model_out = llm(inputs_embeds=inputs_embeds.unsqueeze(0), cu_input_lens=cu_input_lens, position_ids=position_ids.unsqueeze(0))
  File "/root/miniconda3/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1518, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
  File "/root/miniconda3/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1568, in _call_impl
    result = forward_call(*args, **kwargs)
  File "/root/HLLM/code/REC/model/HLLM/modeling_llama.py", line 1259, in forward
    outputs = self.model(
  File "/root/miniconda3/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1518, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
  File "/root/miniconda3/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1568, in _call_impl
    result = forward_call(*args, **kwargs)
  File "/root/HLLM/code/REC/model/HLLM/modeling_llama.py", line 1131, in forward
    layer_outputs = decoder_layer(
  File "/root/miniconda3/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1518, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
  File "/root/miniconda3/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1568, in _call_impl
    result = forward_call(*args, **kwargs)
  File "/root/HLLM/code/REC/model/HLLM/modeling_llama.py", line 826, in forward
    hidden_states = self.mlp(hidden_states)
  File "/root/miniconda3/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1518, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
  File "/root/miniconda3/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1568, in _call_impl
    result = forward_call(*args, **kwargs)
  File "/root/HLLM/code/REC/model/HLLM/modeling_llama.py", line 516, in forward
    down_proj = xformers_swiglu(
  File "/root/miniconda3/lib/python3.10/site-packages/xformers/ops/swiglu_op.py", line 387, in swiglu
    return op(x, w1w2, b1b2, w3, b3).reshape([*batch_shape, -1])
  File "/root/miniconda3/lib/python3.10/site-packages/xformers/ops/swiglu_op.py", line 201, in __call__
    return self.op(*args, **kwargs)
  File "/root/miniconda3/lib/python3.10/site-packages/torch/_ops.py", line 692, in __call__
    return self._op(*args, **kwargs or {})
RuntimeError: `dual_gemm_silu_identity_mul` does not support this input: Error Misaligned Operand
Train [  0/  5]:   0%|                                | 0/18971 [00:01<?, ?it/s]

And in Amazon book,, in LLM_deepspeed.yaml, I set the text_keys to  text_keys: ['title', 'description'],it still have some problem:
INFO  Item prompt: Compress the following sentence into embedding:
Traceback (most recent call last):
  File "/root/HLLM/code/run.py", line 140, in <module>
    run_loop(local_rank=local_rank, config_file=config_file, extra_args=extra_args)
  File "/root/HLLM/code/run.py", line 86, in run_loop
    train_loader, valid_loader, test_loader = bulid_dataloader(config, dataload)
  File "/root/HLLM/code/REC/data/utils.py", line 60, in bulid_dataloader
    train_data = train_set_class(config, dataload)
  File "/root/HLLM/code/REC/data/dataset/trainset.py", line 123, in __init__
    self.load_content()
  File "/root/HLLM/code/REC/data/dataset/trainset.py", line 130, in load_content
    self.env = self.env[self.text_keys + ['item_id']]
  File "/root/miniconda3/lib/python3.10/site-packages/pandas/core/frame.py", line 4108, in __getitem__
    indexer = self.columns._get_indexer_strict(key, "columns")[1]
  File "/root/miniconda3/lib/python3.10/site-packages/pandas/core/indexes/base.py", line 6200, in _get_indexer_strict
    self._raise_if_missing(keyarr, indexer, axis_name)
  File "/root/miniconda3/lib/python3.10/site-packages/pandas/core/indexes/base.py", line 6252, in _raise_if_missing
    raise KeyError(f"{not_found} not in index")
KeyError: "['title', 'description'] not in index"

So I still feel confuse, how can I solve this problem?

Could you please remove xformers ops in your env first ? we'll update modeling_llama.py later becase we do not use xformers in training. We are sorry for some unexpected problems with this pkg.
Could you please check your item_information file for books, there should be only item_id | description | title in the csv file. We fixed the incorrect link several days ago in readme.
Hope these msg can help you.

We have fixed the issue caused by incorrect import. Please check for the update.

We have fixed the issue caused by incorrect import. Please check for the update.

Thanks so much for your work! I have updated the Amazon Book dataset and the code, and tried running it again. This time, everything worked without any error. The model I guess I need prepare more GPUs, so I might need to find another time to run it completely. But regardless, I really appreciate your contributions!


Support for Rails 4.1.x

What would be involved in making this update happen. I have been trying to update myself if possible.


Getting error on action

Parameters:
  with:
    org-id: ***
    api-key: ***
    api-hostname: ***
    bundle-prefix: ***
    pagebuilder-version: 3.3.7
    retry-delay: 15
    retry-count: 40
    deploy: true
    promote: true
    artifact: dist/fusion-bundle.zip
    minimum-running-versions: 7

Error:
Run arcxp/deploy-action@v1
Error: Unexpected token '<', "<html>
<h"... is not valid JSON
/home/runner/work/_actions/arcxp/deploy-action/v1/dist/index.cjs:22165
      if (newVersions[newVersions.length - 1] !== latestVersion) {
                                  ^

TypeError: Cannot read properties of undefined (reading 'length')
    at main (/home/runner/work/_actions/arcxp/deploy-action/v1/dist/index.cjs:22165:35)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)

Thanks, I'll take a peek at this.

@luis-ochoa: I just deployed an experimental version to test this out. This error typically accompanies some sort of issue with the response from the server where HTML or XML is returned instead of JSON (a number of vendors have this issue, including AWS).
Could you please try changing your arcxp/deploy-action@v1 to arcxp/deploy-action@issue3 to see if that experimental version works?

I released this fix earlier today, and you should just be able to use the arcxp/deploy-action@v1 line again.
If you experience this issue again, please don't hesitate to submit a new issue.


Flag for 2SV

Provides the ability for super admins to flag users as requiring 2SV. Once they've been flagged they will be prompted to complete 2SV enrolment and cannot do much until they enrol or defer.

This is now ready for some eyes. The history needs a rework, I'll do this after the approach has been OK'd. Preview:

/cc @jamiecobbett @boffbowsh @benilovj @binaryberry

It looks like this is using an older version of the copy. The copy was updated in the prototype in this commit: https://github.com/alphagov/signonotron2/blob/752f32b827e6048b96564272afb689de2f907540/app/views/prototype/two_factor_prompt.html.erb
Sorry that wasn't more obvious.

@fofr Ah, this was linked off the trello card https://github.com/alphagov/signonotron2/compare/prototype-2fa#commitcomment-12642578
Not to worry, I'll get it corrected.

@fofr

@jamiecobbett @boffbowsh @benilovj this will hopefully address the remaining issues. :checkered_flag:

@boffbowsh @jamiecobbett comments addressed. If this is OK I'll rework the history into something more concise.

:+1: @jamiecobbett want to review and merge?

Really glad to see this merged, even if it was a bit painful getting there. Thanks for sticking with it @benlovell - I think I realise now just how much context the rest of us had built up, so it was quite a big ask for you to do this just after joining. Thank you :fireworks:


chore(Separation): rename some lemmas

Mathport chose wrong names for these constructors.

Thanks!
bors merge


Failed to load resource error

Bug description
I'm catching four fail-to-load resource errors, on the docsify code and the external script. I believe the code originates in the index file. As a result, the app will not load at all. At this point, I'm clicking on the index file to test the app and that is when the errors occur. Any help would be greatly appreciated.
Additional context
No response

Hi @RisePrime, I'm a bit confused. There is no app on this repository, just data. I'm going to close this issue but feel free to let me know what you're trying to do and I can guide you if necessary.


OSError: exception: stack overflow

recent problem... perhaps due to the recent changes in code.
Exception ignored in: <bound method Symbol.__del__ of <mxnet.symbol.Symbol object at 0x000001F0E408C6A0>>
Traceback (most recent call last):
  File "C:\Users\chuaf\AppData\Local\Continuum\Miniconda3\lib\site-packages\mxnet-0.7.0-py3.5.egg\mxnet\symbol.py", line 106, in __del__
    check_call(_LIB.MXSymbolFree(self.handle))
OSError: exception: stack overflow

@freddycct Could you provide some code examples for us to debug?

hang on, i am compiling the latest commit, let me see if there are any problems...

i am still having this crash despite having the latest compiled codes. I will prepare some test data set and upload my code tomorrow. Thank you.

I hope you have scikit learn installed...
Please help me out here, you can see it crashes when I do the model.fit.
Unzip and try, it is written in ipython notebook (jupyter notebook)
encoder_decoder.zip

If there is anyone working on it, please message me if you have any questions.

@sxjscience Hi, can please run my code and see whether you encounter the same problem?

I am python3 btw..

@freddycct I've run it and have got the same error. I'm trying to find out the cause.

I've simplified the code a little bit.
import mxnet as mx

def sym_gen(length):
    data = mx.sym.Variable('data')
    wordvec = mx.sym.SliceChannel(data=data, num_outputs=length, squeeze_axis=1, axis=1)
    hidden = mx.sym.Variable('init_hidden')
    for i in range(length):
        hidden = hidden + wordvec[i]
    return hidden
sym = sym_gen(length=20000)
del sym

MXSymbolFree has thrown the exception. https://github.com/dmlc/mxnet/blob/master/src/c_api/c_api.cc#L591-L595

Thanks @sxjscience , I am happy to have made some contribution to this project by discovering a bug. I hope it will be resolved soon, so that I can continue with what I was doing.

@freddycct You can remove the exception catch by replacing these two lines to API_END_HANDLE_ERROR(delete static_cast<Symbol*>(symbol));. The program can run after applying this hotfix.

Replace which two lines?
Does this fully fix the problem? I wouldn't want any memory leak...

@freddycct I mean https://github.com/dmlc/mxnet/blob/master/src/c_api/c_api.cc#L593-L594. It doesn't fix the problem and only enables you to continue running the executors. Another way is to reduce the sequence length.

The sequence length is due to the nature of my data. So I cannot reduce it.
Is this is a bug within the C++ codes? If it can be addressed at the python side, I could help out. Otherwise ,the C++ codes are not very easy for me to understand and edit.
Meanwhile, I will use the hotfix you suggested. Thank you.

@freddycct Yes, it's in the C++ and only occurs for large symbolic graphs. You can try Truncated BPTT for long sequences. Directly unfolding the whole sequence and performing forward/backward will be quite slow in this case.

@sxjscience Thank you for the suggestions.
Whenever you are free, please continue to fix the bug at your convenience. Thank you.

I simplify the code further
import mxnet as mx

def sym_gen(length):
    data = mx.sym.Variable('data')
    hidden = mx.sym.Variable('hidden')
    for i in range(length):
        hidden = hidden + data
    return hidden
sym = sym_gen(length=20000)
del sym

This is an interesting problem that raises up. This was due to the usage of shared_ptr inside the symbol and the deletion triggered a chain of shared_ptr deletions, where the recursion of delete function call piles up and causes stack overflow.
Like @sxjscience said, remove the delete of symbol might be a good temp solution to go. We will think of better alternatives for a safer destruction.
Thanks for finding this interesting case. Also  cc @mavenlin since it is interesting thing we need to address in pressure testing the graph.

should be fixed by https://github.com/dmlc/mxnet/pull/2586

Thanks for the fix, it works now...


Enable Http2 Push Server - issue with admin page only

Hi,
The context: Nginx + php7fpm + Cloudflare free plan
I enabled the Http2 Push Server feature:

For logged or not logged user, the front works correctly, the javascript and css files are well pushed.

When I access the administration pages error 502,  I get a 502 error. In the nginx logs, I have "Can not Push Server (header size over 3072 Bytes)"

I tried to change the "fastcgi_buffer_size" and "fastcgi_buffer", and I modified the code of the cloudflare plugin to increase the limit "headersize":
if ($headerSize > 3072) {                     error_log('Cannot Server Push (header size over 3072 Bytes).');                     return $src;                 }
to
if ($headerSize > 7168) { {                     error_log('Cannot Server Push (header size over 7168 Bytes).');                     return $src;                 }
=> without success, header size were always too big (I do not understand why the headers are so big).
I looked for different solution by playing on the buffer, without success..
If I go back to my problem, the only pages that pose a problem are the administration pages, administration pages with push server enabled. I do not need to push server on these administration pages (and in general, I do not see any need).
If I disabled push server for administration pages:
    public static function initHooks()
    {
		$user = wp_get_current_user();

		// Change: disable the push server if it is an admin page
		if (is_admin()) {
			return;
		};

        self::$initiated = true;

        add_action('wp_head', array('\CF\WordPress\HTTP2ServerPush', 'http2ResourceHints'), 99, 1);
        add_filter('script_loader_src', array('\CF\WordPress\HTTP2ServerPush', 'http2LinkPreloadHeader'), 99, 1);
        add_filter('style_loader_src', array('\CF\WordPress\HTTP2ServerPush', 'http2LinkPreloadHeader'), 99, 1);
    }

=> Everything is working fine, frontend is pushed, admin page without error and not pushed
Maybe there is a better solution? or can this solution be integrated without risk?

The solution looks good. Feel free to open a PR.
Thanks

@blue928 or you can do the short cloudflare.loader.php edit as seen here: https://github.com/cloudflare/Cloudflare-WordPress/pull/214/commits/4a815fe2c9208bad1d7879d3c4e4029e94ec6e24. This will work until plugin is updated.

Same issue - thanks for this!

I'm seeing these errors in my apache error log. Tried the admin fix but still occurring when I clear my cache. Just wondering on the status of this issue?

@LSB-Web-Design have you tried my fix?

Yes I've tried the wp admin pages fix. Seems to be occurring on non admin pages though.

Oh, sounds like you might be having a different case. As such, I'd recommend opening a new issue.
My best guess would be that you might be loading too many resources on the frontend...

I would also open a problem ticket with CloudFlare Support directly regarding the issue.  There are a number of outstanding issues with this plugin that they are "waiting on other issues" to even review some of the suggested fixes on this project.
Last I looked, they have not had any commits to this project in over a year now and the lack of PHP 7.3 support and other outstanding problems are not being addressed... as far as I can see.


Project Config does not match latest version of Craft

Description
The project config and data migration included with the package do not get installed because the Craft Schema version specified in project config does not match the latest package installed by Composer (<IP_ADDRESS>).  See following excerpt from the output of the craft setup command.
    > can't apply existing project config: Craft is installed at the wrong schema version (<IP_ADDRESS>, but project.yaml lists <IP_ADDRESS>).
    > moving config/project/ to storage/config-backups/project-2023-08-25-153549 ... done

After this, the Craft instance is lacking all the Blog related settings and the sample data migration fails to load as well.
Steps to reproduce

Git Clone Repo
Composer Update
Run Setup

Additional info

Craft version: <IP_ADDRESS>
PHP version:  8.1.
Database driver & version:  MySQL 8.0.30
Plugins & versions:  only what is included in repo

Somehow, these got out of sync! I've gone and re-applied updates, so the setup wizard should accept the provided Project Config files. 🤞


.pnpm-sync.json should be versioned.

The .pnpm-sync.json file should contain a version field so it can be invalidated and regenerated if its schema changes between versions of the pnpm-sync-lib packages, or if an issue is identified and fixed.
I'm seeing an issue on my current local clone of https://github.com/microsoft/rushstack, where the build-tests-subspace/typescript-v4-test/node_modules/@rushstack/heft folder is linked to the wrong location (see screenshot below) because the sourceFolder property was generated with the wrong value.
The .pnpm-sync.json file should have been regenerated after the bug creating the incorrect path was fixed, and that would have been easily identified if it contained a version field.
apps/heft/node_modules/.pnpm-sync.json:
{
  "postbuildInjectedCopy": {
    "sourceFolder": "../..",
    "targetFolders": [
      {
        "folderPath": "../../../../common/temp/node_modules/.pnpm/file+..+..+apps+heft/node_modules/@rushstack/heft"
      },
      {
        "folderPath": "../../../common/temp/build-tests-subspace/node_modules/.pnpm/file+..+..+..+apps+heft_@types+node@18.17.15/node_modules/@rushstack/heft"
      }
    ]
  }
}

build-tests-subspace/typescript-v4-test/node_modules/@rushstack/heft structure:

A bug was fixed with the sourceFolder relativity in pnpm-sync version 0.2.0, based on PR #20:

A version field would enable pnpm-sync to detect a .pnpm-sync.json  file written by an incompatible release and ensure the file gets regenerated.


Streamlink usage error with weird behavior

When running, the script pushs out an error with an incressing amount of of "best"
Steps to reproduce the behavior:

Install the script with automatic installation
Run pm2 start AutoVOD.sh --name StreamerNameHere
Run pm2 logs
Wait more than 1 minute
See error

Expected behavior
Not outputting errors
Screenshots

Desktop (please complete the following information):

OS: Ubuntu
Version 22.04

Additional context
Running as a VM in Proxmox

i am not able to re-produce the error. are you using the newest version?

delete your config
run git pull while in the autovod folder
create the config again cp default.config monsieurplouf.config

update: was able to re-produce issue. debugging now

just pushed a new commit that should fix it.
follow the steps above and let me know if it is resolved

Apparently fixed, I only get the expected error of no streams, thank you ❤


Where's the config for the top bar widget?

I can only find the config for the bottom right widget.

@musjj there's no config for it, but there's a script . check the bar.sh in scripts dir

@siduck I'm not really sure what I'm looking at here. Is this not eww? Or are you using something custom?
I'm not a chadwm user btw, just wanted to have your top bar.

this is dwm bar @musjj

Ah, I'm not a dwm user :(.

Ah, I'm not a dwm user :(.

btw you can do that with polybar too :v

look https://github.com/siduck/dotfiles


Method 'Android.Support.CustomTabs.CustomTabsIntent.LaunchUrl' not found

We cloned the repository and built the "2-add-ad-b2c" solution without problems.
Then we started the Android project and right away we got this exception:
Unhandled Exception:
System.MissingMethodException: Method 'Android.Support.CustomTabs.CustomTabsIntent.LaunchUrl' not found. Occurred

Unfortunately we could not get any further after this.

Thanks for grabbing the repo! (I haven't even officially published the accompanying blog post yet! 😄 )
Unfortunately the Microsoft.Client.Identity library in it's current state throws an exception in Android that has support libraries 25.x and above.
There's a hotfix coming for it next week: https://github.com/AzureAD/microsoft-authentication-library-for-dotnet/issues/490

Great, thanks a lot for the info!
Also thanks for your really good blog posts. Helped our team a lot. It was really nice when we found the final post in the repo yesterday as well. 😄


Update coupler for compatibility with SurfaceFluxes v0.5.0

SurfaceFluxes released v0.5.0, and the coupler needs to be updated to be compatible with this.

#208


Workaround:  to Prevent Crashes (#3080) during new_window creation

create new window in a seperate thead, without interfaring the main thread or getting program crashed
Add changes in example code snipets (multiwindow.rs, popup.rs) with new multithreaded way to create additional window
Updated documentation to include best practices and guidance on multi-threading when using new_window() method.

spawn runs the future on the same thread. I'm guessing it happens to fix this issue because it waits to execute the spawned task until there is a break in rendering. We need to fix the underlying error instead of relying on that behavior in spawn. We could probably fix the issue without requiring the function to be used in spawn by queueing the window creation for the next Poll event on the window instead of running it immediately

Thanks @ealmloff !
Thank you for the suggestion! I understand now that, instead of relying on spawn, we should utilize an event poll system to queue the window creation, which would align better with the current architecture.
I'll give this approach a try. Before I dive in, could you guide me a bit on how to create or use the poll event in this context? If there's already an implementation of a similar poll event elsewhere in the codebase, could you point me to that section? It would be really helpful as a reference to implement it correctly.
Thanks again for the direction!

Hi @ealmloff,
I've been working on the suggestions you provided, and I wanted to share my findings so far:

(if I understood correctly)

For events, we're currently using tao_waker, which is initialized during the creation of WebViewInstance.
WebViewInstance::new() is called initially during app launch.
Later, when attempting to create a new window, WebViewInstance is being invoked again, but it gets stuck within the window.build() method.

You suggested queuing the create new window event, but I'm unclear on the exact location for this in the code. I tried using send_event(NewWindow_event), but it seems that this only queues the event—it doesn’t actually create a new window. To open a window, we still need to create a WebViewInstance, which is where the process gets stuck.
Any further guidance on where  & how to queue this event would be greatly appreciated. Thanks for your help!


Documentation still references dl.bintray.com (shutdown nearly two years ago)

Please can you update the documentation as it still references dl.bintray.com that was shudown in feb. 2021 ?

I missed the notification, readme updated
Let me know if this works


Not receiving Chrome notifications on Android device

I recently purchased Eddystone (UID, URL, TLM, EID) iBKS105 beacons from accent systems (one of the companies recommended by the Google Beacon platform https://developers.google.com/beacons/eddystone#beacon_manufacturers). I configured the beacon using the instructions provided by accent systems to emit a URL (https://reddit.com), which I verified on http://verify.physical-web.org. After following the instructions here (https://google.github.io/physical-web/try-physical-web#android), I am unable to receive any Chrome notifications.
I am, however, able to detect the beacon and receive notifications successfully via Google Nearby Notifications and the Physical Web app but this is not what I'm after.  I want to receive Chrome notifications. Note that I do not have this same issue on iOS, I am also able to get Chrome notifications for my beacon successfully on iPhone 7.
Here is what I have tried so far that has not worked:

Enabling Physical Web in Chrome --> Settings --> Privacy --> Physical Web (I also saw instructions to turn "Do not track" to on but doing that did not have any effect)
Setting the phone to sleep, then waking it up
Tried this on two Android devices but not getting Chrome notifications on either device.

About the Android devices I'm using:

Nexus 5x running Android version 7.1.2 (not getting Chrome notifications)
Motorola Moto-E (2nd Generation) running Android 5.1 (no Chrome notifications on this device either)
Chrome version 57.0.2987.132 (I've also tried Chrome Beta 59.0.3071.25 without luck)

Would someone be able to point out what I'm doing wrong and why I cannot receive Chrome physical-web notifications? Any help would be appreciated.
Update: To clarify, I want to receive Chrome notifications. I am not looking to receive notifications via Google Nearby Notifications or the Android Physical Web application.

If you're getting Nearby notifications than Chrome does show (duplicate) notifications.
Note: Chrome for iOS and Andorid Beta currently show PW autocomplete suggestions inside the browser.

@ferencbrachmann I only see the duplicate when I have the Physical Web application installed. When I uninstall Physical Web, I get zero notifications.

Now I understand. Please go to Chrome Settings / Nearby and conduct a scan.
@scottjenson any comments?

@ferencbrachmann I get an empty screen when I conduct a scan.

Sorry, I ment Google Settings / Nearby.

With the current Chrome release you're supposed to get this. Download Chrome beta for this page and for Chrome autocomplete suggestions to work!

@ferencbrachmann Correction, I do see the beacon on both chrome://physical-web after conducting the scan, and Google Settings/Nearby.
However, I am still not getting any Chrome notifications.

@ferencbrachmann I am not sure what you mean by Chrome autocomplete suggestions. I am trying to get Chrome notifications, but I am currently not reeceiving any.

You should be getting suggestions like these:

@ferencbrachmann The screenshot you posted seems to be iOS, but I am trying to get Chrome notifications on Android.

You'll get the same thing on Chrome for Android Beta (without the PW logo for now)

@ferencbrachmann I have the same problem with some versions of Android, Chrome does not manage more Nearby, who does this after some updates is Google Play Services, in other versions of Android you manage Nearby by Google Config ----> Nearby , But it does not become a standard which brings many problems. What I do not understand is the following, for which reason the Android Native Nearby, does not work as the Physiacl Web Application, that is 100%, including whether my Beacon is working using the Physical Web application or via Chrome notifications in one IPhone, so far no reply. @scottjenson @mmocny any comments?

Nearby does filter some page content if it gets swiped away too many times. You may have ran into this. Please also try the URL validator: https://beaufortfrancois.github.io/sandbox/physical-web/url-validator/

@ferencbrachmann but the Physical Web Aplication never fails, why does the Nearby Native Android not use the same mechanism? Via iOS the same thing, notifications of Chrome on any iPhone, always work, there is some problem in Nearby native Android, I hope it is corrected as soon as possible, as it is difficult to have a technology that works intermittently . All my URLs passed through the validator successfully( Example: https://tagzone.com.br/?18e8a ). See the screens below, the print was almost at the same time.

I have come back to experimenting with Beacons after having great success around 12 months ago. Currently I am in the same situation as @luciofr. Nearby beacons only appear with the Physical Web application on Android.

Please check your URL here: verify.physical-web.org there were quite a few changes in the last 12 months.

@ferencbrachmann Thanks, I saw this mentioned a number of times and have checked against it already.
Still not discoverable on Nearby/Android. Trying with a real beacon and broadcasting from OS X using the eddystone-beacon Node.js module.

To note: testing on Android 5 and 6.

Can you share the URL/short URL? There is some chance this is a bug (or maybe a feature of the content filter of the PW service that does not display URLs that have been swiped away too many times) I have not yet reported but do experience it with a certain URL.
Also cross check your URL by going into Google Settings / Nearby. You may still see it in the list but it does not fire a notification.

@ferencbrachmann I've tried many URLs, including google.com. For domains I control: https://village.pe and https://sime.net.au
Nearby doesn't show a list at all.

Hmm. I wouldn't say this is unheard of, but it still is pretty rare. @mmocny do you have any ideas what it could be?

Based on your symptoms:

Many different URL do not show at all in the Nearby list
They show in the PW app on the same device, at the same time

.. I would conclude that there is an issue with Nearby scanning.
You could help by taking a bug report, by following these instructions:

Enable Developer Mode for the android device.
Turn on "debug mode" for Nearby (Settings > Google > Nearby > Gear icon > "Include debug results")
Use Android "Take bug report" feature.

You can find instructions for steps 1 and 3 here.
Once you have a bug report, may you email it to<EMAIL_ADDRESS>and<EMAIL_ADDRESS>please?

I believe the problem is unique to Nexus 4. I have tested on two separate devices (Android 5 and 6). Other phones don't have this problem.

This helps.  I do not have that device myself, but AFAIK that was one of the first android devices to support BLE 4.0

It worked great 12 months ago, prior to the "Nearby" concept.

@sime, I already have my URLs resolved, Neraby Nativo gets 100%. In addition to a double jump in our URLs, which we have corrected, for just one jump, we also had problems in the configuration of our Hardware, since our Beacons work simultaneously iBeacon and Eddystone, after the correct corrections everything remained 100% in the Near Native of Android. One attitude that we understand was fundamental to the resolution, is that we do not change the URL of Beacon, always the same, so we do not lose positioning in Google Servers.


Milestone 6: Accessibility Checks and Updates

This is what my partner and I did on this branch:

Did ALL the checks required in the project requirements;
Updated my code to make it more accessible where there was the need to do so.

Hi team,
:thumbsup: This is good to make it this far, your project is really nice, congratulations on the good work you have done so far.
There are some issues that you still need to work on to go to the next project but you are almost there!

Required Changes  :recycle:

[ ] Based on project requirements, you have to list all points that you have checked:

- Page titles
- Image text alternatives** (<img alt="alt text">)
- Text headings
- Color contrast
- Resize
- Interaction
- Moving content
- Multimedia
- The basic structure of the page

Please all all these points and make sure that each point on the list included the result of your evaluation.

If everything was ok, make a statement about that (e.g. "Page titles - no issues found").
If you needed to change something, link to the corresponding line of code in your pull request changes.

Cheers and Happy coding! :clap: :clap: :clap:
Feel free to leave any questions or comments in the PR thread if something is not 100% clear.
Please, do not open a new Pull Request for re-reviews. You should use the same Pull Request submitted for the first review, either valid or invalid unless it is requested otherwise.

As described in the Code reviews limits policy you have a limited number of reviews per project (check the exact number in your Dashboard). If you think that the code review was not fair, you can request a second opinion using this form.


Remove redundant Busy on container get.  Clean up and extend logging.…

Also issue warning on slow docker op.

pg2-63 passed clean