Flasks of oil/acid disappear when equipping during battle

Latest Co8, T+
A reference to this issue https://co8.org/community/threads/bottle-throwing-items.10492/#post-135948
Dragging/r-clicking a throwable flask into a hand slot during a battle makes the flask disappear.
Whatever the char was holding gets placed properly in the inventory. But the slot is just empty.
The flask is nowhere to be seen (not dropped, doesn't end up in another weapon combo).
Freeing the hand manually before trying to equip the flask doesn't help.
This doesn't happen with Holy Water though.

This is related to your other issue with the corrupt save. As it turns out, they're both caused by a script that is meant to delete the thrown flask when it hits a critter.
A related vanilla ToEE bug: the "grenade" thrown item doesn't explode, and reappears on the corpse as though it were a throwing dagger/javelin etc. Looks like the root cause is the game doesn't recognize it's a grenade throw action from the auto-attack action, whereas throwing it by using the manual radial menu option works correctly.

Both issues should now be fixed.


Improve inlayHints colors

Theme Gruvbox Light

Theme Atom One Light

Theme Gruvbox Light

Theme Atom One Light

This is my custom color:
{
    "workbench.colorCustomizations": {
        "[Gruvbox Light Hard]": {
            "editorInlayHint.foreground": "#999999",
            "editorInlayHint.background": "#f9f5d7"
        }
    }
}

@shenghui0779 what file did you put that customization in? Tried my User Settings and it didn't work


JFXTextField labelFloat setText positioning problem

When you have a JFXTextField with labelFloat set to true and you use setText to change the text programmaticly the text doesnt float in the right position till you click on the textfield.
On startup after setText:
http://prntscr.com/eoywvr
What its supposed to look like:
http://prntscr.com/eoyx79

Hello,
This issue is related to #255 the fix is not pushed to maven central yet, it will be by the end of the month.
in JFoenix 1.3
Regards,

@HaidarMara you can get the current version via https://jitpack.io/#jfoenixadmin/JFoenix


[Feature Request] Save password on entry

Every time I "Save as Root" it asks for the password. Can you have it remember it for this project?

Thank you for reporting the problem. There was a problem with the way the sudo command was invoked. I've fixed it in https://github.com/yy0931/save-as-root/commit/de7f7fa6ce6ab7449c1f9c2d18d1514de0d8008b and published v1.3.9.

This is so much better now!!!!!
Thanks!

Thank you for your work!
I wanted to point out that when I use the extension, it always asks me for my password every time I save.
I insert it and it asks me for it every time I save one file.
Is there a way to save it the first time I log in?


Is multiple gpu supported with non-persistent pipeline

Hi team,
From the code I can see the multiple gpu deployment is supported for persistent deployment with server method. Is it supported with pipeline method?
Thanks

Yes we support multi-GPU support for the mii.pipeline: https://github.com/microsoft/DeepSpeed-MII#tensor-parallelism
You will need to launch script using the deepspeed launcher to enable model parallelism with the pipeline:
deepspeed --num_gpus 2 pipeline.py
Where pipeline.py could be:
import mii
pipe = mii.pipeline("mistralai/Mistral-7B-v0.1")
response = pipe("DeepSpeed is", max_new_tokens=128)
print(response)


[e2e]: container schedule main default slsa3

Repo: https://github.com/slsa-framework/example-package/tree/main
Run: https://github.com/slsa-framework/example-package/actions/runs/4663481334
Workflow file: https://github.com/slsa-framework/example-package/tree/main/.github/workflows/e2e.container.schedule.main.default.slsa3.yml
Workflow runs: https://github.com/slsa-framework/example-package/actions/workflows/e2e.container.schedule.main.default.slsa3.yml
Trigger: schedule
Branch: main
Date: Tue Apr 11 03:16:41 UTC 2023

Repo: https://github.com/slsa-framework/example-package/tree/main
Run: https://github.com/slsa-framework/example-package/actions/runs/4664659447
Workflow file: https://github.com/slsa-framework/example-package/tree/main/.github/workflows/e2e.container.schedule.main.default.slsa3.yml
Workflow runs: https://github.com/slsa-framework/example-package/actions/workflows/e2e.container.schedule.main.default.slsa3.yml
Trigger: workflow_dispatch
Branch: main
Date: Tue Apr 11 06:52:07 UTC 2023
Tests are passing now. Closing this issue.


Add project specific steps to issue and PR checklists

Description
Adds extra project specific steps to the issue and PR checklists.
Fixes/resolves #21
Type of change
Please delete options that are not relevant.

[x] Improvement (non-breaking change which improves existing functionality)
[x] This change requires a documentation update

Checklist:
Leave blank if not applicable
I have completed these steps when making this pull request:

[x] The issue is currently located in the Ready for Development column
[x] I have messaged my technical lead to check that the issue is available
[x] I have assigned my name to the issue
[x] I have moved the issue to the In Progress column
[x] I have created a new appropriately named feature branch on my own fork branched from main.
[x] I have created a Draft PR and assigned myself to the PR
[x] I have labelled the PR appropriately

Complete these steps as you work through the issue:

[ ] My code follows the style guidelines of this project
[ ] I have performed a self-review of my code
[ ] I have commented my code, particularly in hard-to-understand areas
[ ] I have made corresponding changes to the documentation
[ ] My changes generate no new warnings
[ ] I have added tests that prove my fix is effective or that my feature works
[ ] New and existing unit tests pass locally with my changes

Complete these steps when finishing work on an issue:

[ ] If the work is significant, I have added a row to the contributors page
[ ] I have marked the PR as Ready for review
[ ] I have moved the linked issue to the Review in Progress column

before you open this PR for review, can you please copy the PR template into this PR description

Let me know if the checklist is too long


Scope options for mailing list platform

What
We want to create a release/event based mailing list. Before we do that, we need to scope which platform will be appropriate in terms of functionality and metrics.
Why
There has been demand for more information on release notes/design decisions. These go into GitHub, but clearly people are not finding them easily. A mailing list will surface important information and send it directly to their inboxes.
Who
Community manager
Content designer

So far options I'm aware of are:

Mailchimp - used by cross-gov UCD (send only) and content communities (capture and send)
Smartsurvey - capture only - used by cross-gov UCD (capture)
GOV.UK Notify - send only - not sure anyone uses for newsletters

Agreed to use Mailchimp as it meets our needs.


ISSUE -- 'utf-8' codec can't decode byte 0xe9 in position 1 ISSUE

hello Bros,
I got the issue after i ran as below ? Could you please assist the issue related 'utf-8' . Any assist will be very well appreciated.
./noip-renew.py xxxxxxxxx djfjkgsbsfb   (xxxxx : my noip account ; djfjkgsbsfb : my password)
[2021/03/06 16:32:18] - Debug level: 1
[2021/03/06 16:32:18] - Opening https://www.noip.com/login...
[2021/03/06 16:32:24] - Logging in...
[2021/03/06 16:32:25] - 'utf-8' codec can't decode byte 0xe9 in position 1: invalid continuation byte
PS: Python version : 3.6 , I did it with my Raspberry Pi 3B.

I have the same error from yesterday but witch 0xaa.
'utf-8' codec can't decode byte 0xaa in position 1: invalid start byte

@dr-boss @thangvc91 You need to encode the password in base64 first. You could update the crontab with crontab -e and replace your password with a base64 string of your password. You could get your base64 string with echo djfjkgsbsfb | base64
This is actually a duplicated of #61.

@dr-boss @thangvc91 You need to encode the password in base64 first. You could update the crontab with crontab -e and replace your password with a base64 string of your password. You could get your base64 string with echo djfjkgsbsfb | base64
This is actually a duplicated of #61.

hi Michale,
Thanks for your response,  after I encrypt the password with base64 , the script could work well , but is show the statement as below , can you please help assist ?

as you can see , I have had already 3 hosts owned by my account, but as far as the info said "no host, no record found in my account ".

@thangvc91 I think the script produced 3 images, debug1.png, debug2.png and exception.png. Could you have a look of those files ?
Sometimes if there are popped up boxes, you need to first login manually and try to solve the pop up box so it won't pop up again.
And also, it's written in the todo list in the readme, sometimes there will be unsolvable popup box that, unfortunately, will require to manually renew the domain names instead of using the scripts. But I guess it just happen sometimes, so having the script running in crontab it's still nicer.

thanks Bro :) have a nice weekend.


backup tries to mount mariadb-data volume which fails with ReadWriteOnce volumes

AFAICT it does not need the data dir.
It does indeed need something.  Unfortunately I did not notice straight away because the job completed successfully but the log said
💾 Taking physical backup
[00] 2023-01-16 12:35:50 Connecting to MariaDB server host: mariadb, user: root, password: set, port: 3306, socket: /run/mysqld/mysqld.sock
[00] 2023-01-16 12:35:50 Using server version 10.10.2-MariaDB-1:10.10.2+maria~ubu2204
mariabackup based on MariaDB server 10.10.2-MariaDB debian-linux-gnu (x86_64)
[00] 2023-01-16 12:35:50 uses posix_fadvise().
[00] 2023-01-16 12:35:50 cd to /var/lib/mysql/
[00] 2023-01-16 12:35:50 open files limit requested 0, set to 1048576
[00] 2023-01-16 12:35:50 mariabackup: using the following InnoDB configuration:
[00] 2023-01-16 12:35:50 innodb_data_home_dir =
[00] 2023-01-16 12:35:50 innodb_data_file_path = ibdata1:12M:autoextend
[00] 2023-01-16 12:35:50 innodb_log_group_home_dir = ./
[00] 2023-01-16 12:35:50 InnoDB: Using liburing
2023-01-16 12:35:50 0 [Note] InnoDB: Number of transaction pools: 1
mariabackup: io_uring_queue_init() failed with ENOSYS: check seccomp filters, and the kernel version (newer than 5.1 required)
2023-01-16 12:35:50 0 [Warning] InnoDB: liburing disabled: falling back to innodb_use_native_aio=OFF
2023-01-16 12:35:50 0 [ERROR] InnoDB: File ./ib_logfile0 was not found
[00] 2023-01-16 12:35:50 Error: cannot read redo log header
🧹 Cleaning up old backups
📜 Backup history

This is not as successful as I hoped.

Thanks a lot for the feedback 🙏🏻
The data dir is required when performing physical backups like this one. Those logs are from backupmariadb, which actually compains if the data dir is not mounted.
Could you provide more details of your test case so I can try to reproduce it?

I don't know what details I should provide.  I tried not mounting /var/lib/mysql/ by removing the volume in the cronjob.  But as you said, it does not work and can't.  Physical backups can't work without the physical files.  This should at least be documented.
I assume that taking a CSI snapshot of the volume (if supported) and mounting this file would be possible.
Is it possible to take a logical backup using the CRD?

You are not supposed to manipulate the resources managed by the operator, in this case the Job. If for some reason you want to achieve a different behaviour, you can open an issue so we can change the reconciliation logic to create those resources the way you think is better.

This should at least be documented.

We are aware of this:
https://github.com/mmontes11/mariadb-operator/issues/21

Is it possible to take a logical backup using the CRD?

Yes it is, you can either set backup.scpec.physical = false or not specifying it at all (defaults to false):
https://github.com/mmontes11/mariadb-operator/blob/main/config/samples/mariadb_v1alpha1_backup.yaml
Probably you are using the scheduled one from the samples maybe? That one is `physical

You are not supposed to manipulate the resources managed by the operator, in this case the CronJob/Job. If for some reason you want to achieve a different behaviour, you can open an issue so we can change the reconciliation logic to create those resources the way you think is better.

This should at least be documented.

We are aware of this:
https://github.com/mmontes11/mariadb-operator/issues/21

Is it possible to take a logical backup using the CRD?

Yes it is, you can either set backup.scpec.physical = false or not specifying it at all (defaults to false):
https://github.com/mmontes11/mariadb-operator/blob/main/config/samples/mariadb_v1alpha1_backup.yaml
Probably you are using the scheduled one from the samples maybe? That one is physical
Let me know if that solves your issue.

You were right, that there was a physical: true which I did not notice :sweat_smile:.
Unfortunately  I updated the mariadb-operator-chart and have now an inconsistent installation (I'll file a separate issue).
Closing this issue.


[2.0.1] Add ARM architecture support for AlmaLinux 8.4

@plirglo I think that this one: https://github.com/epiphany-platform/epiphany/issues/3143 will also be solved with this pull?

Correct, i updated this document

Correct, i updated this document

Perfect, I updated and connected the issue to reflect this. thx.


RUSTSEC-2020-0071 - time

Crate:     time
Version:   0.1.44
Title:     Potential segfault in the time crate
Date:      2020-11-18
ID:        RUSTSEC-2020-0071
URL:       https://rustsec.org/advisories/RUSTSEC-2020-0071
Solution:  Upgrade to >=0.2.23
Dependency tree:
time 0.1.44
├── merk 1.0.0
└── merk 1.0.0

Waiting on https://github.com/liftedinit/merk/pull/6 to be merged.


Fix setup-centos8 script to use pip3.9

Use pip3.9 to install packages since python39-pip is installed.

does pip3 not default to the newest installed pip version or change based on alternatives(which I guess I didn't chang? anther reason to use python3 -m pip ...)

The setup script itself does not use alternatives. I invoked the script on a clean centos8 container and I got pip3 command not found.

Is it not safe to use pip3.9 in the presence of other versions?

Oh no it should, I was just wondering. But of course I only touch alternatives in the docker image so this makes sense! Sorry for the confusion^^


Exception thrown when changing themes

I have a fresh install of pshazz and scoop on Windows 10. When I try to change themes, I get an error.
system32 $ pshazz use aag
Exception setting "theme": "The property 'theme' cannot be found on this object. Verify that the property exists and can be set."
At C:\Users\max\scoop\apps\pshazz\current\lib\config.ps1:26 char:9
$cfg.$name = $val
~~~~~~~~~~~~~~~~~
CategoryInfo          : NotSpecified: (:) [], SetValueInvocationException
FullyQualifiedErrorId : ExceptionWhenSetting

Should be fixed in https://github.com/lukesampson/pshazz/commit/8a23d403af1ac9dd5f7755752bbf52a1cea9d257 , please update pshazz to the latest version later on.

I'm running 0.2019.03.23. Scoop says this is the latest...
$ scoop update pshazz
pshazz: 0.2019.03.23 (latest version)
Latest versions for all apps are installed! For more information try 'scoop status'

The manifests update automation is in schedule, please wait for it to be executed. It will take some time.


Run fuzzer in CI

Add with overflow: AAAADEpYTCANCocKAAAAFGR0eXBqeGwgAAAAAGp4bCAAAQALanhscAAAAAD/CjAAHoAlPDwMSJgHwDRHeUMSz9dtB+jQB3S1rh1oQEUghLUWwdQ8ll10GhFMSGTJyAwzZfFMWXdKa//sLGm1WkNn+UwZvguArKOtMwv5iesKwwoI94D/BP////7/////////////7v///////////////////w==

This is the same as #232 and will be fixed in #235.


Client Crash -

When on a multiplayer server, teleported to another player with F7 spawn x overlays on, and the client crashed.
TownCraft Modpack 2.07
https://gist.github.com/ProsperCraft/c960a0de01928dcc8b43fb21a1adb83e

This seems to be a bug in IC2.

No longer having this issue, Ic2 must have fixed it.


Added programmatic pip list

Fixes #863
Proposed Changes

added a programmatic way to invoke pip list (as opposed to submodule call, which is unsafe)

Checklist

[x] CONTRIBUTING guide has been followed.
[x] PR is based on the current GaNDLF master .
[x] Non-breaking change (does not break existing functionality): provide as many details as possible for any breaking change.
[x] Function/class source code documentation added/updated (ensure typing is used to provide type hints, including and not limited to using Optional if a variable has a pre-defined value).
[x] Code has been blacked for style consistency and linting.
[x] If applicable, version information has been updated in GANDLF/version.py.
[x] If adding a git submodule, add to list of exceptions for black styling in pyproject.toml file.
[x] Usage documentation has been updated, if appropriate.
[x] Tests added or modified to cover the changes; if coverage is reduced, please give explanation.
[x] If customized dependency installation is required (i.e., a separate pip install step is needed for PR to be functional), please ensure it is reflected in all the files that control the CI, namely: python-test.yml, and all docker files [1,2,3].

Mmmm. One more thought.
The previous debug_info output was quite concise and that's why useful. Now it would be harder for user to copy it from terminal output. Is it ok?

Mmmm. One more thought. The previous debug_info output was quite concise and that's why useful. Now it would be harder for user to copy it from terminal output. Is it ok?

This is a good point. Should we flush the output to a file, gandlf_debug.info or something?

How do we use it? If we really need list of packages I'd prefer to use stdout & bash pipes instead of hardcoded flushing to file, so user do this:
 gandlf_debugInfo >> gandlf_debug_info.log

So user can both (1) output debugInfo to the terminal to see what's happening, and (2) store it to the file for easier usage if needed

That would be totally fine for a user who is conversant with a terminal interface, but for a "regular" user, the file creation might work better, no? Something like this:
python gandlf debug-info
Debug information has been written to "XYZ/gandlf_debug.info"; please either copy and paste this file or its contents to further guide GaNDLF maintainers towards solving your issue.

As you know, I have a personal preference for using tempfile.gettempdir() for the XYZ path. 😄
Thoughts?

Something like this:

Yeah, that's a good solution if we need pip versions.
But my question is in other direction: existing solution with printing a short but very informative debug_info looks really great IMO. It's very easy to use: just copy these 10 lines from the terminal and that's all. Both trying to copy 100 lines within terminal scrolling, or trying to copy a file from remote machine, looks like moore complex solutions for the user. So I want to ensure if we do really need a whole list of package versions? If it is needed not always but sometimes, maybe add an additional flag to the command like -v?

Yup, adding a -v flag makes perfect sense!

Just to highlight: all solutions look quite similar to me, I don't have a strong preference of one of them:) So I'm just asking and offering alternatives. Any usable solution is ok for me

Yup, adding a -v flag makes perfect sense!

Done!

Hey @VukW, could you please help me with this error? I am guessing it is coming from the entrypoint test, but I am unable to figure out what to change...
....
FAILED testing/entrypoints/test_debug_info.py::test_case[case0] - AssertionError: Function was not called with the expected arguments: expected_args={'verbose': True} vs actual_args={'verbose': False}, diff ['verbose']
FAILED testing/entrypoints/test_entrypoints_existence.py::test_command_execution[gandlf_debugInfo --help] - subprocess.CalledProcessError: Command '['gandlf_debugInfo', '--help']' returned non-zero exit status 1.

@scap3yvt Hi man!
 Right now old_way is calling debug_info() function without any arguments, while verbose bool param is required. That's why the second test fails

in testing/entrypoints/test_debug_info.py you need to update the tests.
Say we have a following CliCase test (example):

    CliCase(
        should_succeed=True,
        new_way_lines=["--foo", "-f"],
        old_way_lines=["--foo_old, "-f"],
        expected_args={"foo": True},
    )

That test means that we can run the following commands:
gandlf debug-info --foo
gandlf debug-info -f
gandlf_debugInfo --foo_old
gandlf_debugInfo -f

and all of them should lead to executing python debug_info() function with expected parameter of foo=True.
In original test the new_lines and old_lines are empty, so we are talking about running commands without any params:
gandlf debug-info
gandlf_debugInfo

And in this case we should expect verbose variable to be False, right?
So this specific test should look like
    CliCase(
       should_succeed=True,
       new_way_lines=[""],
       old_way_lines=[""],
       expected_args={"verbose": False},
   )

Similarly, as the previous test covers running commands omitting -v flag, you need to add a new test that covers the flag:

    CliCase(
        should_succeed=True,
        new_way_lines=["--verbose", "-v"],
        old_way_lines=["--verbose", "-v],   # you should implement this firstly as said in fix(1)
        expected_args={"verbose": True},
    )

Thanks a ton for the guidance, @VukW! I updated the code appropriately.

@scap3yvt Hi man!  Right now old_way is calling debug_info() function without any arguments, while verbose bool param is required. That's why the second test fails

in testing/entrypoints/test_debug_info.py you need to update the tests.
Say we have a following CliCase test (example):

    CliCase(
        should_succeed=True,
        new_way_lines=["--foo", "-f"],
        old_way_lines=["--foo_old, "-f"],
        expected_args={"foo": True},
    )

That test means that we can run the following commands:
gandlf debug-info --foo
gandlf debug-info -f
gandlf_debugInfo --foo_old
gandlf_debugInfo -f

and all of them should lead to executing python debug_info() function with expected parameter of foo=True. In original test the new_lines and old_lines are empty, so we are talking about running commands without any params:
gandlf debug-info
gandlf_debugInfo

And in this case we should expect verbose variable to be False, right? So this specific test should look like
    CliCase(
       should_succeed=True,
       new_way_lines=[""],
       old_way_lines=[""],
       expected_args={"verbose": False},
   )

Similarly, as the previous test covers running commands omitting -v flag, you need to add a new test that covers the flag:

    CliCase(
        should_succeed=True,
        new_way_lines=["--verbose", "-v"],
        old_way_lines=["--verbose", "-v],   # you should implement this firstly as said in fix(1)
        expected_args={"verbose": True},
    )

This (or an extended example set) would be an awesome addition for the migration guide (#843)! 😄

Hey @VukW, can you help with the errors I am seeing with the entrypoints [ref]?
FAILED testing/entrypoints/test_debug_info.py::test_case[case0] - TypeError: __init__() got an unexpected keyword argument 'metavar'
FAILED testing/entrypoints/test_debug_info.py::test_case[case1] - TypeError: __init__() got an unexpected keyword argument 'metavar'
FAILED testing/entrypoints/test_entrypoints_existence.py::test_command_execution[gandlf_debugInfo --help] - subprocess.CalledProcessError: Command '['gandlf_debugInfo', '--help']' returned non-zero exit status 1.

Hey @VukW, do you think you could shed some light on the error I am seeing? I am pretty sure it is related to this portion of the test:
    CliCase(
        should_succeed=True,
        new_way_lines=["-v"],
        old_way_lines=["-v True"], # <<<<< here
        expected_args={"verbose": True},
    ),

Which results in the following error message:
2024-05-04T13:46:01.2015561Z self = ArgumentParser(prog='GANDLF_DebugInfo', usage=None, description='Generate debugging information for maintainers.\n\nCo.../s44172-023-00066-3', formatter_class=<class 'argparse.RawTextHelpFormatter'>, conflict_handler='error', add_help=True)
2024-05-04T13:46:01.2018136Z status = 2, message = 'GANDLF_DebugInfo: error: unrecognized arguments: True\n'

But I am unable to figure out what I am doing wrong.

Hi @scap3yvt ,
Say you are testing line
old_lines = [
    ...,
    "--verbose True",
    ...
]

İt is the same as you are running manually the following command:
gandlf_debugInfo --verbose True

So you can run it to see / debug what happens. Anyway, if you are changing anything it worth to run the according command manually to check if it is successful - or debug any issues if they are, it's much quicker then committing and waiting till ci step is finished:)
In this specific case we expect old commands arg to be a normal flag, so you don't need to pass any value to it ( True in particular), command should look just like --verbose. BTW two committs ago (after removing metavar) the tests were already passing

Thanks for your input, @VukW! The tests are passing, but the added lines are not getting covered by the tests:

Any idea why this might be happening?

@scap3yvt This happens when the section of the code is never reached. Enable verbose in tests to reach this part of the code.

I was assuming that these lines would do the trick but they apparently don't work as expected. Any insight, @VukW?

Hey folks, let me look in more detail a bit later cos I didn't find answer from the first glance.
Actually the _debug_info() should not be covered at all (at least I don't remember any test covering it in a base branch). But by some reasons base branch shows it is covered, and after PR it is not covered though PR didn't change anything here...

@VukW, is it possible that the CliCase that should cover the --verbose option is not getting called?

What CliCase does is it checks _debug_info() function was called with verbose True/False arg. However for that test mocks up the real _debug_info() function: what is mocked, when and how is checked. So in reality this test is not running original _debug_info function at all - by design. That's why it's ok why your PR does not cover the function.
What is strange for me is why base branch thinks the function is covered? and why it was changed during PR? As that's why coverage shows you an error "coverage was reduced". So I'd have to look on this. If the function is really covered somehow in the base branch then we'd need to fix this

Thank you for that detailed explanation!

Hey @VukW - any update on this?

Hi @sarthakpati , thanks for reminder, didn't look on it yet. Let me check what's happening a bit later this week

Hi @sarthakpati , thanks for reminder, didn't look on it yet. Let me check what's happening a bit later this week

Checking in!

Hi @sarthakpati , thanks for reminder, didn't look on it yet. Let me check what's happening a bit later this week

Checking in!

Checking in, @VukW!

Hi @sarthakpati , thanks for reminder, didn't look on it yet. Let me check what's happening a bit later this week

Checking in!

Checking in, @VukW!

Checking in @VukW!

Hi @sarthakpati , thanks for reminder, didn't look on it yet. Let me check what's happening a bit later this week

Checking in!

Checking in, @VukW!

Checking in @VukW!

😅 sorry, yes, I'll reach this PR once...


⚠ Bofrost.es has degraded performance

In 3f70734, Bofrost.es (https://www.bofrost.es) experienced degraded performance:

HTTP code: 200
Response time: 1530 ms

Resolved: Bofrost.es performance has improved in b1f148f after 6 minutes.


Update INSTALL-RASPBIAN.md

Coverage remained the same at 100.0% when pulling 99c438830355f126f8e9a5e0f7198605801cc4ee on digitaltom-patch-4 into 11796c89eeb1fe6fe1eced6ddda063b289457446 on master.


Search requests from Rebecca Moore

From Rebecca: Can search functions in Webonary please be re-updated so that we:

have the option to search in either/both languages without the need to select one or the other; and
have the option to pull up all instances within a part of speech category while keeping the search text blank?

Both of these used to be options but a recent update has changed them. If this can be fixed on the user end, please let me know what I should do to bring these functions back. Thank you!
Verna's comment. Under languages, I guess we need to keep all languages as the default. I didn't think anyone would search for both languages at the same time. I guess I was wrong. So we need to add back the choice of All languages.
For the second point, in this example, there is one instance of Adjectival Pronoun. We don't know what it is and we want to find it, but when we search for it, it says, "No matches..."

I did this Search on https://www.webonary.org/daasanach?s=&search=Search&key=dsh&pos=ADJ-PN&semantic_domain=&search_options_set=1&match_whole_words=1&lang=en.

This is awesome!!!
On #546, it finds most of the Parts of Speech I search for, except the Adjective Singular (https://www.webonary.work/daasanach?s=&search=Search&key=dsh&pos=ADJ(SG)&semantic_domain=&search_options_set=1&match_whole_words=1&lang=en).
On https://www.webonary.work/test-stutzman?s=&search=Search&key=fr&pos=adv&semantic_domain=&search_options_set=1, it says there are 4 instances, but it finds 5.


Update [Azure Cosmos DB Emulator]

Tool name
Azure CosmosDb Emulator
Tool license
unknown
Add or update?

[ ] Add
[X] Update

Desired version
2.14.12
Approximate size
No response
Brief description of tool
No response
URL for tool's homepage
https://learn.microsoft.com/en-us/azure/cosmos-db/local-emulator-release-notes
Provide a basic test case to validate the tool's functionality.
No response
Platforms where you need the tool

[X] Azure DevOps
[X] GitHub Actions

Runner images where you need the tool

[ ] Ubuntu 18.04
[ ] Ubuntu 20.04
[ ] Ubuntu 22.04
[ ] macOS 11
[ ] macOS 12
[X] Windows Server 2019
[X] Windows Server 2022

Can this tool be installed during the build?
No response
Tool installation time in runtime
No response
Are you willing to submit a PR?
No response

Link: Azure CosmosDB emulator isn't running on localhost. · Issue #7039 · actions/runner-images

hello, @kaito-ms! thank you for your request. we will update to new version.

Deployed


26 migrate to dio

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Comparison is base (fc3e694) 98.86% compared to head (77eb332) 100.00%.

:exclamation: Your organization needs to install the Codecov GitHub app to enable full functionality.
Additional details and impacted files
@@             Coverage Diff             @@
##             main       #27      +/-   ##
===========================================
+ Coverage   98.86%   100.00%   +1.13%
===========================================
  Files          22        18       -4
  Lines         264       188      -76
===========================================
- Hits          261       188      -73
+ Misses          3         0       -3

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


Fix as_texture shader for single-channel textures

This commit introduced a bug: when the texture has a single channel, out_color is left to its default value of (1, 1, 1). It should probably be set based on the value of that single channel, e.g.
out_color = color(out_channel);

We should probably also set out_channel in the case of multi-channel textures.

@dictoon what are we going to set the single channel output to in the case of multiple channels? The first channel (R) ? Alpha if present? Luminance of RGB?

@luisbarrancos I'd say luminance ("black & white output") would be more intuitive.

@dictoon ok, have in mind the coefficients are provided by Y in the XYZ->RGB matrix, so they are color space dependent. We can hardcode to Rec.709 luminance for now.

That's plenty enough. We just need to do something reasonable.

on 2nd thoughts, if CMS is active, we have information to use the proper Y coefficients and do the right thing. No need to compromise. If CMS is inactive though, then data is assumed raw, and getting the relative luminance would be meaningless since it's RGBW relative, so the average of RGB is used in this case. The docs will be updated to reflect this as well.


Fix has_func logic in tabulate perf

This PR should fix the has_func logic in the performance tabulation.

bors r+


Linux "perf" traces give a confusing error if the trace is not named "perf.data.txt"

I was trying to have multiple trace files in the same directory.  I was really confused because only my original trace (named perf.data.txt) would open correctly.  Eventually it was realized that the file name matters.  Renaming the other trace to something else and my new trace to perf.data.txt allowed me to open it in WPA.  This error message is counfusing/misleading to me because it doesn't provide any guidance or hint about what is wrong.

(Apologies for a screenshot of a screenshot)

This is good feedback and valid. Unfortunately, this is similar to matching file extensions in the OS file browser with apps that handle certain extensions. If an app says it doesn't handle X file or extension, then it might be nice to see what files are supported, rather than the OS just giving up.
However, the SDK only has this func which each plugin implements custom logic (IsDataSourceSupportedCore(IDataSource dataSource) {} ) so it doesn't expose this now - only that is can or can't accept a given file


Chapter 3 won't build on purs 0.11.6

I can't compile the code for the third chapter. After running the following commands :
cd exercises/chapter3
git checkout 0.11.3
bower update
pulp build

J'ai le message d'erreur suivant :
* Building project in /Users/gbe/projects/purescript/purescript-book/exercises/chapter3
Error 1 of 4:

  at bower_components/purescript-arrays/src/Data/Array.purs line 168, column 1 - line 168, column 1

    Unable to parse module:
    unexpected comma in constraints.

Class constraints in type annotations can no longer be grouped in parentheses.
Each constraint should now be separated by `=>`, for example:
    `(Applicative f, Semigroup a) => a -> f a -> f a`
  would now be written as:
    `Applicative f => Semigroup a => a -> f a -> f a`.

    expecting indentation past column 1, (, qualifier, proper name, operator or ->

  See https://github.com/purescript/documentation/blob/master/errors/ErrorParsingModule.md for more information,
  or to contribute content related to this error.

Error 2 of 4:

  at bower_components/purescript-arrays/src/Data/Array/ST.purs line 34, column 34 - line 34, column 34

    Unable to parse module:
    The `*` symbol is no longer used for the kind of types.
  The new equivalent is the named kind `Type`.

  See https://github.com/purescript/documentation/blob/master/errors/ErrorParsingModule.md for more information,
  or to contribute content related to this error.

Error 3 of 4:

  at bower_components/purescript-proxy/src/Type/Proxy.purs line 55, column 21 - line 55, column 21

    Unable to parse module:
    The `*` symbol is no longer used for the kind of types.
  The new equivalent is the named kind `Type`.

  See https://github.com/purescript/documentation/blob/master/errors/ErrorParsingModule.md for more information,
  or to contribute content related to this error.

Error 4 of 4:

  at bower_components/purescript-strings/src/Data/String/Regex.purs line 29, column 1 - line 29, column 1

    Unable to parse module:
    The `*` symbol is no longer used for the kind of types.
  The new equivalent is the named kind `Type`.

  See https://github.com/purescript/documentation/blob/master/errors/ErrorParsingModule.md for more information,
  or to contribute content related to this error.

* ERROR: Subcommand terminated with exit code 1

I was able to reproduce this, and the following fixed it (on the 0.11.3 branch, like you're using):
rm -rf bower_components/
bower install
pulp build

@gbersac does this work for you?

@grdryn I stopped trying purescript so I won't test it sorry.

@grdryn I had a similiar issue on the master branch. Checking out 0.11.3 and cleaning bower_components helped me.


Docs: Add Radio accessibility docs

Closes  #1549
Description
Add accessibility section for Radio.
Current behavior (updates)

New behavior

Is this a breaking change (Yes/No):
No
Additional Information
I am not a native English user, so please point out if my English is incorrect.
Also, I was wondering about the aria-labelledby specifications and would like you to point out if I am incorrect.

@Haru-0001 @fffk10 @haru-036
aria-labelledbyis not set toRadioGroup. It would be good to write the operation of idandaria-labelledbyas a supplement to the page. Also, you need to explain what happens when you useFormControl`.

@Haru-0001 @fffk10 @haru-036
aria-labelledby is not set to RadioGroup. It would be good to write the operation of id and aria-labelledby as a supplement to the page.
Also, you need to explain what happens when you use FormControl.

I understand. I would like to correct the points you pointed out.

I have corrected it. Please point out any omissions.


[icon request] RSS feed (edit: icon requests bucket)

It would be nice to have an RSS feed icon.

There's also few icons for Developers Italia website, as requested by @libremente on https://github.com/italia/developers.italia.it/issues/671

SVGs have been done, I just need to add them to the library

SVGs have been done, I just need to add them to the library

Hi @francescozaia, awesome! Any update on this side? cc @emilioSp

SVGs have been done, I just need to add them to the library

Hi @francescozaia, awesome! Any update on this side? cc @emilioSp

New icons added in v1.4.2:

it-open-source
it-piattaforme
it-rss.svg
it-rss-square
it-software
it-telegram

New icons added in v1.4.2:

it-open-source
it-piattaforme
it-rss.svg
it-rss-square
it-software
it-telegram


Failure to update PR with GitHub workflow

Example case: https://github.com/polkadot-fellows/runtimes/actions/runs/7902128978
Error message:

HttpError: refusing to allow a GitHub App to create or update workflow .github/workflows/changelog.yml without workflows permission

Requires investigation.

GitHub app has read/write access to workflows:

Theory 1:
The PR that was modified contained a workflow file and is a fork. Technically modifying the fork would consist in also modifying the workflow file inside a different repo.

I'm able to reproduce the problem:
https://github.com/paritytech-stg/up-to-date-action/actions/runs/7918343737

Created the following discussion to publicly report the problem:

Error: refusing to allow a GitHub App to create or update workflow #108402


Added Newsletter in footer

Issue #401
Added newsletter in footer

Nice work @AbhipsaGuru1012 😎

Nice work @AbhipsaGuru1012 😎

Nice work @AbhipsaGuru1012 😎

@smaranjitghose Thank you so much!

Nice work @AbhipsaGuru1012 😎

@smaranjitghose Thank you so much!


Parsing wikibase data to RDF

reading wikibase/mediawiki data and transforming it to RDF graph in order to serialize it as TTL file

the ttl/rdf format generated from wikibase doesn't serve the purpose as it generates useless prefixes and incomprehensible data.


Python 2.7 compatibility and missing dependency

Hi @pnpnpn!
Thanks for making your code open-source. I fixed a few issues that I encountered while trying dna2vec:

Missing dependency: "logbook"
Imported the "print_function" from the "future" module to ensure Python 2 compatibility in multi_k_model.py

Cheers,
Alex

Lgtm. Thanks!


build based on mtime

~This PR allows for targeted builds of gallery components~. It ensures gallery components are only built when changed or if the target file does not exist. This functionality is possible by checking the mtime stat on a file. This is very similar to how Makefile target dependencies work
cc @mikolalysenko @Erkaman @substack

This change is

bin/build-gallery.js, line 338 at r1 (raw file):

  ncp('example/assets', 'www/gallery/assets', function (err) {
    if (err) { return console.error(err) }

Thanks for cleaning that up

Comments from Reviewable

Comments from Reviewable

Reviewed 1 of 1 files at r1.
Review status: all files reviewed at latest revision, 1 unresolved discussion.

Comments from Reviewable


Esphome config update

Moved "Droplet" name in module and HomeAssistant variables to a substitution ${name}, so it can be changed easily.
Moved lambda return{}; ouside the if statement, so it will always satisfy the return from the lambda function (and not only if the condition is false).
Removed a few empty lines from the file.

Thanks!!!!!


Fallback pages

There might be a chance where the user or developer accidentally went to a page that does not exist. As FusionRouter iterates a table every possible route, there is no error produced when no such page is found. This can be really confusing when you have a page that waits for server's response before actually loading the content in it!
In the future, we want to consider implementing fallback pages for errors like:

Page is not found
Page building error (no idea how to implement this yet, likely through a computed function)
Route configuration error

I have been thinking about whether to implement this or not, but since FusionRouter would nicely produce an error if the path is malformed or leads to a non-existent route. There are honestly not enough benefits that convince this feature to be made.
Is malformed path user's fault? Is non-existent path user's fault? No, not really. For some exceptional situations it may be (letting user navigate by typing paths) but in general it's more of a developer fault. Developer should already know those problems when they are testing their UI since FusionRouter would've errored if something went on, and Fusion would too if the page builder function is flawed.


Feature request: send more data to Sentry

I suggest adding more info to Sentry reports: having additional request info and performance monitoring data would be very helpful.
Adding more error details
this
Here's how the image download error looks like at the moment

The most painful problem is that there's no way to get the image URL from error report. You'll need to find the request URL somewhere in the issue details, copy the trailing part, cut off the extension and then decode base64 elsewhere. It would me much more convenient if we had the exact source image url in the report. Sentry SDK has several tools to help with that.
Adding some other details like processing options and request id could also be useful.
Performance monitoring
Sentry also allows to track some performance metrics (docs). Adding this to imgproxy would also be useful: for example, we could detect and optimize slow image transform operations or analyze image download errors more closely.

Hey @ingria!
That's a good idea. Added request ID, processing/info options, and source image URL to error reports.
As for performance monitoring with Sentry, PRs are always welcome 😉


FERPlus checkpoint

Hello, could you please provide a .h5 checkpoint for the model trained on FERPlus?

And scripts for training

Hi, we will consider the FERPlus model. As for the scripts, they will only be released after our paper is accepted.


Setup CI

Add CI scripts
Update setup.py to find CUDA includes and libs
Update recipe to match uploaded packages

rerun tests

rerun tests

rerun tests

We've been building this for Python 3.10 as well.  I don't know if that's possible with gpuCI at the moment

We've been building this for Python 3.10 as well. I don't know if that's possible with gpuCI at the moment

We don't support Python 3.10 for now


Add SchemaName or DatabaseName to TableNameAttribute

It would be great if I could define which Schema (often called Database on some platforms) a particular table resides.  Today if I have a connection to a database server that houses multiple Schemas (databases in SQL Server speak), I have to make a unique connection to each Schema to access tables.  For example...
var dbProduct = new Database("product");
var rows = dbProduct.Fetch<mytable>("where name = @0", ...);

But if I have access another table in a different schema on the same server instance, I have to make a new connection...
var dbReport = new Database("report");
var rows = dbReport.Fetch<othertable>("where.....");

Ideally I should be able to set a non-null/blank "SchemaName" or "DatabaseName" on the TableNameAttribute...
[TableName(SchemaName = "report",...)]
public class othertable....;

If this was done, I could perform this action...
// fetch data from table not found in the originally connected schema but on the same server
var rows = dbProduct.Fetch<othertable>("where ....");

Today I sort of work around this issue by using a fully defined select statement...
// using a connection the product schema fetch data from a table in the report schema...
var rows = dbProduct.Fetch<othertable>("select * from report.othertable where....");

However, this does not work with simple inserts/updates.
// this would fail...
dbProduct.insert<othertable>(sampleRowForOtherTable);

But if 'othertable' SchemaName was defined, nPoco would know it would need to include the explicit schema name when building its internal query.
Thoughts?  I can't be the only one that has to work with multiple Schemas/Databases/Users that reside on the same server instance.

This is already possible.
The table name is used.
eg.
[TableName("[myschema].[tablename]")]

The only thing to bear in mind is that you must escape it yourself, if needed

Hmmm, I thought I tried that once.  Maybe I need to try again and figure out why it was failing.
Thanks.

I'm not sure what I was doing before, but this seems to work.  Sorry about that.  I'll close the ticket.


Integrate Packet Forward Middleware

What is the purpose of the change
Integrate the packet forward middleware
Brief Changelog

Integrated packet forward middleware.
Should this be in the changelog?

Testing and Verifying

All existing tests that use IBC pass (especially E2E)
Should we add an custom E2E test for PFM?

Documentation and Release Note

Does this pull request introduce a new feature or user-facing behavior changes? (yes )
Is a relevant changelog entry added to the Unreleased section in CHANGELOG.md? (no)
How is the feature or change documented? (not applicable   )

@ValarDragon Updated to the newer version of PFM which solves the json encoding issue we discussed. This should be ready for re-review/merge

Needs changelog pre-merge


Create a health rote

It's useful to deploy the pypicloud in PAAS like marathon/heroku or any other who use a health check route to keep the service up.

This is easy enough. Does it have to be anything specific, or will /health that returns an empty 200 be okay?

It's ok


[QST] TPC-DS Query-93 on gpu is slow

this is follow on https://github.com/rapidsai/cudf/issues/6107
@jlowe  I will use nsight system to profile this query later and upload the file

@chenrui17 I have not been able to reproduce this yet, but I am going to keep trying.
I have tried with scale factor 200 on a single node on top of spark-3.0.0, but looking at the logs you put in the other issue, it looks like you are using 3.0.1 with adaptive query execution enabled and a 1TB data set.
But the detailed log you gave was for the CPU run, so I am not sure if these configs were the same for both runs.
    "spark.sql.adaptive.coalescePartitions.initialPartitionNum": "3000",
    "spark.sql.files.maxPartitionBytes": "1024m",
    "spark.sql.adaptive.enabled": "true",
    "spark.sql.shuffle.partitions": "3000"

Was the data partitioned?  This can have a huge impact on GPU performance because of small files.

I have been playing around with AQE with this query and I am seeing a lot of slowness when reading the input data because it highly partitions the output data.  The slowness you are seeing could be related to fetching lots of small partitions.  If you are running with 3000 partitions on the GPU side it could be related to this.

@revans2 i confirmed that the data is partitionned

@chenrui17 I have not been able to reproduce this yet, but I am going to keep trying.
I have tried with scale factor 200 on a single node on top of spark-3.0.0, but looking at the logs you put in the other issue, it looks like you are using 3.0.1 with adaptive query execution enabled and a 1TB data set.
But the detailed log you gave was for the CPU run, so I am not sure if these configs were the same for both runs.
    "spark.sql.adaptive.coalescePartitions.initialPartitionNum": "3000",
    "spark.sql.files.maxPartitionBytes": "1024m",
    "spark.sql.adaptive.enabled": "true",
    "spark.sql.shuffle.partitions": "3000"

Was the data partitioned? This can have a huge impact on GPU performance because of small files.

it looks like you are using 3.0.1 with adaptive query execution enabled and a 1TB data set.

in fact, i use a 100GB data set ,why you say i use a 1TB data set . and about AQE configuration , i will attemp to turn off , About AQE, I'll try to turn it off for testing

I have been playing around with AQE with this query and I am seeing a lot of slowness when reading the input data because it highly partitions the output data. The slowness you are seeing could be related to fetching lots of small partitions. If you are running with 3000 partitions on the GPU side it could be related to this.

about "spark.sql.shuffle.partitions " , I found that it did affect performance , but if i set it smaller , it often OOM

in fact, i use a 100GB data set ,why you say i use a 1TB data set . and about AQE configuration , i will attemp to turn off , About AQE, I'll try to turn it off for testing

In the log file you attached the input path included TB in it so I assumed it was a 1TB data set.
I ran with a partitioned 100 GB data set on a single 16GB-V100. I can try and play around with the data size to see what I ended up with, but I had a much larger batch size then that too.  It sounds like you might be running into issues with PTDS and memory fragmentation in RMM.
@jlowe what do you think.  Because I have been running with a 1GB batch size a 1 GB input partition size, and I was able to run with a shuffle.partitions of 2 with PTDS disabled.

We've definitely seen increased OOM issues with per-thread default stream enabled, which lead us to turned that off in the recent cudf-0.15-SNAPSHOT builds.
@chenrui17 I would recommend retrying with smaller partitions with a cudf built with PTDS disabled.  If you are getting the latest cudf-0.15-SNAPSHOT builds from Sonatype then it should have PTDS off.  If you're building cudf on your own, make sure you do not specify PER_THREAD_DEFAULT_STREAM or specify PER_THREAD_DEFAULT_STREAM=OFF in both the cpp and java builds.

In the log file you attached the input path included TB in it so I assumed it was a 1TB data set.

The amount of data displayed in the path is inconsistent with the actual data data size ;
@jlowe  That's right ，I use the cudf jar from Sonatype recently , and before ,I use rapids-0.1 to run tpc-ds query, Basically, they can pass normally. so , now ,if I use the latest cudf-0.15-SNAPSHOT jar from Sonatype , its PTDS is off ?

if I use the latest cudf-0.15-SNAPSHOT jar from Sonatype , its PTDS is off ?

Yes, it has been disabled in the snapshot builds since the 20200828.210405-58 snapshot.

@revans2 In addition, I would like to ask a question, do I need to switch the spark version from spark 3.0.1 to 3.0.0

@jlowe  my nsys file and history ui is about 100m + , how can i send it to you .

@chenrui17 you should not need to switch from 3.0.1 to 3.0.0.  We "support" both of them, but until 3.0.1 is released it is a moving target, but the Rapids Accelerator requires 3.0.1+ to be able to support Adaptive Query Execution.

@chenrui17 I looked at the nsys trace.  I don't see any task taking 36 seconds, as reported in the GPU join metrics in the history UI.  I'm guessing this trace was of an executor that did not run the task that hit that long build time, so it's not necessarily representative of what happened on that task.
None of the build or joins took very long in the trace once the task started processing.  I did see what appears to be tasks spread out in the second stage, and I'm assuming this is waiting for the GPU semaphore.  I can't know for sure since Java NVTX ranges were missing from the trace.  To add them, you would need to build your own cudf jar, as the snapshot-published version has NVTX ranges turned off for performance (i.e.: published snapshot builds libcudf with -DUSE_NVTX=OFF).
We've tried to reproduce this behavior locally but have not seen such large discrepancies between the join build time metric and one of the coalesce batch collect metrics above it.

I'm fairly confident this large amount of time is mostly time the task spent waiting for its turn on the GPU.

I mean what you said is task time is mainly wating for semaphore to fight for the right to use gpu. ?
if so ,the bottleneck is gpu resource ? if i use 2 gpu like T4, Performance will be significantly improved ？

The main bottleneck during this portion of the query is waiting to acquire the semaphore.  However the tasks owning the semaphore are not making full use of the GPU.  The main portion of time they are spending is decompressing shuffle data on the CPU and copying it down to the GPU.  They need to own the GPU semaphore during this phase because they are placing data onto the GPU.  The whole point of the GPU semaphore is to prevent too many tasks from placing data onto the GPU at the same time and exhausting the GPU's memory.
Essentially the main bottleneck in that stage is dealing with the shuffle data and transfer to the GPU, because that's what's taking so long for the tasks holding the GPU semaphore to release it.  Once the shuffle data is loaded on the GPU, the rest of the stage processing is quite fast.  The RapidsShuffleManager was designed explicitly to target this shuffle problem, as it tries to keep shuffle targets in GPU memory and not rely on the CPU for compression/decompression which can be a bottleneck.  Unfortunately there are a number of issues with RapidsShuffleManager that prevent it from working well in all situations, but we're actively working on improving it.  Our goal is to eventually have that shuffle manager be the preferred shuffle when using the RAPIDS Accelerator, even if the cluster does not have RDMA-capable hardware.

if i use 2 gpu like T4, Performance will be significantly improved ?

If you add more GPUs (and thus more executors, since an executor with the plugin can only control 1 GPU), yes, performance should be improved to a point.  This would be similar to adding executors to a CPU job.  If you have enough GPUs in your cluster so that CPU_cores_per_executor == concurrent_GPU_tasks then no task will ever wait on the GPU semaphore.

The main bottleneck during this portion of the query is waiting to acquire the semaphore. However the tasks owning the semaphore are not making full use of the GPU. The main portion of time they are spending is decompressing shuffle data on the CPU and copying it down to the GPU. They need to own the GPU semaphore during this phase because they are placing data onto the GPU. The whole point of the GPU semaphore is to prevent too many tasks from placing data onto the GPU at the same time and exhausting the GPU's memory.
Essentially the main bottleneck in that stage is dealing with the shuffle data and transfer to the GPU, because that's what's taking so long for the tasks holding the GPU semaphore to release it. Once the shuffle data is loaded on the GPU, the rest of the stage processing is quite fast. The RapidsShuffleManager was designed explicitly to target this shuffle problem, as it tries to keep shuffle targets in GPU memory and not rely on the CPU for compression/decompression which can be a bottleneck. Unfortunately there are a number of issues with RapidsShuffleManager that prevent it from working well in all situations, but we're actively working on improving it. Our goal is to eventually have that shuffle manager be the preferred shuffle when using the RAPIDS Accelerator, even if the cluster does not have RDMA-capable hardware.

if i use 2 gpu like T4, Performance will be significantly improved ?

If you add more GPUs (and thus more executors, since an executor with the plugin can only control 1 GPU), yes, performance should be improved to a point. This would be similar to adding executors to a CPU job. If you have enough GPUs in your cluster so that CPU_cores_per_executor == concurrent_GPU_tasks then no task will ever wait on the GPU semaphore.

So, does it only a time counting problem? what it the root cause why tpc-ds 93 is so slow?

The main bottleneck during this portion of the query is waiting to acquire the semaphore. However the tasks owning the semaphore are not making full use of the GPU. The main portion of time they are spending is decompressing shuffle data on the CPU and copying it down to the GPU

Essentially the main bottleneck in that stage is dealing with the shuffle data and transfer to the GPU, because that's what's taking so long for the tasks holding the GPU semaphore to release it. Once the shuffle data is loaded on the GPU, the rest of the stage processing is quite fast.

I think this is  common for most query
but why waiting-on gpu semaphore hurt the performance？
I think，only when the time needed for cpu processing / cpu tasks that can run in parallel is  bigger then the time needed for gpu processing, the gpu will go into  starvation； (the cpu part worked as producer, the gpu part worked as consumer; and in this case cpu tasks that can run in parallel equals to concurrentGpuTasks because they are all within the scope of gpu semaphore, but since we use multi-core cpu, the cpu part can run in parallel, and the gpu part will still run  in serial, because no PTDS)
increasing concurrentGpuTasks shoud improve the performance significantly if all the above analysis (include your and my) hold true
BTW:
based on our test, use  bigger concurrentGpuTasks cat improve the performance (concurrent=2, 4, 6,  the query time is ~148s, ~114s, ~89s; concurrent=6 has high risc of OOM)
So, the RMM optimization (like reducing fragment) to lower the OOM risc shoud be in a higher priority，we need higher concurrentGpuTasks as much as possible

@jlowe
Another question,
GpuCoalesceBatches's number of output columnar batches is always same as shuffle partation when GpuCoalesceBatches is after GpuColumnarExchnage (the reduce stage)
WHY?
BTW:
// spark-shell
--conf spark.sql.shuffle.partitions=
// spark-defaults.conf
spark.sql.adaptive.enabled true
spark.sql.adaptive.coalescePartitions.enabled true
spark.sql.adaptive.coalescePartitions.initialPartitionNum 64   //  always same as spark.sql.shuffle.partitions
spark.sql.adaptive.coalescePartitions.minPartitionNum 1
spark.sql.adaptive.skewJoin.skewedPartitionThresholdInBytes<PHONE_NUMBER>
spark.sql.adaptive.skewJoin.skewedPartitionFactor 5
spark.sql.adaptive.advisoryPartitionSizeInBytes<PHONE_NUMBER>

@JustPlay

GpuCoalesceBatches is trying to do one of two things.
a. It is either trying to build up a larger batch so the GPU can process it efficiently.  The target is to hit spark.rapids.sql.batchSizeBytes bytes, but it may cut the batch off early if it detects that a string column would be too long, etc.  The default value for this is 2GB, and rarely does a single task get more than 2GB of data to process, unless there is data skew.
b. It is trying to build a single batch so some types of processing can work correctly.  This typically happens for sort, the build side for a hash join, and window functions.  Because these require a single batch then you will always see a single batch, at least until we can improve sort and some of the others to work on data that is larger than would fit in GPU memory.

GpuCustomShuffleReader is a replacement for the spark CustomShuffleReader which shows up as a part of some AQE shuffles. According to the docs it is A wrapper of shuffle query stage, which follows the given partition arrangement. I think that means it allows AQE to mess with shuffle a bit to improve performance.

GpuCoalesceBatches is trying to do one of two things.
a. It is either trying to build up a larger batch so the GPU can process it efficiently.  The target is to hit spark.rapids.sql.batchSizeBytes bytes,

I can not find the code snippet(s) used to compare the batch's size (or the coalesced batch's size) with spark.rapids.sql.batchSizeBytes (sql-plugin/src/main/scala/com/nvidia/spark/rapids/GpuCoalesceBatches.scala);

why GpuCoalesceBatches exists only in one side of GpuShuffledHashJoin, not both?

It should be on both sides, and is a bug if it is not.  What query did you run and what config settings did you use for this?  My guess is that it is probably related to AQE in some way, but I am just speculating at this point.

I can not find the code snippet(s) used to compare the batch's size (or the coalesced batch's size) with spark.rapids.sql.batchSizeBytes (sql-plugin/src/main/scala/com/nvidia/spark/rapids/GpuCoalesceBatches.scala);

https://github.com/NVIDIA/spark-rapids/blob/2ee1a8d22103e4c584c12972f592e59258f25066/sql-plugin/src/main/scala/com/nvidia/spark/rapids/GpuCoalesceBatches.scala#L268-L323
The code is in a generic place because we use it for both the host size and device side concat.
The target size is inserted in GpuTransitionOverrides so an operation can ask for a coalesce batch to be inserted after it, and also an operation can ask for a coalesce to be inserted for one of its inputs.  Then the code decides if there are multiple requests which one wins (right now it is which is larger).
I should also clarify that the only time you should not see a GpuCoalesceBatch after a shuffle is if the data right after the shuffle is being sent directly to the host side.  In all other cases it should be inserted.

It should be on both sides, and is a bug if it is not. What query did you run and what config settings did you use for this? My guess is that it is probably related to AQE in some way, but I am just speculating at this point.

pic1-4 with GpuCoalesceBatches exists only in one side with AQE = ON (TPC-DS 18, 56, 33, 14a, 10, ....)
pic5 with  GpuCoalesceBatches on both side with AQE=OFF (i forget which query，i only remember AQE=OFF)

It should be on both sides, and is a bug if it is not. What query did you run and what config settings did you use for this? My guess is that it is probably related to AQE in some way, but I am just speculating at this point.

pic1-4 with GpuCoalesceBatches exists only in one side with AQE = ON (TPC-DS 18, 56, 33, 14a, 10, ....)
pic5 with GpuCoalesceBatches on both side with AQE=OFF (i forget which query，i only remember AQE=OFF)

but is AQE really take effect，should there exists a GpuCustomShuffleReader node?  in my pics, no such node

Since this issue originated as a question about slowness on query 93, I filed #698 to track the missing coalesce issue separately.

@JustPlay Yes, I would expect to see a GpuCustomShuffleReader after each shuffle exchange when AQE is enabled. I have just been trying to reproduce the issue with the missing coalesce step and was not able to reproduce it with the latest plugin code from branch-0.2 and Spark 3.0.1-rc3.

@chenrui17 is there anything left to answer or can this be closed?

Closing since there was no response.  Please reopen or file a new question if needed.


Supportability of Blob storage events on secondary endpoint of ADLS Gen2

Dear All,
In published document https://docs.microsoft.com/en-us/azure/storage/blobs/data-lake-storage-supported-blob-storage-features
it is clearly mentioned that Blob storage events is a supported feature on ADLS Gen2.
Events | Generally available | Generally available | Reacting to Blob storage events
However according to PG/TA feedback this feature is NOT supported on the secondary endpoint if the account has GRS-RA enabled. (due to mechanism applied for replication).
Case owner has reproduced it in house so we believe what PG/TA advised is true.
Could you please help to mark this out in document ?
Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: a416e755-b0bc-445b-3fcb-99d1f1d51eef
Version Independent ID: 227b8748-c529-f546-abf4-fbc6aef9be4c
Content: Blob storage features available in Azure Data Lake Storage Gen2
Content Source: articles/storage/blobs/data-lake-storage-supported-blob-storage-features.md
Service: storage
Sub-service: data-lake-storage-gen2
GitHub Login: @normesta
Microsoft Alias: normesta

Thanks for reporting this. I have assigned the issue to the content author to investigate further and update the document as appropriate.

Thanks for reporting @celinama . @sachinsbigdata does this align with your expectations of events and secondary regions? I just want to make sure that this is not a bug before documenting this. Thx!

Hello @sachinsbigdata , could you please help to provide your insights? Thank you!

Thank you for reporting. I've added a section to the Data Lake Storage Gen2 known issues article here - https://docs.microsoft.com/en-us/azure/storage/blobs/data-lake-storage-known-issues#events. I've also tagged the Blob Event entry in the blob storage feature support table to indicate that there are issues with this feature and to point readers to the known issues article. That table is here - https://docs.microsoft.com/en-us/azure/storage/blobs/storage-feature-support-in-storage-accounts. There's a similar note in the "Feature Support" section of the Blob Events article here - https://docs.microsoft.com/en-us/azure/storage/blobs/storage-blob-event-overview#feature-support.
#please-close


Performance improvements: code splitting, improved lighthouse score

Performance improvements | Code splitting and lazy loading core components

This Pull Request tries to optimize the performance of the app by reducing the bundle size using code splitting and uses the existing Spinner component as a fallback till the component(page) loads. This would result is better performance as the app gets more content-heavy over time.
Description

Resolves #158
Linked Issues

Closes #158

Type of Change

New feature (non-breaking change which adds functionality)

Changes

Used lazy and Suspense to perform code splitting
Used the existing Spinner component as a fallback to display until the page loads

Screenshots/Recordings

Lighthouse score before optimization:

Lighthouse score after optimization

Screenshot of dist folder after npm run build is executed

Spinner loading animation (centered) - throttled to view on low end devices or slow internet connection

Checklist before requesting a review

[x] I have performed a self-review of my code
[x] I assure there are no similar/duplicate pull requests regarding the same issue
[x] My changes follow the project's coding guidelines and best practices
[x] Code is formatted properly and lint check passes successfully

Nicely done. 🔥 Thank you for your contribution

Nicely done. 🔥 Thank you for your contribution

Thanks a lot for the encouragement and support ❤


App example?

Hi,
I host one of these OpenAI-API compatible inference servers for academics ( just like https://chat.lmsys.org ), and I was thinking about making an IOS app which would talk to such a server.
Turns out I'm a zero on swift, and Xcode is overwhelming from the first sight, to say the least.
The examples in the README lead me to nowhere. I have absolutely no idea how to transform this repo into a useful app.
A minimal example which one could clone and try would be amazingly welcome.
A second thing is that this repo is hardcoded to talk to OpenAI, but not to openai-compatible servers. This is something you might have some interest in. Check the example of https://Continue.dev - they allow you also to point to private inference servers.
Thanks!

Hey!
Big thanks for dropping your ideas here. Just added a Demo app to the repo for a quick start on the Swift/Xcode journey. It’s a simple example to clone and play with for creating your iOS app to connect with an OpenAI-API compatible server.
Regarding the idea to adjust the repo for chatting with openai-compatible servers, It’s a cool suggestion but currently, we're zooming in on OpenAI services. Maybe something to explore in the future, but it's not planned for the next iterations of SwiftOpenAI SDK


Boogie allows identifiers to start with . and @, which SMTLIB does not

The following legal Boogie program (based on its current language spec):
procedure foo() {
  var .x:int;
  assert .x == 0;
}

causes Boogie to throw an exception when used with CVC4:
boogie test.bpl /proverOpt:SOLVER=cvc4

Here is the exception excerpt:
Prover error: (error "Parse Error: <stdin>:11.15: cannot declare or define symbol `.x'; symbols starting with . and @ are reserved in SMT-LIB

I'd like to disallow use of @ in a variable name because of #5. Of course we could change the attribute set reference operator from @ to something else if my proposal is accepted.

Disallowing @ solves only one half on this problem :). Breaking backwards compatibility also means that potentially many tools will have to adjust their Boogie output. We (meaning team SMACK) can adjust relatively easily, but I am not sure about others. If we disallow @ then we should probably disallow . as well.

Another way (as I mentioned in the duplicate issue #8) would be to sanitize the two prefixes inside Boogie. So we would have an initial pass that basically detects vars that start with @ or . and change them to another symbol. I think that I saw Boogie doing this already for one of the prefixes, but I might be wrong. This would also mean that an external tool would not have to change. I am not sure which is the best way to approach this though, and it could be related to what Dan proposed in #5 or not.

Yes, my preference would be to sanitize within Boogie, but I will not push strong in that direction since we can adapt our tool either way.

I'm fine with sanitizing @ and . for now but I wanted to bring up #5 because if it was implemented in it's current form @ wouldn't be allowed in Boogie variable names anyway.

Are you sure about @ being allowed in identifier names? This doesn't parse
procedure foo() {
  var @x:int;
  assert @x == 0;
}

Ah, sorry, I think that @ sneaked into this since Corral generates internally variables starting with @. Sorry about that. See http://research.microsoft.com/en-us/um/people/leino/papers/krml178.pdf on page  4 where identifiers are defined and @ is indeed not allowed.

I think the main problem is with the . prefix, as SMACK generates quite a few constants (e.g. .str) using it.

Hmm let me look into this. SMTLibNamer at a glance is supposed to disallow . in an identifier
  public class SMTLibNamer : UniqueNamer
  {
    // The following Boogie ID characters are not SMT ID characters: `'\#
    const string idCharacters = "~!@$%^&*_-+=<>.?/";

but clearly it's not working. I will investigate...

Hmm well I managed to get Boogie to emit |.x|  (i.e. it is quoted) instead of .x but CVC4 still rejects this
(error "Parse Error: x.smt2:3.17: cannot declare or define symbol `.x'; symbols starting with . and @ are reserved in SMT-LIB

  (declare-fun |.x| () Int)
                ^
")

I'm not sure if this a bug in CVC4 or this really is illegal in SMT-LIB. I've e-mailed the SMT-LIB mailing list and we'll see what they say.

The mailing list post is here

@zvonimir  @pdeligia
Okay I've tried to fix the issue in bed8d4a027c635a146911a2ce973046f02a8e719
Does this fix your problem?

I'm closing this. Please re-open if it's still a problem.


[WIP] Adds The Command /dog

Changelog

Refactored code to be able to handle more commands
Adds the command /dog that will post pictures of dogs to an issue/pr
increased testing

/cat

Codecov Report

:exclamation: No coverage uploaded for pull request base (main@32c1285). Click here to learn what that means.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main      #14   +/-   ##
=======================================
  Coverage        ?   32.95%
=======================================
  Files           ?       10
  Lines           ?      261
  Branches        ?        0
=======================================
  Hits            ?       86
  Misses          ?      164
  Partials        ?       11

Flag
Coverage Δ

#unittests
32.95% <0.00%> (?)

Flags with carried forward coverage won't be shown. Click here to find out more.

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 32c1285...7288a52. Read the comment docs.


Default to user $HOME when opening a workspace

I think starting in $HOME would be a simple improvement vs starting in /.
Ultimately I'd like to be able to start in any folder I like by typing it in. Even better if there's a form of autocomplete/list of suggestions. (To be clear, this is not about recent folders.)

@kylecarbs I've updated the extension but it doesn't seem to give me an option to pick a folder, it immediately lands in /. I looked at the commit and it seems like it should. Any idea why it doesn't?


Natural log support

It would be nice to be able to perform natural log operations with this calculator, like ln(x) which returns the natural log of x.

I will take point in this feature.


Avoid some data clone in state.get_state_object()

There are some unnecessary data clone in cita-vm, such as clone hole data from cache for only getting balance or nonce.

fixed


Debian install error on postgresql-9.6-tsearch-extras

Installation of 1.9.0rc2 fails on stretch because of:
Error: Execution of '/usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold install postgresql-9.6-tsearch-extras' returned 100: Reading package lists...
Building dependency tree...
Reading state information...
The following NEW packages will be installed:
  postgresql-9.6-tsearch-extras
0 upgraded, 1 newly installed, 0 to remove and 0 not upgraded.
Need to get 5100 B of archives.
After this operation, 28.7 kB of additional disk space will be used.
WARNING: The following packages cannot be authenticated!
  postgresql-9.6-tsearch-extras
E: There were unauthenticated packages and -y was used without --allow-unauthenticated
Error: /Stage[main]/Zulip::Postgres_appdb_base/Zulip::Safepackage[postgresql-9.6-tsearch-extras]/Package[postgresql-9.6-tsearch-extras]/ensure: change from purged to present failed: Execution of '/usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold install postgresql-9.6-tsearch-extras' returned 100: Reading package lists...
Building dependency tree...
Reading state information...
The following NEW packages will be installed:
  postgresql-9.6-tsearch-extras
0 upgraded, 1 newly installed, 0 to remove and 0 not upgraded.
Need to get 5100 B of archives.
After this operation, 28.7 kB of additional disk space will be used.
WARNING: The following packages cannot be authenticated!
  postgresql-9.6-tsearch-extras
E: There were unauthenticated packages and -y was used without --allow-unauthenticated

Looks like either --allow-unauthenticated shall be used or, better, install the apt keys missing.

@telenieko I believe we have code that should install the relevant apt keys in scripts/lib/setup-apt-repo;
Can you post the output of apt-key list on your system?

Hi,
Here it comes. This is on a clean lxc container.
# lxc-create -n zulip -t debian -- -r stretch && lxc-start -n zulip && lxc-attach -n zulip
$ apt-get install -y wget sudo
$ cd $(mktemp -d) && \
   wget https://github.com/zulip/zulip/releases/download/1.9.0-rc2/zulip-server-1.9.0-rc2.tar.gz && \
   tar -xf zulip-server-1.9.0-rc2.tar.gz
$ ./zulip-server-*/scripts/setup/install --self-signed-cert     --email=an_email --hostname=a_hostname

After last command we get to the error from the issue summary, then apt-key list:
# apt-key list
/etc/apt/trusted.gpg.d/debian-archive-jessie-automatic.gpg
----------------------------------------------------------
pub   rsa4096 2014-11-21 [SC] [expires: 2022-11-19]
      126C 0D24 BD8A 2942 CC7D  F8AC 7638 D044 2B90 D010
uid           [ unknown] Debian Archive Automatic Signing Key (8/jessie<EMAIL_ADDRESS>
/etc/apt/trusted.gpg.d/debian-archive-jessie-security-automatic.gpg
-------------------------------------------------------------------
pub   rsa4096 2014-11-21 [SC] [expires: 2022-11-19]
      D211 6914 1CEC D440 F2EB  8DDA 9D6D 8F6B C857 C906
uid           [ unknown] Debian Security Archive Automatic Signing Key (8/jessie<EMAIL_ADDRESS>
/etc/apt/trusted.gpg.d/debian-archive-jessie-stable.gpg
-------------------------------------------------------
pub   rsa4096 2013-08-17 [SC] [expires: 2021-08-15]
      75DD C3C4 A499 F1A1 8CB5  F3C8 CBF8 D6FD 518E 17E1
uid           [ unknown] Jessie Stable Release Key<EMAIL_ADDRESS>
/etc/apt/trusted.gpg.d/debian-archive-stretch-automatic.gpg
-----------------------------------------------------------
pub   rsa4096 2017-05-22 [SC] [expires: 2025-05-20]
      E1CF 20DD FFE4 B89E 8026  58F1 E0B1 1894 F66A EC98
uid           [ unknown] Debian Archive Automatic Signing Key (9/stretch<EMAIL_ADDRESS>sub   rsa4096 2017-05-22 [S] [expires: 2025-05-20]

/etc/apt/trusted.gpg.d/debian-archive-stretch-security-automatic.gpg
--------------------------------------------------------------------
pub   rsa4096 2017-05-22 [SC] [expires: 2025-05-20]
      6ED6 F5CB 5FA6 FB2F 460A  E88E EDA0 D238 8AE2 2BA9
uid           [ unknown] Debian Security Archive Automatic Signing Key (9/stretch<EMAIL_ADDRESS>sub   rsa4096 2017-05-22 [S] [expires: 2025-05-20]

/etc/apt/trusted.gpg.d/debian-archive-stretch-stable.gpg
--------------------------------------------------------
pub   rsa4096 2017-05-20 [SC] [expires: 2025-05-18]
      067E 3C45 6BAE 240A CEE8  8F6F EF0F 382A 1A7B 6500
uid           [ unknown] Debian Stable Release Key (9/stretch<EMAIL_ADDRESS>
/etc/apt/trusted.gpg.d/debian-archive-wheezy-automatic.gpg
----------------------------------------------------------
pub   rsa4096 2012-04-27 [SC] [expires: 2020-04-25]
      A1BD 8E9D 78F7 FE5C 3E65  D8AF 8B48 AD62 4692 5553
uid           [ unknown] Debian Archive Automatic Signing Key (7.0/wheezy<EMAIL_ADDRESS>
/etc/apt/trusted.gpg.d/debian-archive-wheezy-stable.gpg
-------------------------------------------------------
pub   rsa4096 2012-05-08 [SC] [expires: 2019-05-07]
      ED6D 6527 1AAC F0FF 15D1  2303 6FB2 A1C2 65FF B764
uid           [ unknown] Wheezy Stable Release Key<EMAIL_ADDRESS>

I just did:
# curl -L https://packagecloud.io/zulip/server/gpgkey | sudo apt-key add -

But apt still complains about verification!
# apt-get install postgresql-9.6-tsearch-extras
Reading package lists... Done
Building dependency tree
Reading state information... Done
The following NEW packages will be installed:
  postgresql-9.6-tsearch-extras
0 upgraded, 1 newly installed, 0 to remove and 0 not upgraded.
Need to get 5,100 B of archives.
After this operation, 28.7 kB of additional disk space will be used.
WARNING: The following packages cannot be authenticated!
  postgresql-9.6-tsearch-extras
Install these packages without verification? [y/N]

Sorry to awaken an old issue but it doesn't appear that it has been resolved.  I am getting the same error as @telenieko trying to install zulip-server-1.9.0.  I'm just following the install guide from zulipchat.com
 ./zulip-server-*/scripts/setup/install<EMAIL_ADDRESS>--hostname=zulip.example.com --self-signed-cert

Results in:
Notice: /Stage[main]/Zulip::Postgres_common/Exec[disable_logrotate]/returns: executed successfully
Error: Execution of '/usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold install postgresql-9.6-tsearch-extras' returned 100: Reading package lists...
Building dependency tree...
Reading state information...
E: Unable to locate package postgresql-9.6-tsearch-extras
E: Couldn't find any package by glob 'postgresql-9.6-tsearch-extras'
E: Couldn't find any package by regex 'postgresql-9.6-tsearch-extras'
Error: /Stage[main]/Zulip::Postgres_appdb_base/Zulip::Safepackage[postgresql-9.6-tsearch-extras]/Package[postgresql-9.6-tsearch-extras]/ensure: change from purged to present failed: Execution of '/usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold install postgresql-9.6-tsearch-extras' returned 100: Reading package lists...
Building dependency tree...
Reading state information...
E: Unable to locate package postgresql-9.6-tsearch-extras
E: Couldn't find any package by glob 'postgresql-9.6-tsearch-extras'
E: Couldn't find any package by regex 'postgresql-9.6-tsearch-extras'
Notice: /Stage[main]/Zulip::Apt_repository/Apt::Source[zulip]/File[zulip.list]/content: content changed '{md5}3406d76cfb085ca402fde9d5c306e1a5' to '{md5}82c72b5035e13370e9939b99e3b7021f'
Notice: /Stage[main]/Apt::Update/Exec[apt_update]: Triggered 'refresh' from 1 events
Notice: Applied catalog in 14.47 seconds

apt-key list produces the following:
/etc/apt/trusted.gpg
--------------------
pub   rsa4096 2014-06-27 [SC]
      48FE 1327 A9B6 4D39 8DF8  BA40 96C5 8306 39B8 AE9C
uid           [ unknown] Tobias Schaaf (meveric<EMAIL_ADDRESS>sub   rsa4096 2014-06-27 [E]

pub   rsa2048 2014-08-04 [SC]
      3FA7 E032 8081 BFF6 A14D  A29A A6A1 9B38 D3D8 31EF
uid           [ unknown] Xamarin Public Jenkins (auto-signing<EMAIL_ADDRESS>sub   rsa2048 2014-08-04 [E]

pub   rsa2048 2013-08-27 [SC]
      A236 C58F 4090 91A1 8ACA  53CB EBFF 6B99 D9B7 8493
uid           [ unknown] NzbDrone<EMAIL_ADDRESS>sub   rsa2048 2013-08-27 [E]

pub   rsa4096 2017-02-22 [SCEA]
      9DC8 5822 9FC7 DD38 854A  E2D8 8D81 803C 0EBF CD88
uid           [ unknown] Docker Release (CE deb<EMAIL_ADDRESS>sub   rsa4096 2017-02-22 [S]

pub   rsa4096 2018-05-02 [SCEA]
      E084 7BF7 6A5F 64D8 2ED0  A038 B975 52F3 1FBF F74F
uid           [ unknown] https://packagecloud.io/zulip/server (https://packagecloud.io/docs#gpg_signing<EMAIL_ADDRESS>sub   rsa4096 2018-05-02 [SEA]

pub   dsa1024 2012-04-28 [SC]
      C97E 4649 A205 1D0C EA1A  73F9 72A7 496B 4549 9429
uid           [ unknown] groonga Key (groonga Official Signing Key<EMAIL_ADDRESS>
pub   rsa4096 2018-01-29 [SC]
      2701 F317 CFCC CB97 5CAD  E9C2 624C F774 3483 9225
uid           [ unknown] Groonga Key (Groonga Official Signing Key<EMAIL_ADDRESS>sub   rsa4096 2018-01-29 [E]

/etc/apt/trusted.gpg.d/debian-archive-jessie-automatic.gpg
----------------------------------------------------------
pub   rsa4096 2014-11-21 [SC] [expires: 2022-11-19]
      126C 0D24 BD8A 2942 CC7D  F8AC 7638 D044 2B90 D010
uid           [ unknown] Debian Archive Automatic Signing Key (8/jessie<EMAIL_ADDRESS>
/etc/apt/trusted.gpg.d/debian-archive-jessie-security-automatic.gpg
-------------------------------------------------------------------
pub   rsa4096 2014-11-21 [SC] [expires: 2022-11-19]
      D211 6914 1CEC D440 F2EB  8DDA 9D6D 8F6B C857 C906
uid           [ unknown] Debian Security Archive Automatic Signing Key (8/jessie<EMAIL_ADDRESS>
/etc/apt/trusted.gpg.d/debian-archive-jessie-stable.gpg
-------------------------------------------------------
pub   rsa4096 2013-08-17 [SC] [expires: 2021-08-15]
      75DD C3C4 A499 F1A1 8CB5  F3C8 CBF8 D6FD 518E 17E1
uid           [ unknown] Jessie Stable Release Key<EMAIL_ADDRESS>
/etc/apt/trusted.gpg.d/debian-archive-stretch-automatic.gpg
-----------------------------------------------------------
pub   rsa4096 2017-05-22 [SC] [expires: 2025-05-20]
      E1CF 20DD FFE4 B89E 8026  58F1 E0B1 1894 F66A EC98
uid           [ unknown] Debian Archive Automatic Signing Key (9/stretch<EMAIL_ADDRESS>sub   rsa4096 2017-05-22 [S] [expires: 2025-05-20]

/etc/apt/trusted.gpg.d/debian-archive-stretch-security-automatic.gpg
--------------------------------------------------------------------
pub   rsa4096 2017-05-22 [SC] [expires: 2025-05-20]
      6ED6 F5CB 5FA6 FB2F 460A  E88E EDA0 D238 8AE2 2BA9
uid           [ unknown] Debian Security Archive Automatic Signing Key (9/stretch<EMAIL_ADDRESS>sub   rsa4096 2017-05-22 [S] [expires: 2025-05-20]

/etc/apt/trusted.gpg.d/debian-archive-stretch-stable.gpg
--------------------------------------------------------
pub   rsa4096 2017-05-20 [SC] [expires: 2025-05-18]
      067E 3C45 6BAE 240A CEE8  8F6F EF0F 382A 1A7B 6500
uid           [ unknown] Debian Stable Release Key (9/stretch<EMAIL_ADDRESS>
/etc/apt/trusted.gpg.d/debian-archive-wheezy-automatic.gpg
----------------------------------------------------------
pub   rsa4096 2012-04-27 [SC] [expires: 2020-04-25]
      A1BD 8E9D 78F7 FE5C 3E65  D8AF 8B48 AD62 4692 5553
uid           [ unknown] Debian Archive Automatic Signing Key (7.0/wheezy<EMAIL_ADDRESS>
/etc/apt/trusted.gpg.d/debian-archive-wheezy-stable.gpg
-------------------------------------------------------
pub   rsa4096 2012-05-08 [SC] [expires: 2019-05-07]
      ED6D 6527 1AAC F0FF 15D1  2303 6FB2 A1C2 65FF B764
uid           [ unknown] Wheezy Stable Release Key<EMAIL_ADDRESS>
Any thoughts on how I can resolve this?

@telenieko what's uname -a?  I think it's possible we only have tsearch_extras packages for x86_64 for stretch in that repository...

While exploring a different issue I discovered that the base Ubuntu install in 18.04 doesn't have a complete /etc/apt/sources.list. (This also seems to apply to the base docker image as well).  Once I added the following everything started working:
deb http://archive.ubuntu.com/ubuntu/ bionic main restricted
deb http://archive.ubuntu.com/ubuntu/ bionic-updates main restricted
deb http://archive.ubuntu.com/ubuntu/ bionic universe
deb http://archive.ubuntu.com/ubuntu/ bionic-updates universe
deb http://archive.ubuntu.com/ubuntu/ bionic multiverse
deb http://archive.ubuntu.com/ubuntu/ bionic-updates multiverse
deb http://archive.ubuntu.com/ubuntu/ bionic-backports main restricted universe multiverse
deb http://security.ubuntu.com/ubuntu bionic-security main restricted
deb http://security.ubuntu.com/ubuntu bionic-security universe
deb http://security.ubuntu.com/ubuntu bionic-security multiverse

@hellfirehd yeah, I think that's https://github.com/zulip/zulip/issues/10417.

@telenieko I believe we have code that should install the relevant apt keys in scripts/lib/setup-apt-repo;
Can you post the output of apt-key list on your system?

Hi, sorry; having some crazy weeks at work !
I do not have that system around anymore, but it is an lxc container so should be easy to reproduce by anyone with a Linux system -- see my second comment on this issue :)

Well, my main question was just whether it was an i386 container -- if so, I know what the bug is :)

@telenieko OK, I've tested your procedure, and it does reproduce the error you saw.  Will do some debugging.

After that error, doing this seems to install the package fine:
root@zulip:/tmp/tmp.3vOtJozR3n# apt update
Hit:2 http://security.debian.org stretch/updates InRelease
Ign:1 http://cdn-fastly.deb.debian.org/debian stretch InRelease
Hit:4 http://cdn-fastly.deb.debian.org/debian stretch Release
Hit:3 https://packagecloud.io/zulip/server/debian stretch InRelease
Reading package lists... Done
Building dependency tree
Reading state information... Done
All packages are up to date.
root@zulip:/tmp/tmp.3vOtJozR3n# apt install postgresql-9.6-tsearch-extras
Reading package lists... Done
Building dependency tree
Reading state information... Done
The following NEW packages will be installed:
  postgresql-9.6-tsearch-extras
0 upgraded, 1 newly installed, 0 to remove and 0 not upgraded.
Need to get 5,100 B of archives.
After this operation, 28.7 kB of additional disk space will be used.
Get:1 https://packagecloud.io/zulip/server/debian stretch/main amd64 postgresql-9.6-tsearch-extras amd64 0.4 [5,100 B]
Fetched 5,100 B in 0s (8,586 B/s)
debconf: delaying package configuration, since apt-utils is not installed
Selecting previously unselected package postgresql-9.6-tsearch-extras.
(Reading database ... 37265 files and directories currently installed.)
Preparing to unpack .../postgresql-9.6-tsearch-extras_0.4_amd64.deb ...
Unpacking postgresql-9.6-tsearch-extras (0.4) ...
Setting up postgresql-9.6-tsearch-extras (0.4) ...
Processing triggers for postgresql-common (181+deb9u2) ...
Building PostgreSQL dictionaries from installed myspell/hunspell packages...
  en_us
Removing obsolete dictionary files:

OK, I tracked down the root cause and fixed it in master; it was a somewhat subtle issue involving gnupg not being installed and our script to setup that apt repository not exiting after encountering the error (which meant you didn't get a clear error message early in the installer).  Thanks for the helpful report @telenieko!

Also sidenote for @synicalsyntax : We have a separate label area for "production installer", and this should have been put into that category :)


Check that the config directory '/tmp/ipykernel_3759' exists and readable

1.My current working directory details are as follows:
!pwd
!ls
/content/drive/MyDrive/Flow_over_a_parameterized_block
config.yaml  flow_block.ipynb  outputs
2.But I keep running into looking under this directory: ‘/tmp/ipykernel_3759’
3.The details of the error report are as follows:
MissingConfigException                    Traceback (most recent call last)
/tmp/ipykernel_3759/211706737.py in <cell line: 12>()
10 normal_dot_vel = NormalDotVec(["u", "v"])
11
---> 12 cfg = compose(config_path=".", config_name="config")
13 cfg.network_dir = './outputs'
14 cfg.device = 'cuda' if torch.cuda.is_available() else 'cpu'
/usr/local/lib/python3.10/dist-packages/modulus/sym/hydra/utils.py in compose(config_name, config_path, overrides, return_hydra_config, job_name, caller_stack_depth)
167     register_graph_configs()
168
--> 169     cfg = hydra.compose(
170         config_name=config_name,
171         overrides=overrides,
/usr/local/lib/python3.10/dist-packages/hydra/compose.py in compose(config_name, overrides, return_hydra_config, strict)
36     gh = GlobalHydra.instance()
37     assert gh.hydra is not None
---> 38     cfg = gh.hydra.compose_config(
39         config_name=config_name,
40         overrides=overrides,
/usr/local/lib/python3.10/dist-packages/hydra/_internal/hydra.py in compose_config(self, config_name, overrides, run_mode, with_log_configuration, from_shell, validate_sweep_overrides)
592         """
...
103             missing_cfg_file=config_name, message=add_search_path()
104         )
MissingConfigException: Primary config directory not found.
Check that the config directory '/tmp/ipykernel_3759' exists and readable
Output is truncated. View as a scrollable element or open in a text editor. Adjust cell output settings...

Could you try changing this line in your notebook from
cfg = compose(config_path=".", config_name="config") to
cfg = compose(config_path="/content/drive/MyDrive/Flow_over_a_parameterized_block", config_name="config") ?
You might also want to check if your current working directory is in your Python path, which isn't always the case.
import sys

for path in sys.path:
    print(path)

If it is not, try adding it to your Python path can solve many issues:
import sys
sys.path.append('/content/drive/MyDrive/Flow_over_a_parameterized_block')


“Safari Cannot open the page because server cannot be found” error appears on clicking the invite link sent to user.

Frequency: 100%
Repro on build version: Appstore build 1.15.2, Testflight build 1.14.3 , Playstore build 1.14.3
Repro on devices: iPhone SE 1st Generation, iPhone 6+(12.4.5), Redmi note 8 (10.0), Vivo v11 pro (10)
Pre-condition:
User must have received invitation mail containing an invite link.
Repro Steps:

Open invite email.
Tap on invite link.
Tap on safari browser option & observe the bug

Current Behavior: “Safari Cannot open the page because server cannot be found” error appears on clicking the invite link.
Expected Behavior:  On clicking the invite link, the link must open Valora app in Appstore.
Impact: Bad User experience, as error appears on clicking the invite link.
Investigation: For Android “Web page not available” error appears on clicking the invite link.
Note: When we have performed invite test cases on previous builds ( Testflight & Android Internal builds 1.15.2,1.14.3), this issue was not reproducible.
Attachment: Invite Link Issue.mp4

https://valora.testquality.com defect D43.

https://valora.testquality.com defect D44.

Hi , I have verified this issue using latest Appstore build V1.15.2 & Android Playstore Build V1.15.2 and found the issue is fixed.

“Safari Cannot open the page because server cannot be found” error appears on clicking the invite link sent to user
Verified on Devices: iPhone SE 1st Generation(14.6), Redmi Note 8 (10.0)
Attachment: Invite issue resolved.mp4


ERROR TypeError: Cannot read property 'setOnTouchListener' of null

Line 28: this._toast.getView().setOnTouchListener(new android.view.View.OnTouchListener({
Happens on android version==11
Robert

Released a 4.1.0 should fix u up for 11+

Released a 4.1.0 should fix u up for 11+

perfect - didn't see the update 👍

perfect - didn't see the update 👍

Mmm I've also got this issue -> Cannot read property 'setOnTouchListener' of null ...recently.
I'm still using NS6... Is there a way to fix it without got to NS7...Thanks

Ah sh**** Android API level 30 causes the issue... https://www.py4u.net/discuss/626157
I've commented 'setOnTouchListener' method from toasty.android.js....and it's work again but as regular uncustomized toast...pfff thanks Android...normally it's IOS that is making me crazy...WHyyyyyyyyy you ? ;)


Use a noop reducer

I see the reducer is handling TOGGLE_VISIBILITY, but it is not dispatched from anywhere. Is it an orphaned code that should be removed?

Legacy code yes, redux-devtools wasn't implementing visibility state as far as I remember.

Of course, if we'll use a noop function and those files won't be imported, it wouldn't affect the bundle size as well. I am working on adding support for monitors reducers into Redux DevTools Extension, and was wondering about extra operations.


Hardened source batch unit test

Added unit test case to verify the expected behaviour when 'TestBatchStrategy' is set to 'Source'; and the result was passed.
Closes #89

:+1:
@netspiri does this mean #89 is not reproducible?

#89 wasn't reproducible.  The newly added unit test cases supported the expected behaviour.  Thanks.


Add admin-ui register_admin_ui errand to pipeline

In order to have the admin-ui deployment fully automated, as SREs we need to add the register_admin_ui errand to the concourse pipeline in cg-deploy-admin-ui.

Thanks to @LinuxBozo for pointing out errand examples:
"See the cg-pipelines task to enable running errands.. see cg-deploy-logsearch pipeline for example usage.. the push-kibana job"
"also, same thing is in cg-deploy-cf for running the smoke/acceptance tests"

And great input from @sharms:
https://github.com/18F/cg-deploy-logsearch/blob/master/pipeline.yml#L63-L71
you can literally just take that, and rename it

https://github.com/18F/cg-deploy-admin-ui/pull/14


Virtual DOM and place-my-order functionality

This branch contains the virtual DOM implementation and other functionality for place-my-order.

I updated can-simple-dom so that we don't have to do simpleDOM["default"] any more.  All steal tests are passing, most of the dist tests are passing, nothing is failing that was passing before.  I'm not comfortable pushing to a branch that's not passing so if I broke something it's not because i didn't test.

Green!

Finally! That was a beast ;)


Wrong type for KeyboardButtonRequestUsers.max_quantity

https://github.com/grammyjs/types/blob/e266fb129062d48fd82a16a374ad7f6ec080a868/markup.ts#L234C26-L234C26
export interface KeyboardButtonRequestUsers {
  ...
  max_quantity?: boolean; // <-- should be number
}

Damn it, thanks for pointing it out. I'll release a fix in a few hours.


fix: fix compile error in example caused by merge conflict

https://github.com/lancedb/lancedb/commit/0c7809c7a080b38fd71e8d36df4a3803d34d5f08 and https://github.com/lancedb/lancedb/commit/2de226220b78c51b22319fb4fbc4678f4d269d65 ended up conflicting with each other


MIME type to format

@mcarans @davidmegginson in case we agree this is the way to go, this should take care of changing MIME type to format.

@mcarans agreed I prefer it too, I've changed it to lowercase.


Add unquote-properties transform

a few quick notes while I had a moment. I noticed travis fails, but it looks to be unrelated to this change.

Nice work! Please fix the two minor issues that came up :)

thanks for your contribution!


SOCKs and NAT-traversal

Any plans to support SOCKS and NAT-traversal in future release?

@aaronsace Implement NAT traversal on your own. It's not that hard I believe.

making it close to useless...
No, it still can be used in a torrent client and it works very well. Your computer does not have to be reachable.

@freshstudio I've been at it for a few weeks and got MonoTorrent working very well now on my machine but I'm having problems without port forwarding. The users won't have a clue about how to forward ports so I'm hoping to get this final problem fixed.
The DHT works and the torrent manager gets peers, but the peers slowly disappear without any connections being opened. Soon as I forward the ports, all the connections come flooding in and it starts downloading.
So confusing, it just doesn't seem to work for me unless I forward the ports. I'm simply passing a magnet link without any trackers; does it work for you if you just pass a hash?
I'll see if I can find any code for 'NAT traversal' after work; hopefully, if I get it working, I'll do another pull request.

https://github.com/mono/monotorrent/pull/79

If the port the engine is listening on is not publicly reachable, you can create outgoing connections but cannot accept incoming connections.
I'd recommend using https://github.com/mono/Mono.Nat if you want to have automatic port forwarding for upnp or nat-pmp devices.