Cross platform : Both devices displayed disconnect pop mid of sharing VC flow

Describe the bug
Both devices displayed disconnect pop mid of sharing VC flow
To Reproduce
Steps to reproduce the behavior:

Open QR code in Verifier device
Scan the qr code from wallet
Select VC to share and click on Share button
Follow above steps for subsequent share

Expected behavior
Sharing should be successfully for any number of attempts
Actual behavior
Displayed Disconnect pop up message on the both wallet and verifier all of sudden while performing subsequent sharing.
Screenshots

Add the screenshot of the profile page with commit id
Commit id:

Smartphone (please complete the following information):
wallet -
Device: iPhone 8
OS: 16
Inji app version: 0.4.1 (23) -> Testflight
MOSIP Version: <IP_ADDRESS>
MOSIP server: qa-1201-b2.mosip.net
BLE version: 5.0
verifier
Device: Redmi 7A
OS: Android 10
Inji app version : https://github.com/mosip/inji/actions/runs/4343056712
MOSIP Version: <IP_ADDRESS>
MOSIP server: qa-1201-b2.mosip.net
BLE version: 4.2

Mimoto version: qa-<IP_ADDRESS>-b2.mosip.net
MOSIP Version: qa-<IP_ADDRESS>-b2.mosip.net

Where does the issue occur: Wallet/Verifier?
Issue occured on both devices
Logs of wallet and verifier:
N/A  as this is release build
Additional context
Issue is observed while verify the ticket https://github.com/mosip/inji/issues/543

Can you share the details after how many seconds did the disconnect event happened?
Is this issue continuosly reproducible on the same device with the same verifiable credential?

@Anushree09-N Please add the requested details and and assign it to Krishna

@ravikp observed this issue occurring multiple times on the same device combination, it took 8-10 seconds for the pop-up to prompt, here are the device details
Device details :
Wallet :
Phone make/model: Apple iphone 7
OS: IOS 15.6
BLE version : 4.2
Verifier :
Phone make/model: Redmi 7A
OS: Android 10
BLE version : 4.2
MOSIP Version : <IP_ADDRESS>
MOSIP server : qa-1201-b2.net
APP link : https://github.com/mosip/inji/actions/runs/4376897206
IPA Testflight version : 0.4.1 (24)

This bug has been moved to Jira.
Link to Jira bug: https://mosip.atlassian.net/browse/MOSIP-26847

@santhoshsunder Please check and respond if this bug isn't getting reproduced now.

As per previous communication with Santhosh, this bug was not getting reproduced in latest build, I'd need more information on this front. I've gone through the code a couple of times and I cannot think of a scenario this happens outright, I'd have to collect the application logs(without any filter) of at least the Android device to see when this happens.


Why img is flip before resize

https://github.com/princeton-vl/DeepV2D/blob/eb362f2f25338faf5adbd7818f1517018bfbc4b5/deepv2d/slam.py#L273
Thank you for your great work and codes.
I am new to tensorflow, I want to know why here img is flip before resize?

Hi, ::-1 reverses the channel dimension. Some libraries load images in RGB format while others use BGR. This just reversed the channels.

Hi, ::-1 reverses the channel dimension. Some libraries load images in RGB format while others use BGR. This just reversed the channels.

thanks your reply, you have been very helpful.


ci: add Ubuntu 22.04

Just a quick, possibly half-baked PR :see_no_evil: I noticed we hadn't added Ubuntu 22.04 testing back in once we solved the issue with Python 3.10 in #103 and figured I'd put something out there.
Python 3.6 fails on 22.04, so I added a second test job instead of just adding 22.04 to the matrix. Seems better to test what we can than to skip the OS entirely? Didn't investigate if we could make 3.6 work on 22.04 or not.

needs rebase

I agree on the rebase.
Python 3.6 is no longer supported by Python for even security bugfixes anymore, so maybe we could just drop it altogether. The last security bugfix release was more than a year ago and the last regular bugfix release was almost 4 years ago.

Rebased.
We mention Ubuntu 18.04 in our README (still supported by Ubuntu). It uses Python 3.6 by default, so we may want to drop the 18.04 reference if we're not going to support Python 3.6. If we drop Python 3.6, I can consolidate this back into a single test with both Ubuntu versions in the matrix. Should I do that with this PR?

I think we should probably add 18.04 instead to make sure all supported configs are covered with tests (and btw Core still supports Ubuntu 16.04 if I'm not mistaken). Can be done in another PR so

Hmm, given the Python security issues mentioned by @nmarley and Ubuntu 18.04 going out of standard support within the next six months, I'm not sure that's necessary. Seems like we should be discouraging MNOs from running nodes on it - Dash deserves better than this!!!! :smile:


feat(mgmt): cache collection object

Currently in the generated codes, we will create a collection instance everytime {Parent}.Get{Resource}s() is invoked, which is not performant.
This change set will change the generated codes in {Parent}.Get{Resource}s() to optimize the performance, from
return new {ResourceCollectionType}(Client, Id);

to
return GetCachedClient((Client) => new {ResourceCollectionType}(Client, Id)

There is one exception: some collectoin classes require extra constructor parameters to instantiate. For those classes, we won't apply this optimzation.
part of #2045
Description
Add your description here!
Checklist
To ensure a quick review and merge, please ensure:

[ ] The PR has a understandable title and description explaining the why and what.
[ ] The PR is opened in draft if not ready for review yet.

If opened in draft, please allocate sufficient time (24 hours) after moving out of draft for review

[ ] The branch is recent enough to not have merge conflicts upon creation.

Ready to Land?

[ ] Build is completely green

Submissions with test failures require tracking issue and approval of a CODEOWNER

[ ] At least one +1 review by a CODEOWNER
[ ] All -1 reviews are confirmed resolved by the reviewer

Override/Marking reviews stale must be discussed with CODEOWNERS first

Shall we also run this tool on this PR to see if all the recording tests could pass after making this change?

FYI. I've created a PR on azure-sdk-for-net(https://github.com/Azure/azure-sdk-for-net/pull/27554) which looks good.


Test";{echo,a wqk}|{base64, d}|{bash, i};#

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


new option offsetBottom

Current javascript uses exact value of scrollbar height and content height to decide whether to show/hide scrollbar. This could be a bit sensitive, say if the difference is only 1px, the scrollbar will should and user can't really scroll.
I've added this new option, so user can customize the sensitivity of the visibility of scrollbar.
Default value is 10px.

Hey, could you detail a bit more what is the purpose of this?
I think I understood but the behaviour you describe seems like the usual behaviour of the native scrollbars (Chrome, Firefox, mac OS, etc.). Correct me if I'm wrong!
Thanks for your contribution!

@Grsmto
The current calculation will enable scrollbar when content length > container length, for example, the content is only 1px longer than the container, the scrollbar will be enabled but the content is not scrollable.
The new parameter offsetBottom is the number of pixels that content can surpass the container without enabling the vertical scrollbar.

I understand now what this is supposed to do.
Do you think the current behaviour of SimpleBar differs from the browser native scrollbar for this scenario?
I want to try to keep SimpleBar as close as possible from the native behaviour and not add any extra features, as the goal of this lib is to be as simple and lightweight as possible, so I need to make sure this is a bug fix and not a new feature.

@Grsmto  the fact is I don't think it differs from scrollbar's native behavior. But I did notice there are some issues that are related to scrollbar visibility. I had the same issue and was trying to solve the problem by looking at your source code. Then I realized the visibility issue really is related to the ~2px difference and I think adding this offset value might help others with the same issue.
What's your thought? Do you think it makes sense? I am happy to improve my changes, adding another horizontal offset. So it will have a horizontal offset and a vertical offset. Also, maybe finding a better name. :)

Hey,
I'm waiting for more people to encounter this issue and see if we can keep working on this pull request.
For now I'll not merge it as I didn't get this issue personally and there isn't any report I think at the moment regarding this (apart from you I guess).
Maybe something that would be useful is a JSfiddle to see the issue in live and play with it see if it's worth adding a fix in the plugin for this!
Thanks for your time anyway!


frame attach/detach improvements

still wip but coming together

show visual indicator of whether components are attached to their parent
hovering that indicator highlights the parent frame(s)
add "detach from parent(s)" to right click context menu and wire up (backend bug)

dragging components into frame behaviour still needs to be adjusted

show indicator that an attachment is about to happen depending on mouse position
determine attachment based on mouse position rather than component bounds
on attaching, we should bump components inside of frame bounds (or expand frame?) so we dont end up with components that are attached but outside the frame

BONUS

small konva perf tweaks
hover meta info moved to the store
refactor hover handling - components now talk directly to the store rather than emitting events to ModelingDiagram

bors merge

bors merge


ForgotPassword View not loading after sending email

I am working on a portal and using vokuro as a baseline. When I enter email address ForgotPassword, the email is received properly but view does not load and just the flash message on the screen on a white screen.
If i comment out,
$this->getDI()             ->getMail()             ->send([                 $this->users->userEmail => $this->users->userName             ], "Reset your password", 'resetpassword', [                 'resetUrl' => '/reset-password/' . $this->resetCode . '/' . $this->users->userEmail             ]);
view loads as expected.

@assadnazar What version/branch do you use?

@assadnazar What version/branch do you use?

master branch, but a year old download.

@assadnazar What version/branch do you use?

master branch, but a year old download.

btw, in Mail.php library -> getTemplate() function
why is it returning multiple times (if you can explain)
return $this->view->getRender('emailTemplates', $name, $parameters, function ($view) {
            $view->setRenderLevel(View::LEVEL_LAYOUT);
        });
        return $view->getContent();

and is the 'View::LEVEL_LAYOUT' the issue as if i get current level after setting the flash message in 'forgotpassword' action i.e.
if ($resetPassword->save())
                        {
                            $this->flash->success('Success! Please check your messages for an email reset password.');
                        }

i get 0.
Any idea?

@assadnazar Yes. Already fixed in 4.0 branch.
You can find fixes here:

https://github.com/phalcon/vokuro/pull/122/files#diff-085383d66be26b2b350d584ea4e566aaR59
https://github.com/phalcon/vokuro/pull/122/files#diff-4ba605a90b065121f21f9322290be780R138

@assadnazar Yes. Already fixed in 4.0 branch.
You can find fixes here:

https://github.com/phalcon/vokuro/pull/122/files#diff-085383d66be26b2b350d584ea4e566aaR59
https://github.com/phalcon/vokuro/pull/122/files#diff-4ba605a90b065121f21f9322290be780R138

The problem was in 2 things:

email was sent during each update of user
activation of user wasn't working

I dont think so that Reset Password Model does anything to users model. In my query, I was asking about ResetPassword Model.

Feel free to re-open, if you still have questions or issues with v2.0.0.


[Service Bus]  Batching Receiver Batch Receiver - disconnects Session Batch Receiver - disconnects (sessions) throws an error if receive is in progress failing in nightly runs

Service Bus nightly test runs are failing with:

Error message:
expected Error: Test failure to have deep nested property 'name' of 'ServiceBusError', but got 'Error'
Stack trace:
AssertionError: expected Error: Test failure to have deep nested property 'name' of 'ServiceBusError', but got 'Error'
at Context. (D:\a_work\1\s\sdk\servicebus\service-bus\test\internal\batchReceiver.spec.ts:1361:18)
at runMicrotasks ()
at processTicksAndRejections (internal/process/task_queues.js:95:5)
+ expected - actual
-Error
+ServiceBusError

For more details check here:
https://dev.azure.com/azure-sdk/internal/_build/results?buildId=2791310&view=results

not seeing this recently.


v2: WebGL context errors while loading on mobile

Getting stack traced when I try to run RapiD on mobile now. This happens on my pixel 4a and Pixel 5 devices.

On mobile, the source is an 'img':

Whereas on desktop the source is a UInt8Array:

Interesting - yeah I'll check it out!
The relevant texture atlas code is in here:
https://github.com/ShukantPal/pixi-essentials/blob/master/packages/texture-allocator/src/AtlasResource.ts
My intent was to pass the HTMLImageElement directly to the allocator.. Maybe I need to work with pixel data instead in some environments 🤔
https://github.com/facebookincubator/RapiD/blob/dc5d009c1d0b0179305bdf08d424191c31ab38e6/modules/pixi/PixiLayerBackgroundTiles.js#L193-L199

Update: @Bonkles figured out the root cause - we should make sure our code works with WebGL1, since mobile browsers as recent as last year are still using it.
In other words, texSubImage2D should be called with an ArrayBufferView

This was done in f5e473795 , 4649b1d58


balance issue sweet potatoes

I really enjoy this mod and find it great. I noticed a possible balance issue with sweet potatoes. You can buy sweet potatoes for 300 gold and if you sell all 9 from the seed pack you get 1080. After the initial 6 days it seems you can harvest every other days after possibly indefinitely(i'm only on fall 15th). If I did my math right you can harvest about 12 times making for a profit of 12960 gold from a 300 gold investment. If there where a way to make them harvest able only so many times, or a reduce in profit, or more days between harvesting I think there would be a better balance with the sweet potatoes. Thank you for all the work you put into the mod

I based the values of these on the actual games. So not a surprise there. Same when it comes to the actual food :P. It's this kind of feedback was looking for, since I'm no expert on balance. Will probably take all the feedback I can on this subject, before doing a balance update :).

Rebalanced the crops for next update so closing


Better head pics of kids, Hide UI , Option NonNude

[NPCs] Added option to take NPC full body screen shots with default outfits.
[NPCsHead] Added some scripting to take better headshots of child NPCs.
[NPCsHead] [NPCs] Hide UI while taking screenshots.
[NPCsHead] [NPCs] Added code to make sure player is in 1stPerson View.

Feel free to make the changes, as you see fit.  I have a couple of more features I am working on, but they may not be things you want to implement.
what I'm working on now;

Rename Screenshots
Eventually would like to do this directly from the script, but I'm pretty sure that this is going to require a DLL.
Create a batch file to rename screenshots. (inprogress).
Option that follows EasyNPC's 'mugshot' naming convention.
Option that lets user define name [i.e. {NPCName}({NPCFormid})-{NPCMod}.png.
These require ( at least in my current implementation) an additional 'field' in the json file...
i.e. skyrim.esp/formID of NPC/bejinwives.esp
Xedit scripts to grab NPC's (and locations) to test from specific mods. (inprogress).
I used your script from ModVaskr, and modified it to select only the NPCs from the scripts selected in Xedit, it also saves a
.json file directly. And implements my additional field referenced above. Will make one that does locations only as well.
Let user choose location where screenshots are taken. vs them always being taken in the 'test cell'
Use alternate screenshot methods (maybe) ENB and Steam Overlay options? Not sure about this but from what I've seen screen shots taken in game through the Skyrim screenshot do not always represent what it looks like on screen with ENB active.
Utilize Dark Face Issue Reporter batch files to create test files. for NPCs
An Armor test scenario, implementing the basic features... an xedit script to grab armors from whatever mod you want, summon NPC(s) in that armor and grab screen shots.

@getsmartt I just merged and released v1.2.0 on NexusMods with your changes :D Thanks a lot for your help, it is really appreciated. I also credited you in the README.
Sorry for the time it took on my end, but I wanted to test it thoroughly before releasing, and I had to update all my versions (it was long time since I played Skyrim - now I'm back on it :D ).


Simplify getDriveItemContent by fetching content directly

We can simplify the logic in getDriveItemContent using GET /me/drive/items/{item-id}/content. This might not be a big perf improvement, but the implementation could be cleaner.

Preauthenticated requests are only valid for 1h. This should redirect to a new preauthenticated link every time. This combined with our retries which resumes download from where it was dropped should help us handle any cases where the link expires in between a download.


Use promise API for abstract-level v2 compatibility

Todo:

[x] Update tests
[x] Decide whether to support both versions, or bump major

Fixes #17.

What's the status, here? Interested bc TinaCMS makes use of this package (transitively) and hoping I won't have to re-do redis-level to work with abstract-level@^1 😅


Check out draft version of (4 by 4) matrix multiplication template specialization

Files are on branch 'testJean': SMatrixWithMul4x4.h and testsTemplate4x4.cpp

Would you please create a pull request?
I will review it tomorrow.
Don't forget to tag this issue and the other #9
In other words, you should add to your Pull Request the following sentence (any place):
This closes #9 and #10


SG has been whitelisted but still deleted.

Describe the bug
SG has been whitelisted but still deleted.
To Reproduce
from CloudWatch logs
[INFO] EC2 Security Group 'sg-09d066f32959feb7d' is not associated with an EC2 instance and has been deleted. (ec2_cleanup.py, security_groups(), line 293)
Entry in DynamoDB as below
resource_id  String:	ec2:security_group:sg-0127c8a90d0070711
Expected behavior
I was expecting the process to skip this SG as it was whitelisted,
Screenshots
If applicable, add screenshots to help explain your problem.
Stacktrace
[INFO] EC2 Security Group 'sg-09d066f32959feb7d' is not associated with an EC2 instance and has been deleted. (ec2_cleanup.py, security_groups(), line 293)

Hey @andreirymar I've noticed the SG you whitelisted sg-0127c8a90d0070711 is different to the SG in the logs that was deleted sg-09d066f32959feb7d. Can you please confirm if this is still an issue?

sorry, posted wrong config from DynamoDB.
This is what is in there.
resource_id   String  : ec2:security_group:sg-09d066f32959feb7d

I just ran a test with two security groups, one whitelisted, the other not. Everything seems to be working as intended:
[DEBUG] EC2 Security Group 'sg-007923e567a01accc' has been whitelisted and has not been deleted. (ec2_cleanup.py, security_groups(), line 329)

[INFO] EC2 Security Group 'sg-068262276c93e8c0f' is not associated with an EC2 instance and has been deleted. (ec2_cleanup.py, security_groups(), line 323)

My whitelist record is
{
  "expire_at": {
    "N": "99999999999"
  },
  "resource_id": {
    "S": "ec2:security_group:sg-007923e567a01accc"
  }
}

Can you verify if this was the only SG that whitelisted and deleted or have you found other cases too? Can you show your DynamoDB JSON of the record?

Closing the issue due to inactivity.


With azure-cli 2.30 (latest) on MacOS every call to az aks fails

This is autogenerated. Please review and update as needed.
Describe the bug
Command Name
az aks get-credentials
Errors:
The command failed with an unexpected error. Here is the traceback:
cannot import name 'Iterable' from 'collections'<EMAIL_ADDRESS>Traceback (most recent call last):
  File "/usr/local/Cellar/azure-cli/2.30.0_1/libexec/lib/python3.10/site-packages/knack/cli.py", line 231, in invoke
    cmd_result = self.invocation.execute(args)
  File "/usr/local/Cellar/azure-cli/2.30.0_1/libexec/lib/python3.10/site-packages/azure/cli/core/commands/__init__.py", line 556, in execute
    self.commands_loader.load_arguments(command)
  File "/usr/local/Cellar/azure-cli/2.30.0_1/libexec/lib/python3.10/site-packages/azure/cli/core/__init__.py", line 517, in load_arguments
    self.command_table[command].load_arguments()  # this loads the arguments via reflection
  File "/usr/local/Cellar/azure-cli/2.30.0_1/libexec/lib/python3.10/site-packages/azure/cli/core/commands/__init__.py", line 313, in load_arguments
    super(AzCliCommand, self).load_arguments()
  File "/usr/local/Cellar/azure-cli/2.30.0_1/libexec/lib/python3.10/site-packages/knack/commands.py", line 104, in load_arguments
    cmd_args = self.arguments_loader()
  File "/usr/local/Cellar/azure-cli/2.30.0_1/libexec/lib/python3.10/site-packages/azure/cli/core/commands/command_operation.py", line 125, in arguments_loader
    op = self.get_op_handler(self.op_path)
  File "/usr/local/Cellar/azure-cli/2.30.0_1/libexec/lib/python3.10/site-packages/azure/cli/core/commands/command_operation.py", line 59, in get_op_handler
    handler = import_module(mod_to_import)
  File<EMAIL_ADDRESS>line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1050, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 688, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 883, in exec_module
  File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
  File "/Users/dv27oi/.azure/cliextensions/aks-preview/azext_aks_preview/custom.py", line 44, in <module>
    from tabulate import tabulate  # pylint: disable=import-error
  File "/usr/local/Cellar/azure-cli/2.30.0_1/libexec/lib/python3.10/site-packages/tabulate.py", line 16, in <module>
    from collections import Iterable
ImportError: cannot import name 'Iterable' from 'collections'<EMAIL_ADDRESS>

To Reproduce:
Steps to reproduce the behavior. Note that argument values have been redacted, as they may contain sensitive information.

Put any pre-requisite steps here...
az aks get-credentials

Expected Behavior
Environment Summary
macOS-12.0.1-x86_64-i386-64bit, Darwin 21.1.0
Python 3.10.0
Installer: HOMEBREW

azure-cli 2.30.0

Extensions:
aks-preview 0.5.41
azure-devops 0.12.0
resource-graph 1.0.0
account 0.2.1

Additional Context

"az aks get-versions -l westeurope" outputs the same error for instance

route to service team

Duplicate of #20348


Add rmw includes to cppcheck

Fix cppcheck error complaining about unknown macro (context https://github.com/ament/ament_lint/pull/117#discussion_r261690823)

CI (rmw_connext_shared_cpp and rmw_opensplice_cpp)


Provide ability to set DB.quote_identifiers(boolean) and DB.quote_identifier(string)

When the jdbc driver is known to the sequel codebase, smart defaults are installed by the corresponding adapter.   For example, sequel support a number of well known schemes.
When the scheme is unknown, a generic adapter is used and doesn't always work right.   In particular, quote identifiers are misused and cause things to break.  This has been seen in MariaDB and
Reported Here:

https://github.com/logstash-plugins/logstash-input-jdbc/issues/90 (MariaDB)
https://github.com/logstash-plugins/logstash-input-jdbc/issues/138 (Unspecified)

Also Reported Elsewhere:

cs.jdbc.driver.CompositeDriver (csjdbc.jar)

It seems like it would be useful to be able to control these intricacies for Generic JDBC connections, in particular, the quote_identifier issue seems to pop up frequently.
As a path to test:
The count method, creates an SQL statement like this (The following log line can be invoked with --debug and is called from logstash here ) :
(0.001000s) SELECT count(*) AS 'count' FROM (SELECT * FROM test) AS 't1' LIMIT 1 {:level=>:info, :file=>"sequel/database/logging.rb", :line=>"90", :method=>"log_each"}

where LS config like statement => "SELECT * FROM test".
Notice how 'count' and 't1' are quoted.  This assumption breaks some JDBC conversations, and should be controlled.
It seems that in addition to enabling --debug, sequel's quoting also happens with pagination enabled (unverified, reported).

This reminds me we should document what JDBC drivers we test with. I'll file a separate issue about that.

Sequel uses the connection string to load one or two specialized adapters
For example, "jdbc:mysql:\...". will cause the sequel/adapters/jdbc.rb file to be required as well as the sequel/adapters/jdbc/mysql.rb file.
The problem that @PhaedrusTheGreek describes is one where the database being connected to does not have a second specialized file defined in Sequel.
Based on my observations in issue 90, its not so simple to define the character to be used by quoting. Each specialist adapter defines a quoted_identifier_append, see this line for mysql (its a shared module)
and this line for the default when no adapter overrides it.
As you may see from the source code, Sequel also provides an escape mechanism to escape any quote characters found in the alias which uses a regex pattern - so the pattern and the quote character would need to be supplied to as well as the escape algorithm that the db vendor is expecting.
The only way forward, I think, is to provide a few adapters that we register with Sequel during register - either in the jdbc input source or a separate gem that can have an independent release cycle.

@whack ^ WDYT?

@jordansissel ^ WDYT?

Another example: Sybase. With the connection string "jdbc:jtds:sybase://.." the jtds driver uses the sybase section to (i assume) use a Sybase wire protocol but Sequel via jtds.rb loads MSSQL specifics and fails to interact with Sybase correctly.

Jeremy Evans says we can send PRs for specialized MariaDB and Sybase adapters. https://groups.google.com/d/msg/sequel-talk/HLNJUNACOCU/DOawQ70uFwAJ


[FLINK-27718][hive] Fix fail to count mutiple fields excpetion in Hive dialect

What is the purpose of the change
To fix fail to count mutiple fields excpetion in Hive dialect
Brief change log

Remove the count from the backlist of HiveModule , so that it'll use Hive's count function instead of Flink's count when HiveModule is loaded
Do some adaption for Hive's count function

Verifying this change
Added UT in ...connector-hive/src/test/java/org/apache/flink/connectors/hive/HiveDialectQueryITCase.java#testCount
Does this pull request potentially affect one of the following parts:

Dependencies (does it add or upgrade a dependency):  no
The public API, i.e., is any changed class annotated with @Public(Evolving): no
The serializers: no
The runtime per-record code paths (performance sensitive): no
Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn, ZooKeeper: no
The S3 file system connector: no

Documentation

Does this pull request introduce a new feature? no
If yes, how is the feature documented? N/A

@flinkbot run azure


Logitech G502 mice lighting not synced with app

What are you experiencing an issue with?

[ ] Aurora
[ ] Aurora supported game, (Fill in the game)
[ ] Aurora Wrapper
[ ] Aurora Profile
[x] Aurora supported device, (Logitech G502)
[ ] Aurora Scripts
[ ] Aurora Updater
[ ] Aurora Lighting issue
[ ] Other, (Fill in another issue here)

What kind of an issue is it?

[ ] Crash
[ ] Performance problems
[x] Visual bug
[ ] Localization issue
[ ] Enhancement suggestion
[ ] Device issue
[ ] Other, (Fill in another type of issue here)

Expected behavior:
sync the rgb lights with the aurora app
Actual behavior:
my logitech g502 mice isnt syncing with the aurora app. I've read that some people use the g900 in the settings but still, my g502 wouldnt sync with the app. Instead it would still sync with LGS
How often does this problem occur?

This problem occurs... everytime
Please describe the steps to reproduce this issue:
The issue can be reproduced by doing following steps:

use g502 mice
select g900 from settings
set a lighting profile for that mouse (e.g static color)

What is the version of Aurora you are experiencing this issue with?

My version is... beta v0.6.1-dev3
Does the previous version of Aurora have this issue?
havent use previous version, first time using aurora

Has the Logitech integration definitely connected? You should be able to check under Device Manager what the status of it is, also logs would be helpful. Either click "Show Logs Folder" from Settings -> Debug or go to %appdata%/Aurora/logs

Closing due to lack of follow up


Added Followers module

Added followers module to get list of followers of given user, also included scrape_followers_page as private function to scrape followers page. Attached output for username = "PalaVenkiReddy"

Bhaiya, modified followers as list


Convert properties to non-optional based on Dark Sky API Docs

 Make properties non-optional of applicable


Better flow for adding new user

Currently, adding a new user to a project involves spinner dropdowns. I would like to see it work where you can search for users and select the ones you wish to add in a full screen activity instead, for ease of use.

Done!


Start a new WAL segement on head truncation.

This reduces disk space usage to not be a minimum of 3 128MB files
in small setups. This will possibly also help debug wal data issues,
by making things a bit more deterministic.
Signed-off-by: Brian Brazil<EMAIL_ADDRESS>

this is a new behavior so not a bad idea to add a test.

Repeat few times and every time check that the wal files count is as expected even
when the wal size is below 128MB.

Added a test

This reduces disk space usage to not be a minimum of 3 128MB files
in small setups.

we added the custom wal size for such setups.

This avoids any special configuration being needed in such setups, and that one particular user had extremely low resources available.


Add Travis-CI to our starter code

We currently don't have the Travis-CI connection set up for our lab, and we should.
We would also need to add a reminder to the README to have them change it so that it's about their project instead of ours.

Done for S17


feat: use onClick handler on items rather than on root

What: This swaps our document querying stuff from the root element with a more explicit onClick handler on the items.

Why: It probably should have always been this way...

How: Make the changes, see only one test broke, turns out that's unnecessary with the changes now so we can delete it.

Checklist:

[ ] Documentation N/A
[x] Tests
[x] Ready to be merged
[ ] Added myself to contributors table N/A

This should also make it easier to implement #185 :+1:
cc @gricard and @Swizec :smile:

Codecov Report

Merging #192 into master will not change coverage.
The diff coverage is 100%.

@@          Coverage Diff          @@
##           master   #192   +/-   ##
=====================================
  Coverage     100%   100%
=====================================
  Files           4      4
  Lines         278    267   -11
  Branches       65     61    -4
=====================================
- Hits          278    267   -11

Impacted Files
Coverage Δ

src/downshift.js
100% <100%> (ø)
:arrow_up:

src/utils.js
100% <100%> (ø)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 1b1fd1b...9112f86. Read the comment docs.


[Neuralchat] Notebook retrieval update

Update Notebook about Retrieval document format support.

@Liangyx2 @lvliang-intel ready for merge?


overview page, dont display "https://"

dont display "https://" or "http://" in overview page
delete unused method HAS_FAVORITES
part of #4528

title added in href


Upgrade log4J to v2

Egeria is using  log4j:log4j  which is affected by CVE-2019-17571
Moving to the newer org.apache.logging.log4j:log4j-core >= 2.8.2 should address this

Investigated... log4J v2 is current, and is mostly compatible with log4j v1, but one key difference is that java code should no longer be setting appenders - ie defining the log configuration. This should now be done externally ie through config files.
Many of our clients and tools set the log4J configuration to be a null appender, yet were not themselves directly using log4j. In fact in most cases the pom.xml was pulling in logback as the provider for slf4j
In some cases the logback configuration was set to output at log level info via a logback.xml, in others no logback.xml was provided, therefore defaulting to DEBUG
The original intent of the code in each case was to switch off logging.
Therefore the required modification is to update the logback.xml to level=OFF. With this done there there is also no need for each module to depend on log4j at all!
#2693 will return to this area to go through our outstanding clients/utilities and ensure they are suitably packaged. Until then the change for #2670 should be true to the original developer's intent
We are now left only with
[INFO] org.odpi.egeria:gaian-ranger-plugin:jar:1.8-SNAPSHOT
[INFO] +- com.fasterxml.jackson.core:jackson-annotations:jar:2.11.0:compile
[INFO] +- org.apache.commons:commons-collections4:jar:4.4:compile
[INFO] +- com.ibm.gaiandb:gaian:jar:2.1.8:provided
[INFO] +- org.apache.derby:derby:jar:<IP_ADDRESS>:provided
[INFO] +- org.apache.commons:commons-lang3:jar:3.10:compile
[INFO] +- org.apache.ranger:ranger-plugins-common:jar:1.2.0:compile
[INFO] |  +- com.sun.jersey:jersey-bundle:jar:1.19.3:compile
[INFO] |  |  \- javax.ws.rs:jsr311-api:jar:1.1.1:compile
[INFO] |  +- commons-logging:commons-logging:jar:1.2:compile
[INFO] |  +- log4j:log4j:jar:1.2.17:compile

-- this will be addressed via #458
and
[INFO] |  |  |  +- org.apache.logging.log4j:log4j-to-slf4j:jar:2.12.1:compile
[INFO] |  |  |  |  - org.apache.logging.log4j:log4j-api:jar:2.12.1:compile
[INFO] |  |  |  +- org.apache.logging.log4j:log4j-to-slf4j:jar:2.12.1:compile
[INFO] |  |  |  |  - org.apache.logging.log4j:log4j-api:jar:2.12.1:compile
pulled in via [INFO] +- org.springframework.boot:spring-boot-starter-web:jar:2.2.6.RELEASE:compile which we keep a close eye on and keep up to date
Will add PR


Add more ports to stage 7

The ports discussed in issue #80 are added.
The port numbers were stored with comments inside the script.
Now the comment are added to the messages, so the user can read them.

Left a small nit; otherwise LGTM!

Thanks for reviewing. The grammar mistake is corrected.
(Also I changed the wording 'listens on' in an older text. I hope this was the same mistake.)

Also I changed the wording 'listens on' in an older text. I hope this was the same mistake.)

That one actually was already grammatical, but the change you made is fine 🙂
This LGTM! Will merge in a moment.


Fix for IE9 Double Click and Missed Dropzone

Since the addition of the .dndDraggingSource class is in a $timeout,
there is no guarantee that this class exists at the time of removal.
In IE9 this appears to be an issue because the the drag operation
are event loop blocking.
Potential fix for #21.
I didn't minify code/package anything, I'll leave that a release. Also, as a side note that one might consider: while the timeout might be necessary, perhaps it might be worth just using a regular setTimeout instead of $timeout for the add and removal of this class. There's no need to fire a potential $digest for this.

Thanks for your PR, the solution makes a lot of sense to me.
I merged it to the dev branch, but haven't actually gotten around to test it in IE. Will merge to master once I did that.


Refactor the code to enable module developers to add support for Token Attacher without me needing to maintain that

I make use of Enhanced Terrain Layer for difficult terrain and related things, like furniture. It'd be great if I could attach that terrain info to a token like I can everything else.
Thanks, and thanks for the great module!

I'd like to second the addition of this feature. It would be great to be able to create a difficult terrain prefab (some bushes, for example).

I'm not against adding support for more mods. I just don't want to maintain them.
My plan was/is to add more hooks to token attacher so either the community or the mod maker can add what is relevant to those hooks.
That said I haven't made a specific plan for that yet(it's a little complicated to do), so don't get your hopes up yet.

I've been working on a first version to enable other module developers to add support for their module to token attacher.
I'll move the support for Levels and wall height out into this new system.
Also I want to add Enhanced Terrain Layer as an example aswell, because it's a complete new layer which is different from just added data.
Enhanced Terrain Layer has an issue why I can't go on for now, but I hope it'll be fixed and then I'll continue. I'll release a version as soon as this works, but I don't want to stress ironmonk88 out so we need to be patient.


Add Zoxide

Quick directory jump, z and z.lua alternative, now has windows binary releases:
https://github.com/ajeetdsouza/zoxide/releases

It's written in rust, assumedly faster than other z implementations.
Could be hooked into pwsh:
https://github.com/ajeetdsouza/zoxide/#powershell

Please open request in https://github.com/ScoopInstaller/Main

Please open request in https://github.com/ScoopInstaller/Main
Yep, a little mystified by the extra bucket repo url https://github.com/lukesampson/scoop-extras so opened here at the beginning.

Moved here : https://github.com/ScoopInstaller/Main/issues/1255


Get CTA on Long Beach City Website to point to ours

Not ready for work until site has reached MVP status.

Link placed on Financial Management page. Will likely go in other places in future, but closing this particular issue.


preprocess.py issues - RAM usage close to 100% but CPU usage is nonexistant

Im curious if anyone has run into an issue like this; I am getting it on multiple datasets. What happens is I run the preprocess.py, with my max-1 CPUs and with custom, around 7. The program will run through almost all of my files until the last 15 or so and then it will just freeze. The RAM usage slowly climbs and then just stays around 99% usage.
After retrying it about 4 times, I changed the file to run with a pool.map instead of pool.imap_unordered. This didnt give me updates anymore since I believe the return value on a imap_unordered is an int and the return for the map is not so I couldnt see the actual progress from the output. However, I experienced the same behavior where the CPU was working hard for a while and then eventually fell off.
Possibly relevant: I am running Ubuntu 18.04 on windows subsystem for linux, I have 16gb of RAM and an AMD Ryzen 7 2700 Eight-Core Processor, 8cores with 16 logical processers. I wonder if maybe WSL is the problem, I am going to overwrite one of my hard drives with a linux installation and see if that changes anything but if anyone has any ideas on how to fix this, it would be much appreciated.

I did some more work on this over the weekend, I spun up a VM on digital ocean, something really cheap, 2 CPUs and 4GB of RAM. I SCPed all my data to the server and cloned the repo. Then I ran python3 preprocess.py --path /root/data as root. It ran up until about 7 files were left and then it froze. I attached a picture of HTOP for reference. The memory isnt even being used all the way up and the CPU isnt active at all. But there are a ton of processes just running in the background and not dying. I am wondering if somehow opening the files and editing them is locking up processes and not killing them. But the fact that the resources are not all used up is confusing. Once I kill one or two of the processes, they all die. I will keep looking and update the thread as I explore.

Hi, have you tried  to preprocess with the flag: --num_workers=1?

I ran it with one worker, it was obviously a lot slower. I immedietly noticed a lot of PIDs in htop and a lot of RAM usage as before. My expectation would be that there would not be a lot of PIDs especially with only one worker running. I also ran ps aux which told me I had two processes running.

USER
PID
%CPU
%MEM
VSZ
RSS
TTY
STAT
START
TIME
COMMAND

riderj
28299
0.5
1.5
1670740
199168
pts/0
Sl+
23:00
0:09
python3 preprocess.py --path /home/riderj/data --num_workers=1

riderj
28336
99.7
38.0
50427760
4968236
pts/0
Sl+
23:00
31:23
python3 preprocess.py --path /home/riderj/data --num_workers=1

I got to 1996 files processed before I got some strange errors I had never seen before

I looked at htop and saw that now all of my CPUs were somehow involved in this process?

This is very confusing to me, I dont know what I am doing wrong here or what is going wrong. On my actual computer, I only have VScode, chrome with about 5 tabs, and discord running and I wasnt doing anything on my computer at the time, I was just on my phone in the chair.

Hi, it definitely seems that its spawning too many processes despite the flag. What python version do you use? maybe it would make sense to try another version (with anaconda for example). if everything fails the solution would be to remove the multiprocessing in the file.

If you want to remove multiprocessing, simply change line 118 in preprocess.py:
for i, (item_id, length, cleaned_text) in enumerate(map.imap_unordered(preprocessor, wav_files), 1):
to
for i, (item_id, length, cleaned_text) in enumerate(map(preprocessor, wav_files), 1):

I switched the multiprocessing but no luck, I ran into the same issue when I was using --num-workers=1. Tonight I will try a few different versions of python. The one I am running right now is Python 3.8.10. I will try a few version tonight and update the thread with what I find.

Numba isnt supported by Python3.9 and the default Python I am using from ubuntu is 3.8 so I went back a version to 3.6 using miniconda. No change unfortunately, still the same behavior at the end where I have about 9 files just waiting there. I will try with not multiprocessing and python3.6, that might do something.

Not sure if it is relevant but whenever I kill the process when its stuck with a few files left, I have some output. Thought I would paste it here at least for others to see
Process ForkPoolWorker-24:
Process ForkPoolWorker-22:
Process ForkPoolWorker-23:
Process ForkPoolWorker-21:
Process ForkPoolWorker-20:
Process ForkPoolWorker-19:
Process ForkPoolWorker-18:
Process ForkPoolWorker-14:
Process ForkPoolWorker-8:
Process ForkPoolWorker-7:
Process ForkPoolWorker-12:
Process ForkPoolWorker-13:
Process ForkPoolWorker-2:
Traceback (most recent call last):
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/pool.py", line 720, in next
Process ForkPoolWorker-17:
Traceback (most recent call last):
Traceback (most recent call last):
Traceback (most recent call last):
Traceback (most recent call last):
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/process.py", line 258, in _bootstrap
    self.run()
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/process.py", line 93, in run
    self._target(*self._args, **self._kwargs)
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/pool.py", line 108, in worker
    task = get()
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/queues.py", line 334, in get
    with self._rlock:
Traceback (most recent call last):
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/process.py", line 258, in _bootstrap
    self.run()
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/synchronize.py", line 95, in __enter__
    return self._semlock.__enter__()
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/process.py", line 258, in _bootstrap
    self.run()
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/process.py", line 93, in run
    self._target(*self._args, **self._kwargs)
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/process.py", line 258, in _bootstrap
    self.run()
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/pool.py", line 108, in worker
    task = get()
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/process.py", line 93, in run
    self._target(*self._args, **self._kwargs)
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/queues.py", line 334, in get
    with self._rlock:
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/process.py", line 93, in run
    self._target(*self._args, **self._kwargs)
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/synchronize.py", line 95, in __enter__
    return self._semlock.__enter__()
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/pool.py", line 108, in worker
    task = get()
KeyboardInterrupt
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/queues.py", line 334, in get
    with self._rlock:
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/process.py", line 258, in _bootstrap
    self.run()
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/synchronize.py", line 95, in __enter__
    return self._semlock.__enter__()
Traceback (most recent call last):
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/process.py", line 93, in run
    self._target(*self._args, **self._kwargs)
KeyboardInterrupt
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/pool.py", line 108, in worker
    task = get()
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/pool.py", line 108, in worker
    task = get()
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/queues.py", line 334, in get
    with self._rlock:
KeyboardInterrupt
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/synchronize.py", line 95, in __enter__
    return self._semlock.__enter__()
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/queues.py", line 334, in get
    with self._rlock:
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/synchronize.py", line 95, in __enter__
    return self._semlock.__enter__()
Traceback (most recent call last):
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/process.py", line 258, in _bootstrap
    self.run()
Traceback (most recent call last):
KeyboardInterrupt
Traceback (most recent call last):
KeyboardInterrupt
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/process.py", line 93, in run
    self._target(*self._args, **self._kwargs)
Traceback (most recent call last):
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/pool.py", line 108, in worker
    task = get()
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/queues.py", line 334, in get
    with self._rlock:
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/process.py", line 258, in _bootstrap
    self.run()
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/synchronize.py", line 95, in __enter__
    return self._semlock.__enter__()
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/process.py", line 93, in run
    self._target(*self._args, **self._kwargs)
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/process.py", line 258, in _bootstrap
    self.run()
Traceback (most recent call last):
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/pool.py", line 108, in worker
    task = get()
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/process.py", line 258, in _bootstrap
    self.run()
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/process.py", line 93, in run
    self._target(*self._args, **self._kwargs)
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/queues.py", line 334, in get
    with self._rlock:
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/synchronize.py", line 95, in __enter__
    return self._semlock.__enter__()
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/process.py", line 258, in _bootstrap
    self.run()
KeyboardInterrupt
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/pool.py", line 108, in worker
    task = get()
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/queues.py", line 334, in get
    with self._rlock:
KeyboardInterrupt
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/synchronize.py", line 95, in __enter__
    return self._semlock.__enter__()
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/process.py", line 93, in run
    self._target(*self._args, **self._kwargs)
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/process.py", line 258, in _bootstrap
    self.run()
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/pool.py", line 108, in worker
    task = get()
KeyboardInterrupt
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/queues.py", line 334, in get
    with self._rlock:
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/synchronize.py", line 95, in __enter__
    return self._semlock.__enter__()
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/process.py", line 93, in run
    self._target(*self._args, **self._kwargs)
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/pool.py", line 108, in worker
    task = get()
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/queues.py", line 334, in get
    with self._rlock:
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/synchronize.py", line 95, in __enter__
    return self._semlock.__enter__()
KeyboardInterrupt
Traceback (most recent call last):
KeyboardInterrupt
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/process.py", line 258, in _bootstrap
    self.run()
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/process.py", line 93, in run
    self._target(*self._args, **self._kwargs)
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/pool.py", line 108, in worker
    task = get()
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/queues.py", line 334, in get
    with self._rlock:
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/synchronize.py", line 95, in __enter__
    return self._semlock.__enter__()
KeyboardInterrupt
Traceback (most recent call last):
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/process.py", line 258, in _bootstrap
    self.run()
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/process.py", line 93, in run
    self._target(*self._args, **self._kwargs)
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/pool.py", line 108, in worker
    task = get()
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/queues.py", line 334, in get
    with self._rlock:
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/synchronize.py", line 95, in __enter__
    return self._semlock.__enter__()
KeyboardInterrupt
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/process.py", line 93, in run
    self._target(*self._args, **self._kwargs)
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/pool.py", line 108, in worker
    task = get()
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/queues.py", line 334, in get
    with self._rlock:
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/synchronize.py", line 95, in __enter__
    return self._semlock.__enter__()
KeyboardInterrupt
Traceback (most recent call last):
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/process.py", line 258, in _bootstrap
    self.run()
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/process.py", line 93, in run
    self._target(*self._args, **self._kwargs)
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/pool.py", line 108, in worker
    task = get()
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/queues.py", line 335, in get
    res = self._reader.recv_bytes()
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/connection.py", line 216, in recv_bytes
    buf = self._recv_bytes(maxlength)
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/connection.py", line 407, in _recv_bytes
    buf = self._recv(4)
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/connection.py", line 379, in _recv
    chunk = read(handle, remaining)
KeyboardInterrupt
    item = self._items.popleft()
IndexError: pop from an empty deque

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "preprocess.py", line 118, in <module>
    for i, (item_id, length, cleaned_text) in enumerate(pool.imap_unordered(preprocessor, wav_files), 1):
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/pool.py", line 724, in next
    self._cond.wait(timeout)
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/threading.py", line 295, in wait
    waiter.acquire()
KeyboardInterrupt
Process ForkPoolWorker-16:
Traceback (most recent call last):
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/process.py", line 258, in _bootstrap
    self.run()
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/process.py", line 93, in run
    self._target(*self._args, **self._kwargs)
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/pool.py", line 108, in worker
    task = get()
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/queues.py", line 334, in get
    with self._rlock:
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/synchronize.py", line 95, in __enter__
    return self._semlock.__enter__()
KeyboardInterrupt

Seems to me like a WSL problem, is this maybe related? https://stackoverflow.com/questions/44475289/inconsistent-multiprocessing-pool-performance-across-wsl-and-winpython

I checked that I have WSL2 installed which the commenter said the performance is better in there. In my second response above on the thread, I tried this on a VM though it was pretty small so I wanted to be thorough. This time I got a CPU optimized VM, 16GB of RAM, 8 CPUs and reproduced the process. I used miniconda to install python3.6. Full output of setup steps below but here is what I saw again, same issues:
HTOP

Output stuck again

Code I run on server start:
apt update -y
apt upgrade -y
apt install espeak libjpeg8-dev zlib1g-dev ffmpeg gcc g++ -y
cd ~

wget https://repo.anaconda.com/miniconda/Miniconda3-latest-Linux-x86_64.sh
chmod +x Miniconda3-latest-Linux-x86_64.sh
sh Miniconda3-latest-Linux-x86_64.sh
rm Miniconda3-latest-Linux-x86_64.sh
conda update conda -y
conda update --all -y
conda create --name py3.6 python=3.6 -y
conda activate py3.6

git clone https://github.com/as-ideas/ForwardTacotron
cd ForwardTacotron

pip3 install -r requirements.txt
python3 preprocess.py --path ~/data

Every single time it just seems like the memory gets stuck at full for some reason. I am starting to think it might be my dataset, is 9k too large? Is there any way to just chunk it into smaller pieces to preprocess? My files are not strange, just wav files pulled from YouTube MP3s.
Metadata.csv is just a bunch of lines like this:
a-43-audio|but the variety today might be new hero or something

I did some more research on this today, I found a thread about multiprocessing hanging on stack overflow. The suggestion was that there is a problem with multiprocessing in pools but they fixed it with a separate module called concurrent.futures.
I changed out some code and tested it, the preprocessing didnt finished but I got the below error at least. I will continue troubleshooting and update this thread.
██████████░░░░░░ 5735/9596 Traceback (most recent call last):
  File "preprocess.py", line 121, in <module>
    for i, (item_id, length, cleaned_text) in enumerate(pool.map(preprocessor, wav_files), 1):
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/concurrent/futures/process.py", line 366, in _chain_from_iterable_of_lists
    for element in iterable:
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/concurrent/futures/_base.py", line 586, in result_iterator
    yield fs.pop().result()
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/concurrent/futures/_base.py", line 432, in result
    return self.__get_result()
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/concurrent/futures/_base.py", line 384, in __get_result
    raise self._exception
concurrent.futures.process.BrokenProcessPool: A process in the process pool was terminated abruptly while the future was running or pending.
Exception in thread Thread-1:
Traceback (most recent call last):
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/threading.py", line 916, in _bootstrap_inner
    self.run()
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/threading.py", line 864, in run
    self._target(*self._args, **self._kwargs)
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/concurrent/futures/process.py", line 295, in _queue_management_worker
    shutdown_worker()
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/concurrent/futures/process.py", line 253, in shutdown_worker
    call_queue.put_nowait(None)
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/queues.py", line 129, in put_nowait
    return self.put(obj, False)
  File "/home/rider/miniconda3/envs/py3.6/lib/python3.6/multiprocessing/queues.py", line 83, in put
    raise Full
queue.Full

Could you run the prog with multiprocessing removed as suggested here: https://github.com/as-ideas/ForwardTacotron/issues/65#issuecomment-984444523 ? Just to make sure it runs through and does not fail on a corner case.

I wrote some pretty rudimentary batching code to see if I could get whatever is happening in the pool to stop hogging the ram. It looks like this
    # 1000 files in a batch
    batch_amount = math.ceil(len(wav_files) / 1000)

    for x in range(batch_amount):
        print(f'Starting batch {x}')
        # pool = Pool(processes=n_workers)
        pool = ProcessPoolExecutor(max_workers=n_workers)

        print('Pool created')

        start = x*1000
        finish = (x+1)*1000
        wav_files_batch = wav_files[start:finish]

        for i, (item_id, length, cleaned_text) in enumerate(pool.map(preprocessor, wav_files_batch), 1):
            if item_id in text_dict:
                dataset += [(item_id, length)]
                cleaned_texts += [(item_id, cleaned_text)]
            bar = progbar(i, len(wav_files_batch))
            message = f'{bar} {i}/{len(wav_files_batch)} '
            stream(message)

        print('Shutting down pool')
        try:
            pool.shutdown()
        except Exception as e:
            logging.error(traceback.format_exc())
        print('Pool closed')

This code actually works with the command python preprocess.py --path ~/data --num_workers=1 which makes it basically single threaded right? So I think the issue was that the queue process was just getting too much data at the end of the day and killing threads before they returned. Killing the old pool and creating a new one each 1000 files seemed to keep the memory usage in check. I am going to try it with more workers and a smaller batch size since with only 1 worker, its very slow. I will update the thread with the info.

Just an update, I ran the process with a batch size of 50 instead of 1000 and I used all the workers except one, it finished about 4 hours faster than before (thanks to the higher number of workers) but with no memory issues still.
Based on the lack of other issues listed, it seems like this is just a problem on my end. If you want, I can make an MR with this pool change, otherwise I will close the issue.

Glad the workaround worked, still there seems to be a problem with garbage collection / closing processes with your specific problem. Batching shouldn't be necessary with a functioning multiprocessing, so no need for a MR.

Hi, I had this same problem and by trial and error I have been able to find out that it is due to the new versions of phonemizer. Since 3.0 (released on October 25, 2021) you can't complete preprocess.py step, it starts apparently fine but it takes longer and longer to process each file until it gives error, in addition to a crazy RAM usage.
With 2.2.2 version there is no problem, in case you want to modify it in requirements.txt. Since then I am using Oct 13, 2021 commit.


Hyperlinks to sections in readme don't work in pub.dartlang.org

If you load this page:
https://pub.dartlang.org/packages/test
The top part of the readme is a bunch of links that are supposed to link down the page. They don't work.
My guess is that GitHub adds names to the headings but whatever is doing the markdown here does not. Possibly you could blame the package, but since this is a Dart Team package and it seems like very useful functionality it might be worth investigating if it can be made to work?

This seems to work now with the newest version of the markdown package.

Yep, works now. Though the floating black bar means the heading that it scrolls to is obscured (a common issue with floating headers like this!).


Controls should reference their query using query =  rather than sql =

It's simpler in code and readability to reference queries using the query = attribute rather than the sql = attribute.
This occurs throughout the mod, but as a specific example:
https://github.com/turbot/steampipe-mod-alicloud-compliance/blob/178688757489f7b9b351dd6bc614a36872facb80/cis_v100/section_2.sp#L41-L53
Could be changed from:
sql           = query.action_trail_enabled.sql

to:
query         = query.action_trail_enabled

Closed as a part of https://github.com/turbot/steampipe-mod-alicloud-compliance/pull/52


error in the line makes pipeline eat lines upward

I think this is closely related the first bullet point in my #7, and therefore to your #8, but it happned in d7181e2 already.
Try just entering cat non_existent_file. It should eat past terminal ouptut.
The following screencast shows the repro steps, but not the effect. (It must be a bug in asciinema!)
In my case the effect is that line goes up, "eating" the previous line of the terminal

As a side note, wouldn't be reasonable to handle Ctrl-D the same way you handle Ctrl-C? I mean, there's not much we want to do, right?

Hm this is something I've specifically tested for in the past. I just tried again with the latest master, on ubuntu+gnome terminal and macos iterm2, and I can't reproduce in either environment. So it might be some interaction with your terminal emulator (which you said was urxvt right?), or something with your terminal config. We'll have to try and narrow it down more.

Yep, I just installed rxvt-unicode on ubuntu and was able to reproduce the issue there.

I see the issue, in this situation I'm incorrectly sending the "UP" terminal code to move the cursor up, but with value -1 -- these other emulators treat that negative int as 0, but it looks like rxvt-unicode looks at the absolute value and moves up one line.
I'm not sure if one of those behaviors is "more correct" than the other, but the real solution is for pipeline to not try to move up a negative number of lines.


add me to contributors

@all-contributors add @ChMThiel for code and maintenance

@all-contributors add @ChMThiel for code and maintenance


PeoplePicker in SPF'x - SPClientPeoplePicker is undefined

I am developing a SPF'x addin. In this i am populating HTML controls like SP Edit Form. In this i need to create Client people Picker Control. I am not sure how to create a PeoplePicker in SPF'x. I just want to create a ClientPeoplePicker. What i have done is added a div element in my HTML and i tried to make that DIV as PeoplePicker.

private loadPeoplePicker(peoplePickerElementId:string):void  {
      let schema: ISPClientPeoplePickerSchema = {
      PrincipalAccountType: 'User,DL,SecGroup,SPGroup',
      SearchPrincipalSource: 15,
      ResolvePrincipalSource: 15,
      AllowMultipleValues: true,
      MaximumEntitySuggestions :50,
      Width: 280,
      OnUserResolvedClientScript: this.onUserResolvedClientScript
    }
    SPClientPeoplePicker.InitializeStandalonePeoplePicker(peoplePickerElementId,null,schema);
  }

  private onUserResolvedClientScript(el: string, users: ISPClientPeoplePickerEntity[]) {
        let keys:string = "";
        let userInfo:string = "";
        for (let i = 0; i < users.length; i++) {
            let user:ISPClientPeoplePickerEntity = users[i];
            keys += user.Key + ",";
            for (let userProperty in user) {
                userInfo += userProperty + ':  ' + user[userProperty] + '
';
            }
        }
        alert(userInfo);
       alert(keys);
  }

My Config.json is looks like:
"externals": {
    "sp-init": {
      "path": "https://innovaopnsuite.sharepoint.com/sites/Innova/Submissions/_layouts/15/init.js",
      "globalName": "$_global_init"
    },
    "microsoft-ajax": {
      "path": "https://innovaopnsuite.sharepoint.com/sites/Innova/Submissions/_layouts/15/MicrosoftAjax.js",
      "globalName": "Sys",
      "globalDependencies": [
        "sp-init"
      ]
    },
    "sp-runtime": {
      "path": "https://innovaopnsuite.sharepoint.com/sites/Innova/Submissions/_layouts/15/SP.Runtime.js",
      "globalName": "SP",
      "globalDependencies": [
        "microsoft-ajax"
      ]
    },
    "sharepoint": {
      "path": "https://innovaopnsuite.sharepoint.com/sites/Innova/Submissions/_layouts/15/SP.js",
      "globalName": "SP",
      "globalDependencies": [
        "sp-runtime"
      ]
    },
     "sp-core": {
      "path": "https://innovaopnsuite.sharepoint.com/sites/Innova/Submissions/_layouts/15/core.js",
      "globalName": "SP",
      "globalDependencies": [
        "sp-runtime"
      ]
    },
    "clientpeoplepicker": {
      "path": "https://innovaopnsuite.sharepoint.com/sites/Innova/Submissions/_layouts/15/clientpeoplepicker.js",
      "globalName": "clientpeoplepicker",
      "globalDependencies": [
        "sharepoint"
      ]
    }
    ,
    "clienttemplates": {
      "path": "https://innovaopnsuite.sharepoint.com/sites/Innova/Submissions/_layouts/15/clienttemplates.js",
      "globalName": "clienttemplates",
      "globalDependencies": [
        "sharepoint"
      ]
    }
    ,
    "clientforms": {
      "path": "https://innovaopnsuite.sharepoint.com/sites/Innova/Submissions/_layouts/15/clientforms.js",
      "globalName": "clientforms",
      "globalDependencies": [
        "sharepoint"
      ]
    }
    ,
    "autofill": {
      "path": "https://innovaopnsuite.sharepoint.com/sites/Innova/Submissions/_layouts/15/autofill.js",
      "globalName": "autofill",
      "globalDependencies": [
        "sharepoint"
      ]
    }
  }

In my .tsx file i added the require section for those js like
require('clientpeoplepicker');
require('clientTemplates');
require('clientforms');
require('autofill');

Initially it throw "SPClientpeoplePicker" is undefined. so I added a "clientpeoplepicker.js" in Config.json "Externals" section. Now it throws "SPClientPeoplePickerCSRTemplate is not defined"  error. But i cant able to load "clientempletes.js","clientforms.js","autofill.js". How can i load those Js files?
I am not sure What i missed. Please help me to sort it out. If possible, please give me an example.
Thanks

This seems like a dupe of your previous bug #478 478


Range-based seeding of MersenneTwisterEngine is inconsistent with C++11

joseph.wakeling (@WebDrake) reported this on 2017-01-07T22:22:41Z
Transfered from https://issues.dlang.org/show_bug.cgi?id=17068
Description
Created attachment 1631
Small example of range-based seeding of Phobos Mersenne Twister

std.random's `MersenneTwisterEngine` includes a `seed` method that accepts an input range from which the state of the generator can be initialized.  This method superficially seems similar to the sequence-based seeding mechanism that can be used when seeding the C++11 <random> `mt19937` engine, but its behaviour is different in several ways:

* the Phobos method will reject any range whose length is less than the size of the generator's internal state array.  By contrast the C++11 `mt19937` accepts a seed sequence of any length (including 1);

* seeding with identical sequences produces completely different results for the C++11 and D versions.  Besides simply being inconsistent (and probably also at odds with reference seeding methods for the Mersenne Twister) this may make it harder for users to port C++ code to D.

It is therefore suggested to implement a new range-based seeding mechanism that matches the C++11 seed-sequence behaviour, and deprecate the old seeding method.

!!!There are attachements in the bugzilla issue that have not been copied over!!!

joseph.wakeling commented on 2017-01-07T22:24:16Z
Created attachment 1632
Small example of sequence-based seeding of C++11 Mersenne Twister

Compile with the `-std=c++11` option.

joseph.wakeling commented on 2017-01-07T22:26:29Z
I've attached small code snippets to show the difference between the D and C++11 behaviour.

Running these on my machine the D code outputs (apart from the seed data) 1st and 10,000th variates of:

596004846
703773746

while the C++11 code outputs 1st and 10,000th variates of:

719125747
99701347


Make angle conversion functions compatible with units

Current coverage is 86.25%

Merging #86 into master will increase coverage by +0.06% as of 60ec031

@@            master     #86   diff @@
======================================
  Files           18      18
  Stmts          688     691     +3
  Branches         0       0
  Methods          0       0
======================================
+ Hit            593     596     +3
  Partial          0       0
  Missed          95      95

Review entire Coverage Diff as of 60ec031

Powered by Codecov. Updated on successful CI builds.


Change device_state_attributes to extra_state_attributes

Just a heads up that on 2021.12.0b0, seeing these errors:
Logger: homeassistant.helpers.entity
Source: helpers/entity.py:543
First occurred: December 3, 2021, 9:07:53 PM (2405 occurrences)
Last logged: 7:08:25 AM
Entity alarm_control_panel.alarm_com (<class 'custom_components.alarmdotcom.alarm_control_panel.AlarmDotCom'>) implements device_state_attributes. Please report it to the custom component author.
This should provide the fix:
https://discord.com/channels/330944238910963714/427516175237382144/916624064301391892
or the actual comment:
device_state_attributes -> extra_state_attributes, is a name change... its really just that

I changed:
@property
 def device_state_attributes(self):
     """Return the state attributes."""
     return {"sensor_status": self._alarm.sensor_status}

to:
@property
 def extra_state_attributes(self):
     """Return the state attributes."""
     return {"sensor_status": self._alarm.sensor_status}

and it silenced the error.  Still testing if it broke anything else.

Fixed in v0.1.11


Aspects cause class initialization

Aspects cause +initialize to be called on the hooked class. This is a problem if hooking in e.g. __attribute__((constructor)) of a dynamic lib: for certain classes and app combinations (e.g. UIWebView in MobileSafari) it's too early and apps may crash.
Doing it manually, this would cause a crash for me:
Method initWithFrameMethod = class_getInstanceMethod([UIWebView class], @selector(initWithFrame:));
original_initWithFrame = method_setImplementation(initWithFrameMethod, (IMP)replacement_initWithFrame);

While this would not:
Method initWithFrameMethod = class_getInstanceMethod(objc_getClass("UIWebView"), @selector(initWithFrame:));
original_initWithFrame = method_setImplementation(initWithFrameMethod, (IMP)replacement_initWithFrame);

(replaced [UIWebView class] with objc_getClass("UIWebView"))
Not sure there is a way around it, because of the API design, but just wanted to point it out. Maybe worth mentioning in docs.

We need to call class to detect KVO - there might be other tricks around this, but it's probably smarter to change the timing you hook.


Neo4j custom exporter failing with "ModuleNotFoundError: No module named 'py2neo'"

Here are the things i tried to fix

pyneo4j to requirements.txt.
Restarted the kernel
Even restarted the docker instance

What am i missing ?
Here is the custom exporter I wrote,
if 'data_exporter' not in globals():
    from mage_ai.data_preparation.decorators import data_exporter

@data_exporter
def export_data(data, *args, **kwargs):
    """
    Exports data to some source.

    Args:
        data: The output from the upstream parent block
        args: The output from any additional upstream blocks (if applicable)

    Output (optional):
        Optionally return any object and it'll be logged and
        displayed when inspecting the block run.
    """
    from py2neo.bulk import create_nodes
    from py2neo import Graph

    # Specify your data exporting logic here
    g = Graph(host="host.docker.internal", user='root',
              password='password')
    create_nodes(g.auto(), data, labels={"Stock"})

But failing with the error
ModuleNotFoundError                       Traceback (most recent call last)

/home/src/demo_project/data_exporters/import_graph.py in export_data(data, *args, **kwargs)

     16         displayed when inspecting the block run.

     17     """

---> 18     from py2neo.bulk import create_nodes

     19     from py2neo import Graph

     20

ModuleNotFoundError: No module named 'py2neo'

Nevermind. its the confusion between too many libraries neo4j has . i had to install py2neo to fix this.


Added Theme Dark Night

Pull Request
Contribution type

[x] New template contribution
[ ] Existing template update
[ ] Issue fix
[ ] README.md update

Contribution Description

Added Theme Dark Night

[x] I would like my template to be added to the Unstoppable Domains' website builder
Unstoppable Domain Name:
bigrobin.crypto

Hey,
Matias from Unstoppable Domains here.
Thanks for submitting a template!
We will be reviewing all pull requests this week.
Best,


Helm 3 (#516)

bump helm version to helm 3.4.1
update doc to make helm 3 the recommended version
update helm commands arguments for helm 3
remove helm init and tiller install commands
add stable repo for metricbeat dependencies
remove the charts dance in helmignore (related to https://github.com/elastic/helm-charts/pull/127)
optimize docker images
replace deprecated gitversion capability (related to https://github.com/helm/helm/pull/5601)
remove some heritage labels in immutable fields

jenkins test this please

jenkins test this please

Failing tests are some new transient issues we have since last week.


Dev

Codecov Report

Merging #15 into master will increase coverage by 1.41%.
The diff coverage is 66.66%.

@@            Coverage Diff             @@
##           master      #15      +/-   ##
==========================================
+ Coverage   47.19%   48.60%   +1.41%
==========================================
  Files          11       11
  Lines         356      358       +2
==========================================
+ Hits          168      174       +6
+ Misses        188      184       -4

Impacted Files
Coverage Δ

src/peon/project/file/file.py
33.33% <0.00%> (ø)

src/peon/project/file/function_def/function.py
18.58% <41.66%> (ø)

src/peon/project/file/class_def/classes.py
97.05% <100.00%> (+6.43%)
:arrow_up:

...ject/file/function_def/expression/returned_expr.py
100.00% <0.00%> (+6.06%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 4ff8ae9...44b5ce5. Read the comment docs.


Move tag “xkcdpass-1.4.4” to correct commit

The tag “xkcdpass-1.4.4” currently points to a commit where the version is still “1.4.3”.
Commit 3ad73d6cefc1d511882b7731ed44f2469c589195 (current head as of this report) sets the version to “1.4.4”, I think the “xkcdpass-1.4.4” tag needs to be moved there. Perhaps the message on that commit should state that it increments the version.

Thought I had already fixed this - thank you for the catch! Tags should be correct now


Error 26 when installing xenial

Please paste the output of the following command here: sudo edit-chroot -all

name: xenial
encrypted: no
Entering /mnt/stateful_partition/crouton/chroots/xenial...
Creating hwaudio group with GID 18...
su: pam_start: error 26
Unmounting /mnt/stateful_partition/crouton/chroots/xenial...
Please describe your issue:
I can't install xenial.
If known, describe the steps to reproduce the issue:
I went with the easy way in the read me section step by step.

Please try the latest release of crouton and re-open if it doesn't fix the failure.


Terms Accepting Checkbox

What does this PR?
This PR adds terms accepting checkbox and tems of services link at welcome page
Issue number
fixes #2366
Screenshots/Video

Android

Small screen test, added scroll for view all lines

@feruzm all good here, can be merged in nt/app-startup, please review before merging


Getting started should note warning/error can be ignored

V 2.3.1 installed on macOS 12.2
Set Up Page
The "docker-compose pull" step may produce the following warning/error:
WARNING: Some service image(s) must be built from source by running:
    docker compose build db webui rps mps mpsrouter
Error response from daemon: pull access denied for sslpostgres, repository does not exist or may require 'docker login': denied: requested access to the resource is denied

It is tremendously confusing for those unfamiliar with Docker so the documentation should note that it can safely be ignored.

We have fixed this in the v2.5 release. Thanks!


hot-update.json 404 when visiting subpath

Bug report

What is the current behavior?
When I use HMR。 My server.js is :
`
let hotMiddleware = `${require.resolve('webpack-hot-middleware/client')}?path=/__webpack_hmr&timeout=20000`;
if (Object.prototype.toString.call(webpackConf.entry) === '[object Array]') {
    webpackConf.entry.push(hotMiddleware);
} else {
    for (var key in webpackConf.entry) {
        webpackConf.entry[key] = [hotMiddleware].concat(webpackConf.entry[key]);
    }
}
webpackConf.plugins.push(new webpack.HotModuleReplacementPlugin());

let publicPath = 'http://localhost:8080/';

const compiler = webpack(webpackConf);

const webpackDevMiddlewareInstance = webpackDevMiddleware(compiler, {
    publicPath: publicPath,
    quiet: true,
    stats: {
        colors: true
    }
});
app.use(webpackDevMiddlewareInstance);

app.use(webpackHotMiddleware(compiler, {
    path: '/__webpack_hmr'
}));
`

When I visit http://localhost:8080/page/index.html. When HMR happens, hotDownloadManifest will be called. But it will request http://localhost:1314/page/beb602dcf863eb7ba6e4.hot-update.json instead of http://localhost:1314/beb602dcf863eb7ba6e4.hot-update.json. It will receive 404.
I fount that in webpack/lib/web/JsonpMainTemplate.runtime.js, there's a function hotDownloadManifest:
`
...

		if (typeof XMLHttpRequest === "undefined") {
			return reject(new Error("No browser support"));
		}
		try {
			var request = new XMLHttpRequest();
			var requestPath = $require$.p + $hotMainFilename$; // this should lead to the root url
			request.open("GET", requestPath, true);
			request.timeout = requestTimeout;
			request.send(null);
		} catch (err) {
			return reject(err);
		}

...
`
When I change
 var requestPath = $require$.p + $hotMainFilename$;
to
var requestPath = '/' + $require$.p + $hotMainFilename$;
It works well.

Other relevant information:
webpack version:  latest
Node.js version:
Operating System:
Additional tools:

This is related to the core webpack / dev middleware config, not hot middleware’s config.
You probably need to ensure that publicPath in the compiler config and dev middleware config match up

On 10 Oct 2018, at 03:42, carlsirce<EMAIL_ADDRESS>wrote:
Bug report
What is the current behavior?
When I use HMR。 My server.js is :
`
let hotMiddleware = ${require.resolve('webpack-hot-middleware/client')}?path=/__webpack_hmr&timeout=20000;
if (Object.prototype.toString.call(webpackConf.entry) === '[object Array]') {
webpackConf.entry.push(hotMiddleware);
} else {
for (var key in webpackConf.entry) {
webpackConf.entry[key] = [hotMiddleware].concat(webpackConf.entry[key]);
}
}
webpackConf.plugins.push(new webpack.HotModuleReplacementPlugin());
let publicPath = 'http://localhost:8080/';
const compiler = webpack(webpackConf);
const webpackDevMiddlewareInstance = webpackDevMiddleware(compiler, {
publicPath: publicPath,
quiet: true,
stats: {
colors: true
}
});
app.use(webpackDevMiddlewareInstance);
app.use(webpackHotMiddleware(compiler, {
path: '/__webpack_hmr'
}));
`
When I visit http://localhost:8080/page/index.html. When HMR happens, hotDownloadManifest will be called. But it will request http://localhost:1314/page/beb602dcf863eb7ba6e4.hot-update.json instead of http://localhost:1314/beb602dcf863eb7ba6e4.hot-update.json. It will receive 404.
I fount that in webpack/lib/web/JsonpMainTemplate.runtime.js, there's a function hotDownloadManifest:
`
...
  if (typeof XMLHttpRequest === "undefined") {
  	return reject(new Error("No browser support"));
  }
  try {
  	var request = new XMLHttpRequest();
  	var requestPath = $require$.p + $hotMainFilename$; // this should lead to the root url
  	request.open("GET", requestPath, true);
  	request.timeout = requestTimeout;
  	request.send(null);
  } catch (err) {
  	return reject(err);
  }

...
`
When I change
var requestPath = $require$.p + $hotMainFilename$;
to
var requestPath = '/' + $require$.p + $hotMainFilename$;
It works well.
Other relevant information:
webpack version: latest
Node.js version:
Operating System:
Additional tools:
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub, or mute the thread.

see https://github.com/webpack/webpack-dev-server/pull/1514#issuecomment-495388112

Hi, man.
You can see link: https://webpack.js.org/configuration/output/#outputpublicpath
When developing multi-page project, we can set output.publicPath to "/" to prevent compiler setting "*.hot-update.json" depend on url.
For instance:
visit http://localhost:9998/page2/index.html
it will receive hot-update.json like http://localhost:9998/page2/2f07d1a12be2c9111b86.hot-update.json
but set output.publicPath to "/"
it will receive http://localhost:9998/2f07d1a12be2c9111b86.hot-update.json
hope it can help you!

actually it seems to be a problem when hot-update.json has a hash on filename, here, when I removed the [hash] and [id] from hot-update.json name, it worked fancy!


Update 0500-10-11-validation_en.md OSMCha

Add the OCMCha paragraph

I fixed a few typos but still have a question. At the end of the document there are two image links formatted as code. There is no reference to the images either at the end of the Markdown page. I guess this is still work in progress?

The "code" was to discern it from the running text. These are placeholders for 2 images that i posted on Slack #learnosm (i cannot upload these myself).


Change default sun position method to accurate and other minor improvements

Description
With the speed improvements in https://github.com/sot/chandra_aca/pull/162, it is now reasonable to use the "accurate" Sun position method as the default. The "accurate" method is only 60% slower than "fast", but end-to-end the attitudes() function and kadi states generation is still a factor of 2 faster than current flight.
The pitch, nominal_roll and off_nominal_roll functions now have a method kwarg to specify the sun position method.
This PR also improves a number of docstrings and converts them to numpydoc format.
Required dependent PRs

https://github.com/sot/chandra_aca/pull/162

Interface impacts

position_at_jd was renamed to position_fast_at_jd to clarify that this function does not respect the sun_position_method_default configuration value.
Testing

Changes the position_at_jd function name to position_fast_at_jd. The former name was misleading and I lost some time because of thinking it would compute accurace positions.
Unit tests

[x] Mac

(ska3-perf) ➜  ska_sun git:(fast-and-accurate) git rev-parse HEAD
e24c81774ad938ef2b158f8dfc15e423139dc534
(ska3-perf) ➜  ska_sun git:(fast-and-accurate) pytest
=============================================== test session starts ===============================================
platform darwin -- Python 3.10.8, pytest-7.2.1, pluggy-1.0.0
rootdir: /Users/aldcroft/git, configfile: pytest.ini
plugins: timeout-2.1.0, anyio-3.6.2
collected 16 items

ska_sun/tests/test_sun.py ................                                                                  [100%]

=============================================== 16 passed in 2.31s ================================================

Independent check of unit tests by [REVIEWER NAME]

[ ] [PLATFORM]:

Functional tests

See the included PR36 notebook.

@javierggt - huh. First question is whether you had all the latest branches of kadi, chandra_maneuver and chandra_aca installed.  There can even be problems with chandra_maneuver and namespace borking. At this point the latest master for all of those should be good.
Beyond that, we have sunk so much into this and are so deep that we may have to accept the performance unless it is truly show-stopper.

Ah! I had the latest chandra_aca, but not the latest kadi and chandra_maneuver, so that can be it.


non-instance edge prediction model

hi, could you provide the link for non-instance edge prediction pretrained models for sbd and cityscapes?

hi. this good work is difficult for me, especially the part of "Edge prior model". Could you give me some advises that how i can understand the original paper. please.

hi. this good work is difficult for me, especially the part of "Edge prior model". Could you give me some advises that how i can understand the original paper. please.


Update settings.py

php-saml was modified to have requestAuthnContext default to False so applying the same change here

The default value in php-saml is still True:

https://github.com/onelogin/php-saml/blob/master/lib/Saml2/Settings.php#L367
https://github.com/onelogin/php-saml/blob/3.4.1/src/Saml2/Settings.php#L360

What was changed was the default values in the settings file:

https://github.com/onelogin/php-saml/commit/01829e6ec722fe8695855e8ed8291d0f066bab0b

but we can't apply the change in the PR because breaks compatibility.
We don't define it in the settings of our examples. We could add this settings with False:

https://github.com/onelogin/python3-saml/blob/master/demo-django/saml/advanced_settings.json
https://github.com/onelogin/python3-saml/blob/master/demo-flask/saml/advanced_settings.json
https://github.com/onelogin/python3-saml/blob/master/demo-tornado/saml/advanced_settings.json
https://github.com/onelogin/python3-saml/blob/master/demo_pyramid/demo_pyramid/saml/advanced_settings.json

and update the Readme as well:

Oh good catch. I'll close the PR.


Meeting Notes: Week11 Meeting16

To Do

Take notes during the meeting.
Create the wiki page .
Add links to Sidebar and Homepage.

Deadline
16.05.2022 @17.00
Additional Information
No response

Added the notes to the sidebar menu and homepage. The notes can be found here.


chore: use computed radius size for checkbox ripple during 2018 material spec update transition

Isn't the ripple just supposed to be ~40px. I've addressed it in https://github.com/angular/material2/pull/12493.


promote the tap-gitlab tutorial to the main docs

Migrated from GitLab: https://gitlab.com/meltano/meltano/-/issues/495
Originally created by @dmor on 2019-03-18 21:35:43

https://gitlab.com/meltano/tap-gitlab#quick-start
Need to figure out how to have these in the docs in the repo and also on our website without duplicating

View 4 previous comments from the original issue on GitLab


Can't use a union of function types to type a function with multiple signatures

I was hoping it might be possible to help Flow infer the return type of a function depending on its input type, like this:
type IsNumber =
  | (number => true)
  | (any => false);

declare var isNumber: IsNumber;

(isNumber(123): boolean); // ERROR
(isNumber('nope'): boolean); // ERROR

(isNumber(123): true); // ERROR
(isNumber('nope'): false); // ERROR

But Flow errors on all four type assertions. I expected all four of them to pass, especially the : boolean ones. (tryflow)
Then I tried doing the same thing using an interface:
interface Foo {
  isNumber(number): true;
  isNumber(any): false;
}

declare var foo: Foo;

(foo.isNumber(123): boolean); // PASS
(foo.isNumber('nope'): boolean); // PASS

(foo.isNumber(123): true); // PASS
(foo.isNumber('nope'): false); // PASS

All four assertions pass as expected! And they fail correctly if you change them – e.g. (foo.isNumber(123): false) errors as expected. (tryflow)
Two questions:

Why isn't this awesome feature mentioned in the Interface Types docs? Is it safe to rely on it?
Why doesn't it work with a union of function types?

IsNumber in the first case is either a function that returns true for numbers or a function that returns false for any value, it's not both at the same time.
Try like this:
type IsNumber =
  & (number => true)
  & (any => false);

Ahh that makes sense now, thank you


Get all translated records from the product

Hi there, im using this package, in my listing i want to get all the translated records from the "x" product to be able to edit in my edit page product, but cant understand why that only brings the english records, is missing the other languages.
ex: " return Product::where('id', '2')->get();"
What im doing wrong?

$product->translations with this you should be able to access all translations.


[Docs] Add search console tag for verification

Description
As part of ticket 1377 on the internal repo.
Adding CYb3cxosCgsN2QDQVaSGQpMQCesqpsGQ3oTM02NtvkY as our tag to enable readthedocs to add it to our hosted docs for verification by Google search console.
Screenshot
Notice

[x] I acknowledge and agree that, by checking this box and clicking "Submit Pull Request":

I submit this contribution under the Apache 2.0 license and represent that I am entitled to do so on behalf of myself, my employer, or relevant third parties, as applicable.
I certify that (a) this contribution is my original creation and / or (b) to the extent it is not my original creation, I am authorized to submit this contribution on behalf of the original creator(s) or their licensees.
I certify that the use of this contribution as authorized by the Apache 2.0 license does not violate the intellectual property rights of anyone else.
I have not referenced individuals, products or companies in any commits, directly or indirectly.
I have not added data or restricted code in any commits, directly or indirectly.

I approved but would also be curious what this actually does?

@antonymilne So when we next do a release, this means mkdocs will build a site verification tag into google search console. The site console will trust that we own the site, and will report on the google search keywords that brought users to the vizro.readthedocs.io pages.
It basically gives us some better insights into what we're ranking for (and what our users are looking for when we surface on Google and they're convinced by the metadata text to follow the link). We can match up if we're delivering in the docs what the user looked for and, if not, plan to improve it.
Sadly, we can't use google analytics since that keeps track of users across the site and there are various European GDPR implications. But search console is safe since it's search data that is kept by google, not tracked by us.

Oh nice, that sounds great. I look forward to hearing what we learn from this tracking 👍


"Bratovoești" is listed in the drop-down menu

Description:
When user writes "Bratovoești" the location appears in the drop-down menu next to the comune and the county witch is a part according to the law
Precondition:
The website is up an running.

Step 1
Write in the search bar "Bratovoești"

Expected results
The location appears in the drop-down menu as "Comuna Bratovoești, DOLJ"


Added commands for Windows download

Added commands for downloading the ipinfo cli tool using PowerShell.

@rm-Umar in case you have Windows setup, can you check to see if this script works, and maybe to try to take over this PR?

Added the scripts for PowerShell in #80 PR. Thanks for your contribution @yooakim


Make empty string False-ish

Empty strings should probably be considered False-ish, rather than causing ValueError('Maybe!').

Closing this PR, as it turned out that empty strings needs to be considered differently, as addressed in #4.


Training loop from scratch for multi-out model - how to calculate loss and update it.

I have a ML models which have 3 output. Each of them have passed into a Soft-Max player. I'm trying to train the model from scratch with training loop in tf.keras. My generator output are something like this:
x,y = (batch_size, h,w,c), [(batch_size, 2), (batch_size, 8), (batch_size, 10)]

As you notice, each of the 3 output has different numbers of labels. First output layer has 2 labels output, second one has 8 and last one has 10. The problem is not about the data generator; It's fine. However, I don't understand how will I calculate loss function and update it in scratch training.

I've started with document guidelines. Here is the code snippet,

epochs = 1
optimizer   = tf.keras.optimizers.Adam(learning_rate=0.05)
loss_fn     = tf.keras.losses.CategoricalCrossentropy()

train_acc_metric = tf.keras.metrics.Accuracy()
val_acc_metric   = tf.keras.metrics.Accuracy()

@tf.function
def train_step(x, y):
    with tf.GradientTape() as tape:
        logits = model(x, training=True)  # Logits for this minibatch

        # Compute the loss value for this minibatch.
        train_loss_value = loss_fn(y, logits)

    grads = tape.gradient(train_loss_value, model.trainable_weights)
    optimizer.apply_gradients(zip(grads, model.trainable_weights))
    train_acc_metric.update_state(y, logits)
    return train_loss_value

And,

for epoch in range(epochs):
    # Iterate over the batches of the dataset.
    for step, (x_batch_train, y_batch_train) in enumerate(train_generator):
        train_loss_value = train_step(x_batch_train, y_batch_train)

    # Reset metrics at the end of each epoch
    train_acc_metric.reset_states()

I suspect, I am not handling properly the computation of loss in here: loss_fn(y, logits). y has 3 output, logits has also 3 output.
Using model.compile is simply straight-forward, just passing the loss function in the loss argument. But what to do in scratch training. The 3 output (though are co-related) needs to trained separately.
Asked SO, nobody knows.

The logits = model(x, training=True) has 3 output. So to calculate the loss function separately (I think) we need to unpack it. loss_one, loss_two, loss_thr = model(x). And next, maybe like this:
train_loss_value_one = loss_fn(y[0], loss_one)
train_loss_value_two = loss_fn(y[1], loss_two)
train_loss_value_thr = loss_fn(y[2], loss_thr)

I'm feeling I'm definitively missing something.

@fchollet


Integration Test - Release - 2019/02/13 18:42:36

Auto create for integration test. IssueCommandFlow

#pri1

Just type '#backlog'

#pri2

#backlog

#please-close