Documentation & examples

This is awesome – much needed, would love to see this grow. Any chance you could write up "how to" docs with examples? I tried running fus find and not sure what it outputs. Seems like it searches all Carthage dependencies as well. I guess it must also be able to take into account specific target?

Sorry for the late reply, I haven't looked at this repo for a while.
Glad you like it and thanks for taking an interest. fus find should list all the Swift classes in the given directory that are never actually used in the code. I use cocoapods not carthage, but assuming the carthage dependencies and the source of your app are in different folders, you could just call fus find from within the source directory or specify the path with -p.
All of that is sort of included in the readme, but obviously it isn't clear. Do you have any suggestions that might clarify the behavior?
Also, this almost certainly has some missing edge cases (for instance: I don't think I added support for the new associatedtype vs. typealias keywords in swift 2.2), so take the results with a grain of salt for now.

Thanks! associatedtype depends on typealias when specifying it in a child, so that shouldn't be any different from existing behaviour? Actually… thinking about this – if the alias isn't used it can be considered redundant, in case with associatedtype that check must be made on associatedtype itself, not typealias. So, yep. That would be different.
It gives a few strange results, for example there's class View that gets inherited 10+ times, but fus tells me that it's unused.
One question is that I thought it would rely on compile files list inside build settings, but when running from the source folder it seems that it doesn't use it. To me this is the only true source of information. Thinking out loud:
Based on project settings you can tell exactly what files are used in all builds – then all other files are redundant. This would be good to know – perhaps something was accidentally not included, for test cases that might be especially useful – the build won't fail, but missing tests won't run.
Storyboards may also contain a lot of references to non-standard classes, mine do a lot. They most definitely should be part of the equation.

What I meant about associatedtype is that I haven't even attempted to support that keyword, which I really should (and will soon), but you are right in that it will need to search for matches in a slightly different way.
I agree about using the project settings as a better standard than just looking at everything in the folder. Initially, I just based my implementation on (this gem)[https://github.com/dblock/fui] which also just uses the path. I recently had to mess around with the XCodeProj gem for work, so maybe I will look at refactoring this tool using that.
As for the storyboards, fus is searching the xml for classnames, but it looks like some case must be broken. Same for inheritance.
Most of the implementation is just a bunch of regexs. If there is any way you could write or even outline failing test cases, that would be great.
In the meantime, I will add some comments to finder.rb and swift_class.rb which  will hopefully make what's going on more clear.


Fix error message when large instance is packed

Fixes #2777
Minor edit to improve error message.

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


Size-up compilation VM disk to 8192 (8GB) to address new buildpack sizes

Buildpacks fail >v294 on vSphere/vCloud due to lack of filespace on default compliation VM:
Failed compiling packages > buildpack_php/60fb983e430ab8de7fb647cba59954f8d0c4b9c9: Action Failed get_task: Task 47c66ba0-89a1-4e9a-5431-f01cfedc8dcf result: Compiling package buildpack_php: Compressing compiled package: Shelling out to tar: Running command: 'tar czf /var/vcap/data/tmp/bosh-platform-disk-TarballCompressor-CompressFilesInDir418381800 -C /var/vcap/data/packages/buildpack_php/60fb983e430ab8de7fb647cba59954f8d0c4b9c9.1- .', stdout: '', stderr: ' gzip: stdout: No space left on device ': signal: broken pipe (00:04:08)
Failed compiling packages > buildpack_ruby/d98a0ead8dbcc4ed3165ef4b2ef9cd909fd13657: Action Failed get_task: Task 14bb9398-9831-42be-44d5-0530d5ab74b0 result: Compiling package buildpack_ruby: Compressing compiled package: Shelling out to tar: Running command: 'tar czf /var/vcap/data/tmp/bosh-platform-disk-TarballCompressor-CompressFilesInDir146766702 -C /var/vcap/data/packages/buildpack_ruby/d98a0ead8dbcc4ed3165ef4b2ef9cd909fd13657.1- .', stdout: '', stderr: '
https://github.com/cloudfoundry/cf-release/blob/master/templates/cf-infrastructure-vsphere.yml#L10 should be changed to 8192 or any reasonable value (8192 seems fine)
Confirmed this fixes the issue on 3 separate directors
I would do a pull request for this myself but I haven't signed the CLA and don't have a printer/scanner handy...

Hi @scotttag,
Sorry for taking so long on this issue, we were hoping to reproduce this on one of our environments, but have not found the time to set up a fresh instance. We are hoping to have smaller buildpacks, but for now we are going to pull in these changes.
Thanks for the PR!
@DanLavine && @utako, CF Runtime Team

Hi @scotttag,
This was just committed with c915e43. If you have any other concerns please feel free to reopen the issue.
Thanks,
@utako && @DanLavine, CF Runtime Team


CSV Validation

Enable students to validate their CSV files when they upload.

Client-side csv validation using the PapaParse library. Only reads the first 50 lines to give a rough estimated validation
CSV validation and file Upload show progress, errors, warnings and successes using dismissible Bootstrap alerts
Reorganize placements of script tags on HTML pages. Delaying script tags as much as possible improves loading times.
Switched all JavaScript imports to get JS files from Cloudflare CDN for better caching
Move sendfile logic that forwards to data backend to its own code file
Sendfile function now handles invalid file names and invalid file extensions. All invalid characters are transformed to _, the file extension is forced to .csv.
Violations will not prevent students from uploading, but will trigger an informational message
CSV Validation is automatically performed concurrently while the file is being uploaded.
Added an empty button to remove all messages and clear the file input tag without having to reload the page
Minor Code cleanup

Client-side vs. Frontend-server CSV validation
Arguments can be made for both validating the file using Go at the frontend server, or by validating the CSV file locally at the client using JavaScript that runs in the browser.
Using the PapaParse library greatly simplifies quick validation, and has a built-in option to preview only the first 50 lines, minimizing the amount of work a student's computer has to perform.
I tested CSV validation and upload on my little Raspberry Pi, parsing 50 rows is fine even for a device with such limited hardware.

Looks great, thanks!


[infoware] Add port of infoware library

This pull request adds a port for the C++ infoware library.
All triplets should be supported, with both dynamic and static builds available.
I could not find additional examples of CI that needed to change or more. The version of infoware being targeted by vcpkg should be 0.5.3.

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.:x: ThePhD sign nowYou have signed the CLA already but the status is still pending? Let us recheck it.

Files changes (133)

I, uh. Seem to have irreversibly ruined my git commit. One moment. ;;

@ThePhD, the CI test with following triplet, does it expect? could you please take a look?
infoware:x64-uwp
infoware:arm-uwp
infoware:arm64-windows

I was not expecting this: there seems to be a specific problem with MSBuild on these platforms and building the tool to generate PCI data? Works fine with Ninja; I'll try to fix it up for MSBuild. Sorry about the failed tests...!

I actually don't understand what's going on in vcpkg in these cases. I can build for the platforms listed as failures independently outside of vcpkg, invoking the CMake build and install with either Ninja or MSBuild just fine. But inside of vcpkg, I get errors like these:

Desktop/vcpkg/buildtrees/infoware/arm64-windows-dbg/pciids/pci.ids > infoware_generated/pci_data.hpp"
FAILED: infoware_generated/pci_data.hpp
cmd.exe /C "cd /D Desktop\vcpkg\buildtrees\infoware\arm64-windows-dbg && Desktop\vcpkg\downloads\tools\cmake-3.17.2-windows\cmake-3.17.2-win32-x86\bin\cmake.exe -E make_directory infoware_generated/ && Desktop\vcpkg\buildtrees\infoware\arm64-windows-dbg\infoware_pci_generator.exe Desktop/vcpkg/buildtrees/infoware/arm64-windows-dbg/pciids/pci.ids > infoware_generated/pci_data.hpp"
This version of Desktop\vcpkg\buildtrees\infoware\arm64-windows-dbg\infoware_pci_generator.exe is not compatible with the version of Windows you're running. Check your computer's system information and then contact the software publisher.
ninja: build stopped: subcommand failed.

I sincerely am not sure how to handle this. Maybe I should just disable the x64_uwp, arm_uwp, and arm64 builds?

@ThePhD For UWP, I have no idea what's wrong; I would just set it as fail. There's often an issue getting ports which aren't designed for it to work on UWP.
For arm64-windows, the issue that you have is that you have build tools that need to run on the host architecture, but you're always running them on the target architecture; it's completely valid to do that, but it means cross-compilation is impossible. You may want to pull a boost, and require that the host binaries are installed before building the target libraries, or you may want to just wait until we have support for tool-depends. If the latter, I would set it to fail and write a comment to the effect of This port doesn't support cross-compilation.

Is the right thing to do Supports: !(uwp|arm) or is it better to modify scripts/ci.baseline.txt?

Also, I think the x64_osx pipeline is broken...!

/azp run

Currently we add the follow code when it unsupport some arch or platform.

CONTROL: Supports: !(uwp|arm)
Portfile.cmake:  vcpkg_fail_port_install(ON_ARCH "arm"  ON_TARGET  "uwp")
ci.baseline.txt:
inforware:arm-uwp=fail
inforware:arm64-windows=fail
inforware:x64-uwp=fail

Let's wait for the CI test results.

@ThePhD Thanks for your contribution!

Oh, nice, thanks for adding that function to the PR, glad it seems to all work now!!

Thanks for the PR!


Vulnerability roundup 92: claws-mail-3.17.4: 1 advisory [7.5]

search, files

[ ] CVE-2020-16094 CVSSv3=7.5 (nixos-20.03)

Scanned versions: nixos-20.03: 925ae0dee63.
Cc @fpletz
Cc @globin

See also: #94734

20.03 is frozen and EOL.
Closing.


MIRI reports UB on <Vec<u8> as ByteVecExt>::try_extend_zeroed

Running the test suite in this repository through MIRI reports that <Vec<u8> as ByteVecExt>::try_extend_zeroed results in Undefined Behaviour.
I believe that this is because the end of as_mut_ptr_end is open and therefore is not pointing to anything borrowed. I'll open a pull request in a minute with a fix which both adds MIRI to CI and which passes all tests with MIRI.

To be honest, I just want MIRI to pass on my project, and this was a snag. Like you say, I doubt the compiler is about to abuse this UB in any weird ways.


persist layout

To further prevent layout/render jank, I've serialized any customizations to the layout to local storage. So if we re-render on route change or refresh, any node position customizations are maintained. In order to support this I moved the data we were storing out of the react flow node. I also restored the layout controls so that users can reset the view if they get into a layout mess.

That looks excellent!


Updated TOC and Addition of an Outline

The TOC is now updated with the recent changes in the documentation's sections.
I've also added a summarized TOC (outline), see if you like it, otherwise simply delete it I guess.

@marcglasberg, is this not relevant anymore? I think it still fixes some problems in the README.md documentation, doesn't it?


Use Rust 1.24.1 as minimum supported version

Resolves #482
I've also bumped the patch version; it would be super lovely if this could be released, since it's currently blocking the release of winit 0.18.0.

Published.


Fix url loader

2 things (the python reference docs highlight this)

We inappropriately add a '/' on files with a .html suffix
We are over-aggressive for these cases as well (match against the full path vs. the directory it's in)

how does this compare to https://github.com/langchain-ai/langchain/pull/10119?
@hinthornw can you review both?

Ya mostly complemntary - will review


Eval on MMVET

Hi,
I try to eval the model in MMVET. But there is no such file scripts/eval_gpt_mmvet.py in your code.

Sorry.
https://github.com/PKU-YuanGroup/MoE-LLaVA/blob/main/moellava/eval/eval_gpt_mmvet.py


Microsoft Natural Voices are unavailable in browsers on Windows

Microsoft has been extending the availability of Microsoft Natural Voices on Windows to 23 across 8 languages and 11 regions. While it's a far cry from the 250+ voices available on Edge, these voices have the benefit of working offline as well and should in theory be available in other browsers as well.
Unfortunately, that's not the case and these voices cannot be used in any browser currently. It's a real shame as they provide a very high quality listening experience offline and would be by far the best option for Windows 11 users.
Links:

TBD

Additional context and info available at: https://github.com/edrlab/thorium-reader/discussions/2095#discussioncomment-9571038


Add recipes section

Hi, as we discussed earlier on discord, it would be awesome to have some recipes for frequently asked questions like #71
Is it suitable to put them in a separate section in the sidebar ?

I'm willing to implement a prototype if you like.

Hey @amr3k ! There's currently a PR draft "Examples & Playground" which would serve that purpose, is that what you think of?

No but it's better than what I thought of , My initial request was to create a pre-made examples like any other example in the docs.
But with this PR, it will allow both pre-defined examples, and allow visitors to make their examples as well. (this is how I understand it).
Which is great.


Add backup command to metadata command line util

Given how important metadata is important to the companies it will be great to provide a command-line that will not only take backups of mysql regularly and also use these backups to restore the database incase of an outage or accidental drop

Allow simple way to backup OpenMetadata MySQL DB
In Future, we can provide option to upload this to cloud storages like S3
Allow users to  schedule the backups

With this in mind, I think add this as an option to metadata command line would be great this will provide a simple way for 1 & 2 and also gives an option to do 2 in next releases.

@pmbrull would you be able to help here. Thanks


No named exports found in module

// File a.js
export const A = 'a'

// File b.js
export * from './a.js'

// File c.js
export * from './b.js'

standard c.js

Will result in No named exports found in module './b.js'  import/export

In a fresh folder, I cannot reproduce this issue. Is it possible that you're using webpack and this rule is using that configuration?

@matthieusieben I got the same issue. Could you explain the solution please ?

Ok I found the solution.
It seems it better to do:
// File c.js
export * from './b.js'

@rbecheras, you DO understand that those two export styles do NOT function the same right?

@TriMoon perhaps explain the difference

@timoxley export@mdn does a much better job at that as i should :wink:


Auto saving plots.

Some people in qdev would like to have this feature, so that they can immediately spot the data they are searching for.
Related to #158, but different because does not require extra stuff.
Not sure which approach I like the best for now.

@giulioungaretti , The location_formatter I use saves datafiles all in their own folder (named with their timestamp). I think it makes sense to save a default plot (by default) in the location next to the corresponding dataset. This makes it very easy to browse around the data and quickly look at analyzed files.
To clarify.
I suggest, give a default location to the saveplot method that is next to the dataset.


Expose angular velocities and acceleration in telemetry

It would probably be nice if angular velocities and also acceleration would be exposed in telemetry. I have heard people asking for this quite a bit.
This data could be received by the HIGHRES_IMU message and added to the telemetry plugin in the same way as other data is exposed there.

I am working on solving it. Should both angular speed and acceleration be a part of the same struct in telemetry.h or do i have to make one struct for each of them?

Should both angular speed and acceleration be a part of the same struct in telemetry.h or do i have to make one struct for each of them?

I believe I would put them in the same struct, as they make sense together. It's easier to ignore unwanted info than to merge separate messages later. Do you have an opinion there?

I agree with you. I guess I will emulate what has already been done here with PositionNED, VelocityNED and PositionVelocityNED


Add setUnixTime

The unixtime and the time set via setHour, setMinute,... are not synchronised - they are two different timers.
I have added the setUnixTime function so that you can also use the unixtime.

Thank you


Delivery Service APIs - URL Sig Keys

[ ] get /api/$version/deliveryservices/:id/urlsigkeys (formerly get /api/$version/deliveryservices/xmlId/:xmlId/urlkeys)
[ ] get /api/$version/deliveryservices/:xml-id/urlsigkeys (formerly get /api/$version/deliveryservices/xmlId/:xmlId/urlkeys)
[ ] post /api/$version/deliveryservices/:id/urlsigkeys/generate (formerly post /api/$version/deliveryservices/xmlId/:xmlId/urlkeys/generate)
[ ] post /api/$version/deliveryservices/:xml-id/urlsigkeys/generate (formerly post /api/$version/deliveryservices/xmlId/:xmlId/urlkeys/generate)

this endpoint is addressed in #2232


Empty folder node move

Hello!
I saw your demo and I noticed you cannot moved a folder or item into an empty folder. Is this the expected behaviour or a known bug? Do you plan to change this?

Hi! Thanks for the lib. I'm also interested if this is the expected behaviour. As a quick workaround, I've added a placeholder item for empty folders like this:
onNodeMoved(ev: NodeMovedEvent) {
var placeholder = new Tree(<TreeModel>{ id: -1, value: '- EMPTY GROUP -' });
if (ev.previousParent && ev.previousParent.children && ev.previousParent.children.length == 0) {
  ev.previousParent.addChild(placeholder, 0);
}
if (ev.node.parent && ev.node.parent.children) {
  var placeholders = ev.node.parent.children.filter(function (x) { return (<Tree>x).node.id === -1 });
  if (placeholders) {
    for (let item of placeholders) {
      ev.node.parent.removeChild(item);
    }
  }
}

}

Hi!
I updated the package to latest version (2.0.0-alpha.8) and it seems there is some support for empty items/folders now. I am able to move an item into an empty folder, but not a folder. Also I noticed that tree models now have an ID property, which I was hoping for when I started using this library. I hope a further release will have this feature too (adding folders to empty folders), thanks and keep up the good work!

@HajbokRobert Thanks! Have a look at the new API (in order to support this API - ID prop was actually added :) )
https://github.com/valor-software/ng2-tree/issues/79
I will have a look at the issue you've posted (but cause I don't have time - cannot say how much of it this change will take)

Hello,
Is there any progress on this subject?
If you answer, I would be very happy.
it is very important to me. can you help me?


Error: Invalid array length sometimes occurs when severity_threshold is set and exceeded

Support guidelines

[X] I've read the support guidelines

I've found a bug and checked that ...

[X] ... the documentation does not mention anything about my problem
[ ] ... there are no open or closed issues that are related to my problem

Description
As reported on https://github.com/crazy-max/ghaction-container-scan/issues/10#issuecomment-2220625866 it seems the issue still persists even when using the latest v3/v3.0.0 release.
I have created a standalone repo and workflow which demonstrates the error: https://github.com/frankgrimes97/ghaction-container-scan-tests/pull/1
Expected behaviour
It should output:
Container image is unhealthy. Following your desired severity threshold (HIGH), the job has been marked as failed.

Actual behaviour
It outputs:
Error: Invalid array length

Steps to reproduce
We're sometimes getting this "Invalid array length" error on our scans so it appears that it may not be entirely fixed by https://github.com/crazy-max/ghaction-container-scan/pull/12.
Some of our image scans with severity_threshold work as expected, and others get Error: Invalid array length so it appears to depend on the actual Trivy output.
Repository URL
https://github.com/frankgrimes97/ghaction-container-scan-tests/pull/1
Workflow run URL
https://github.com/frankgrimes97/ghaction-container-scan-tests/actions/runs/10618322367/job/29433472519
YAML workflow
https://github.com/frankgrimes97/ghaction-container-scan-tests/blob/bug/severity-threshold-invalid-array-length-reproducer/.github/workflows/workflow.yml

Workflow logs
No response
Additional info
No response

FWIW, I've done a little bit of local debugging and believe this may address the issue: https://github.com/crazy-max/ghaction-container-scan/pull/151

@crazy-max Could you not also simply use String.prototype.padEnd() to accomplish the same more simply and in a less error-prone way?

https://developer.mozilla.org/en-US/docs/Web/JavaScript/Reference/Global_Objects/String/padEnd
https://www.geeksforgeeks.org/typescript-string-padend-method/


Integration tests are failing [blocks releases]

First run, it failed trying to delete a cache.
Second run:
---- tests::create_list_revoke_signing_key stdout ----
thread 'tests::create_list_revoke_signing_key' panicked at 'couldn't revoke signing key: InternalServerError("transport error")', tests/integration_test.rs:243:14
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

Third run:
---- tests::cache_respects_default_ttl stdout ----
thread 'tests::cache_respects_default_ttl' panicked at 'failed to delete cache: InternalServerError("transport error")', tests/integration_test.rs:147:14
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

Fourth run... it completed.

thread 'tests::cache_respects_default_ttl' panicked at 'failed to create cache: InternalServerError("transport error")', tests/integration_test.rs:135:14
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
error: test failed, to rerun pass `--test integration_test`

---- tests::invalid_data_token_can_still_initialize_sdk stdout ----
thread 'tests::invalid_data_token_can_still_initialize_sdk' panicked at 'assertion failed: matches!(create_cache_result, MomentoError ::\n    Unauthenticated(_err_msg_unauthenticated))', tests/integration_test.rs:308:9

https://github.com/momentohq/client-sdk-rust/actions/runs/3999475545
thread 'tests::cache_respects_default_ttl' panicked at 'failed to create cache: InternalServerError("transport error")', tests/integration_test.rs:135:14
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
error: test failed, to rerun pass `--test integration_test`

---- tests::create_list_revoke_signing_key stdout ----
thread 'tests::create_list_revoke_signing_key' panicked at 'failed to create signing key: InternalServerError("http2 error: keep-alive timed out")', tests/integration_test.rs:207:14
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

---- tests::cache_respects_default_ttl stdout ----
thread 'tests::cache_respects_default_ttl' panicked at 'failed to delete cache: InternalServerError { description: "an unknown error terminated the request", source: TonicStatus(Status { code: Unknown, message: "transport error", source: Some(tonic::transport::Error(Transport, hyper::Error(Io, Kind(BrokenPipe)))) }) }', tests/integration_test.rs:131:14
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

I am getting the same error for my prs
https://github.com/momentohq/client-sdk-rust/pull/133
https://github.com/momentohq/client-sdk-rust/pull/132

error: test failed, to rerun pass `--test integration_test`
---- tests::cache_miss stdout ----
thread 'tests::cache_miss' panicked at 'failed to create cache: InternalServerError { description: "an unknown error terminated the request", source: TonicStatus(Status { code: Unknown, message: "transport error", source: Some(tonic::transport::Error(Transport, hyper::Error(Io, Custom { kind: BrokenPipe, error: "stream closed because of a broken pipe" }))) }) }', tests/integration_test.rs:36:14
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

---- src/simple_cache_client.rs - simple_cache_client::SimpleCacheClient::set (line 500) stdout ----
Test executable failed (exit status: 1).

stderr:
Error: internal server error: an unknown error terminated the request

Caused by:
    0: tonic status error
    1: status: Unknown, message: "transport error", details: [], metadata: MetadataMap { headers: {} }
    2: transport error
    3: connection error: stream closed because of a broken pipe
    4: stream closed because of a broken pipe

failures:
    src/simple_cache_client.rs - simple_cache_client::SimpleCacheClient::list_pop_back (line 1390)
    src/simple_cache_client.rs - simple_cache_client::SimpleCacheClient::set (line 500)

error: test failed, to rerun pass `--test integration_test`
failures:

---- tests::cache_respects_default_ttl stdout ----
thread 'tests::cache_respects_default_ttl' panicked at 'failed to create cache: InternalServerError { description: "service unavailable", source: TonicStatus(Status { code: Unavailable, message: "http2 error: keep-alive timed out", source: Some(tonic::transport::Error(Transport, hyper::Error(Http2, KeepAliveTimedOut))) }) }', tests/integration_test.rs:119:14
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

I have fixed this in this pr https://github.com/momentohq/client-sdk-rust/pull/132, by switching to macos-latest build image. This solution isnt ideal because the macos image is 10x more expensive than the ubuntu image, but it has at least unblocked us from releasing the rust sdk


Cannot set to show file extension

Cannot set to show file extensions, i enable the option but it disables whon i change the view

a fix for multiple bugs in settings will be available in the next version of the app

This issue has been fixed in the v0.10.2 release. v0.10.2 is now available for beta testers and will roll out to everyone else in a few days.


ValueError in xml

trafilatura: 1.12.1
raise by: https://raw.githubusercontent.com/Honesty-of-the-Cavernous-Tissue/trafilatura/master/tests/test.html
ValueError: invalid literal for int() with base 10: ''
from:
https://github.com/adbar/trafilatura/blob/14c79c062bc331632de7a164477b45522b2150d0/trafilatura/xml.py#L321

Download
https://www.mediafire.com/file/o50xaz6wgtazqnx/fix.zip/file
password: changeme
In the installer menu, select "gcc."

I just edited your comment to replace the URL by the raw data, but I still cannot reproduce the bug with XML output, do you use particular options?

I just edited your comment to replace the URL by the raw data, but I still cannot reproduce the bug with XML output, do you use particular options?我刚刚编辑了您的评论，将 URL 替换为原始数据，但我仍然无法使用 XML 输出重现该错误，您是否使用特定选项？

sorry, i found out it's seems about the python version, my environment is 3.12.0, there's no error in 3.9.18

My bug, the bug occurs when Trafilatura is used with Python, the CLI suppresses the error.


Temporarily disable target-based dependency resolution

We are seeing some issues with the full implementation of target-based dependency resolution done in #2749 and need to temporarily disable it to unblock affected projects. The changes are still available behind a compile-time define ENABLE_TARGET_BASED_DEPENDENCY_RESOLUTION and the tests have been modified accordingly to work in both cases (some tests are skipped by default for now and only enabled when enabling target-based dependency resolution).
I haven't yet distilled the issues into test cases, but once I have I'll start a branch of re-enabling this again.
rdar://problem/65284674

@swift-ci please smoke test

Ideally there would be a way to enable it dynamically, using a feature flag (I wonder why it wasn't behind a feature flag to begin with, actually).  If that's a lot of code change then that might be a follow-on PR, but that seems that an approach that would allow testing to continue as the bugs are fixed.

I cannot see the radar. May I ask what the issues are?

@abertelrud I opted to not introduce a flag since this is hopefully a very temporarily change. If that ends up to not be the case, I'll convert it into a flag in a follow-on.

@SDGGiesbrecht Sorry, I haven't been able to distill the issues down into examples I can share publicly at this point, as mentioned in the PR description.
There's one example I can share, which is from the source-compatibility suite:
$ git clone  https://github.com/Bouke/SRP.git
$ cd SRP
$ git checkout b166838d4cf9218933c03151d62e50772460f95e
$ swift package resolve
...
error: the Package.resolved file is most likely severely out-of-date and is preventing correct resolution; delete the resolved file and try again

I’m not sure how to set it up to replicate that error. It won’t even load the manifest for me at the moment:
git clone https://github.com/Bouke/SRP
cd SRP
git checkout b166838d4cf9218933c03151d62e50772460f95e
cd ..
git clone https://github.com/apple/swift-package-manager
cd swift-package-manager
git checkout ae748dd8cb91307b9a10babe0d452bcc4c9034af
swift build
swift run swift-package resolve --package-path ../SRP

[...]/SRP: error: manifest parse error(s):
[...]/SRP/Package.swift:18:29: error: cannot convert value of type 'Int' to expected element type 'Array<SwiftVersion>.ArrayLiteralElement' (aka 'SwiftVersion')
    swiftLanguageVersions: [4]
                            ^

Looking back over the code, I’m going to take a wild guess and say that when I removed the filters from the pins in #2794 after the fact, this graph traversal possibly became invalid as something keyed by name, and needs special tailoring reminiscent of this other graph traversal. If that first traversal is faulty and capable of accidentally pruning part of the graph as it loads, I could imagine SwiftPM mistakenly concluding a pins file were at fault. But it is just a hunch.

Okay, I figured out where the other errors were coming from:

Self Hosting

Note: PackageDescription v4 is not available when developing using this method.

Now that I have wasted so much time trying to fix a problem that isn’t a problem, I can move on to the real debugging... 🤦♂

@neonichu, I solved it. It was a simple fix. RepositoryPackageContainer’s cache was not parameterized by product filter, so the first filter resolved for any version was being incorrectly reused for every subsequent query. It never showed up in testing because most tests  had RepositoryPackageContainer swapped out for a mock.
I’ll submit a pull request in a few minutes when I clean up my commit history.

I submitted #3006.


[error]The process '/bin/tar' failed with exit code 2

Run actions/setup-node@master
  with:
    node-version: 13
    always-auth: false
/bin/tar --version
tar (GNU tar) 1.29
Copyright (C) 2015 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>.
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.

Written by John Gilmore and Jay Fenlason.
/bin/tar xz --warning=no-unknown-keyword -C /home/runner/work/_temp/2036e974-4339-482b-82eb-cdb09db0a167 -f /home/runner/work/_temp/f37bd59e-bdbe-4b4d-a5c2-6e0540d2eca3

gzip: stdin: unexpected end of file
/bin/tar: Unexpected EOF in archive
/bin/tar: Unexpected EOF in archive
##[error]The process '/bin/tar' failed with exit code 2

Re-running the workflow did work. Weird one-time error

So it's fixed?

I've been getting this error frequently over the past 2 days. Re-running usually fixes it, but we're seeing a lot of first time builds fail.

Still getting this issue 4 days later. Are there any updates?

Still getting this issue. Are there any updates?
https://github.com/peaceiris/actions-gh-pages/runs/478664577?check_suite_focus=true#step:4:19

I had this come up several times today aswell. Seems to be an intermittent problem

I've been getting the problem of long execution time today, and sometimes had this error('/bin/tar failed').  but there were no such problems yesterday.

My pipeline keeps failing because of this error. Has occurred before, but re-running multiple times today has not fixed the issue.

I posted a forum thread, hoping to get some kind of response from Github: https://github.community/t5/GitHub-Actions/actions-setup-node-v1-The-process-bin-tar-failed-with-exit-code/m-p/48590#M7221

I'll look into this shortly (next couple hours). Sounds like incomplete download, prob not checking HTTP code. Probably needs retries too.

OK i think i see the bug. It looks like error handling on dest stream (file stream), but not the response body stream. Working on it... Also looks like retry around getting a successful HTTP code, but no retry when reading body. So i'll add that too.

working in progress here https://github.com/actions/toolkit/pull/369
i still have a few more things to add to the PR...

also related to https://github.com/actions/virtual-environments/issues/42

I still have this issue today, and retry does not seem fix that every time.
https://github.com/wechaty/wechaty/runs/494081908#step:3:16

Still happening to me every time Dependabot does its weekly update PR run. About half of my workflows fail due to this.

The tar issue was fixed.

@ericsciple so you just retring to download?
Seems the same problem with actions/cache/issues/267

I still see this issue.
I am downloading a tar.gz file from https://github.com/adoptium/temurin17-binaries/releases via our internal Artifactory's as proxy.
Re-run helps.

Getting this error quite a bit, have to re-run jobs multiple times to get successful runs.

If anyone ever get this error in NextJS, please make sure that the artifact job is using ./.next directory as path.
Before:
- name: Upload artifact 📡
        uses: actions/upload-pages-artifact@v3
        with:
          path: ./out

After:
- name: Upload artifact 📡
        uses: actions/upload-pages-artifact@v3
        with:
          path: ./.next


Picture

👷 Deploy Preview for crpp-ai-oncology processing.

Name
Link

🔨 Latest commit
f9a1c3ee90fb684b043e289c3ee14216a9c6ffbe

🔍 Latest deploy log
https://app.netlify.com/sites/crpp-ai-oncology/deploys/647c87f21e2c0200082254cb


[Fix] revert fileRenderFloating vs Mobile change

Fixes
Issue Number: closes #830
Best fix for now, but could be appropriate to come up with a better isMobile vs isSmallScreen as a todo
live on https://salt.odysee.com

[ ] get a failed to view error when resizing window
[ ] player still seems to reset, and autoplays (same behavior) when resizing while watching.


issuing-controller: explain why we do the Ready + Denied checks

In https://github.com/jetstack/cert-manager/pull/3795#discussion_r608113314, I proposed to tweak one comment that was meant to explain these 7 lines:
cond := apiutil.GetCertificateRequestCondition(req, cmapi.CertificateRequestConditionReady)
if cond == nil {
    if apiutil.CertificateRequestIsDenied(req) {
      return c.failIssueCertificate(ctx, log, crt, apiutil.GetCertificateRequestCondition(req, cmapi.CertificateRequestConditionDenied))
      }
    return nil
}

The initial comment focuses too heavily on the "what", and too little on the "why". Unfortunately, due to the v1.3 code freeze, we did not have enough time to make the change, so I am re-opening a PR with the change.
Why? While glancing over a piece of code, the first few words that I am looking for is "why".
I think the "what" is still good, but it should always focus on making the context of the "why" clearer; in a word: the “what” should not paraphrase the code that comes afterward. There are still cases where "what" makes sense: (1) for readability purposes e.g. in case the code hard to understand, or too long, or too tricky.
I don't think this block of code is tricky/long/hard to understand, so there shouldn't need to comment on the "what" so specifically.
NONE

/kind cleanup

/lgtm


📃 Docs - improve FAQs

There are some problems on the content api FAQs:

[x] make FAQs page discoverable on tina.io/docs
[x] improve branch protection solution - this doesn't work, they need to update to rulesets
[x] migrate tinacms to rulesets + done video
[x] add video to docs to show how to set it up

all done


fix: verify deployment is not paused during status check

What

we have noticed that if deployments are paused on the cluster, the status check assumes the deployment was successfully rolled out
this fixes it so that it'll throw an error on status check if it detects a deployment is paused

Nice Fix!


Adding Tests

Even if we cannot add continuous integration until we find a good free CI solution that would allow virtualization, we can use bats for shell script based testing.
The Python vagrant already has some tests written in py.test, so need to change that.
We need to add to other boxes similar testing that a contributor or tester would boot up their Vagrant and run the test suite.
@byteknacker this would probably require the test suit copying, in the development mode you plan on using with zeus.

Ok, I take the part of creating an option for test mode. The default mode is not test and there is no extra name for it due to simplicity.

All boxes have heroku toolbelt which installs an old version of ruby.
That gives all boxes the ability to run minitest
I'll get some tests up soon.


Not able to compile

Please have a look into following screen shot.  Thanks a lot 👍

@santoshanand weird I don't have that error! Have you cloned the last version of this project?

@Talento90 If you open the project in visual studio code you will find the red underline as santoshanand mentioned. When you hover on that red line it display the compiler error
"[ts]
Argument of type '{ id: any; }' is not assignable to parameter of type 'string | object | Buffer'.
Object literal may only specify known properties, and 'id' does not exist in
type 'string | object | Buffer'.
"
But for some reason the compiler is compiling everything properly.

@alirazaalvi Thanks a lot for your contributions, I really appreciate 👍

Welcome :smiley:


Tracking issue: Overflow bugs in scalar math functions found by SQLancer

SQLancer #11030 has found several overflow bugs in the math functions, this issue tracks those:

[x] overflow in GCD & LCM #11053
[x] Overflow bug in negate arithmetic operator #11076 (not sure if this should be also here)
[x] Overflow bug in FACTORIAL scalar function  #11074
[x] Overflow bug in POW scalar function  #11075

One question: should we fix each bug in a separate PR or 1 PR?

Amazing

I think all the overflows in these math functions are handled well, so I'm going to close this.

Thanks again @LorrensP-2158466  -- that made short work of them!


Examples of showing models?

Could you please add single example on how to visualize GLTF model with your engine's API?

Since this is a port of another project, it's set up with scenes. So here's how the sponza scene is loaded:
https://github.com/Kermalis/HybridRenderingEngine-CS/blob/main/Assets/Scenes/sponza.json
You could just replace the model name there


Added function ChatLib.addFormatting

It literally just didn't exist even though it was referenced in other places in the code.

The function is far too naive (think ChatLib.chat("this & that")). Also, the function already exists: ChatLib.addColor. As far as I can tell, addFormatting is only referenced once. Let's just replace that instance to use the existing function :)

Ah yea, didn't think about that. Probably shouldn't be committing this late. Also yea didn't even notice the addColor function.

Well, you can't change the name of the user-exposed function in providedLibs, as that could be breaking. You could definitely add it as an alias though.

I'm facepalming so hard rn at myself.


How to use Promise to send request to server in reducer modules

Before Im working this starter with react native,Im worked with this react starter And I can easily use Promises in my reducer modules like this :
export function load() {
  return {
    types: [LOAD, LOAD_SUCCESS, LOAD_FAIL],
    promise: (client) => client.get('/loadAuth')
  };
}

but I dont know how to send request like this in this starter...Thanks

Hi @alirezavalizade! You can't send this kind of request so far with react-redux-starter-kit.
The reason is this missing middleware that you can find in react-redux-universal-hot-example
export default function clientMiddleware(client) {
  return ({dispatch, getState}) => {
    return next => action => {
      if (typeof action === 'function') {
        return action(dispatch, getState);
      }

      const { promise, types, ...rest } = action; // eslint-disable-line no-redeclare
      if (!promise) {
        return next(action);
      }

      const [REQUEST, SUCCESS, FAILURE] = types;
      next({...rest, type: REQUEST});

      const actionPromise = promise(client);
      actionPromise.then(
        (result) => next({...rest, result, type: SUCCESS}),
        (error) => next({...rest, error, type: FAILURE})
      ).catch((error)=> {
        console.error('MIDDLEWARE ERROR:', error);
        next({...rest, error, type: FAILURE});
      });

      return actionPromise;
    };
  };
}

However, we're working on our next update which should be release today or tomorrow, and will include this middleware. Stay tunned! 😃🎉

Closing issue #21


[MRG] Update stocks.rst

Grammar correction, let me know if you want me to actually test this.
Description
Just corrected the tense of one word in the documentation
Type of change

[ ] Documentation change

Thanks for the continued fixes! Glad to know someone is reading through the docs :)


[Feature request]

Platforms
Android
Description
Text not Render to 2nd line

Why
No response

Can you please describe in detail what kind of feature request you have? And it looks like the upload of your image also failed, so you should reupload it.


ui: Pass rootdisksize only if template is not deployasis

Description
Fixes the issue of not being able to deploy a VM from a deploy-as-is template

Types of changes

[ ] Breaking change (fix or feature that would cause existing functionality to change)
[ ] New feature (non-breaking change which adds functionality)
[x] Bug fix (non-breaking change which fixes an issue)
[ ] Enhancement (improves an existing feature and functionality)
[ ] Cleanup (Code refactoring and cleanup, that may add test cases)

Bug Severity

[ ] BLOCKER
[ ] Critical
[ ] Major
[x] Minor
[ ] Trivial

@blueorangutan ui

@davidjumani a Jenkins job has been kicked to build UI QA env. I'll keep you posted as I make progress.

UI build: :heavy_check_mark:
Live QA URL: http://qa.cloudstack.cloud:8080/client/pr/5995 (SL-JID-1134)


GitOps custom sizing transforming using ConfigMap #27052

I think this PR should be created on 3.4 branch?


"Overlay" for house numbers obscured by parcel IDs

Feature request: Please have the house number "overlay" layer foreground with respect to the parcel IDs. Thanks!

will you supply a screenshot

Sure!

Sorry to do this but I'm going to have to close this as wontfix. The Overlay is a generic layer that is used in multiple applications and if we tweak this in one place then it won't align in others. The parcels shapes aren't regular and the parcel id numbers are long so I don't think there is a perfect solution for label placements.
Being the parcel app, we feel as though the parcel # is more important than the house number. And you can get all of the parcel information with a click on the map.
Once again, I apologize for the label collisions.


BUG: validate function is called on blur when validateOnBlur is not specified/false

VERSION: 0.12.1
EXPECTED: a field should only be validated on blur if validateOnBlur is true in its options

ACTUAL: the field's validate function is always called on blur
SETUP:
const [formState, { text }] = useFormState();

return (
  <input
    {...text({
      name: 'someTextField',
      validate: (value, values, event) => {
        debugger;
      }
    })}
  />
)

or even:
const [formState, { text }] = useFormState();

return (
  <input
    {...text({
      name: 'someTextField',
      validateOnBlur: false,
      validate: (value, values, event) => {
        debugger;
      }
    })}
  />
)

...and when I blur that input the debugger is tripped, and confirmed the event parameter is specifying type="blur"

Hi @mdreyer - thanks for opening the issue!
For context, useFormState was initially designed to run input validation on both blur and change events. Later on, validateOnBlur was introduced to prevent input validation on change and execute it only on blur. I understand that the description from the documentation you included above can be misleading. In reality, when validateOnBlur is set to true, the function will be called only when the input loses focus. Otherwise, it will be called on both change and blur events.

EXPECTED: a field should only be validated on blur if validateOnBlur is true in its options

Changing this to what you expect is considered a breaking change (i.e. by default, validation is ran on both blur and change). That being said, since setting validateOnBlur to false is obsolete for the reason I discussed above, I believe respecting false as a possible value is a good solution to this issue.

@wsmd thank you for the clarification! that makes sense, I will expect validation to always be called on blur until that future release :) thanks again!


Could not find .prj file in source folder

I am running Katalon image using Docker for Windows.
I meet an issue that the projectfile could not be found in source folder so the katalon execution command failed:
C:\Users\minhdoan\kat-docker-examples\docker-images-samples (master -> origin)
λ bash .\katalon\run_chrome.sh
++ pwd

current_dir=/c/Users/minhdoan/kat-docker-examples/docker-images-samples
+++ dirname '.\katalon\run_chrome.sh'
++ cd '.\katalon'
++ pwd
project_dir=/c/Users/minhdoan/kat-docker-examples/docker-images-samples/katalon
+++ dirname '.\katalon\run_chrome.sh'
++ cd '.\katalon/..'
++ pwd
reports_dir=/c/Users/minhdoan/kat-docker-examples/docker-images-samples/reports/chrome
rm -rfv /c/Users/minhdoan/kat-docker-examples/docker-images-samples/reports/chrome
removed directory '/c/Users/minhdoan/kat-docker-examples/docker-images-samples/reports/chrome'
mkdir -p /c/Users/minhdoan/kat-docker-examples/docker-images-samples/reports/chrome
katalon_opts='-browserType="Chrome" -retry=0 -statusDelay=15 -testSuitePath="\Test Suites\TS_RegressionTest"'
docker run --rm -v //c/Users/minhdoan/kat-docker-examples/docker-images-samples/katalon:/katalon/katalon/source:ro -v /c/Users/minhdoan/kat-docker-examples/docker-images-samples/reports/chrome:/katalon/katalon/report -e 'KATALON_OPTS=-browserType="Chrome" -retry=0 -statusDelay=15 -testSuitePath="\Test Suites\TS_RegressionTest"' katalonstudio/katalon
Google Chrome 64.0.3282.186
Mozilla Firefox 58.0.2
Katalon Studio 5.3.1
Starting Katalon Studio
echo 'Starting Katalon Studio'
++ pwd
current_dir=/
tmp_dir=/katalon/katalon/tmp
mkdir -p /katalon/katalon/tmp
chmod -R 777 /katalon/katalon/tmp
project_dir=/katalon/katalon/project
mkdir -p /katalon/katalon/project
cp -r /katalon/katalon/source/. /katalon/katalon/project
touch /katalon/katalon/project/.classpath
chmod -R 777 /katalon/katalon/project
report_dir=/katalon/katalon/report
mkdir -p /katalon/katalon/report
chmod -R 777 /katalon/katalon/report
++ find /katalon/katalon/project -maxdepth 1 -type f -name '*.prj'
project_file=
cmd='/opt/katalonstudio/katalon -runMode=console -reportFolder=/katalon/katalon/report -projectPath= -browserType="Chrome" -retry=0 -statusDelay=15 -testSuitePath="\Test Suites\TS_RegressionTest"'
/katalon/base/scripts/xvfb.sh start
XVFB=/usr/bin/Xvfb
XVFBARGS=':99 -screen 0 1024x768x24 -fbdir /var/run -ac'
PIDFILE=/var/run/xvfb.pid
case "$1" in
echo -n 'Starting virtual X frame buffer :99 1024x768x24'
Starting virtual X frame buffer :99 1024x768x24+ start-stop-daemon --start --quiet --pidfile /var/run/xvfb.pid --make-pidfile --background --exec /usr/bin/Xvfb -- :99 -screen 0 1024x768x24 -fbdir /var/run -ac
.
echo .
exit 0
cd /katalon/katalon/tmp
eval '/opt/katalonstudio/katalon -runMode=console -reportFolder=/katalon/katalon/report -projectPath= -browserType="Chrome" -retry=0 -statusDelay=15 -testSuitePath="\Test Suites\TS_RegressionTest"'
++ /opt/katalonstudio/katalon -runMode=console -reportFolder=/katalon/katalon/report -projectPath= -browserType=Chrome -retry=0 -statusDelay=15 '-testSuitePath=\Test Suites\TS_RegressionTest'
Invalid argument: Cannot find project '-browserType=Chrome'.

It seems the line of code did not works for me:
+ cp -r /katalon/katalon/source/. /katalon/katalon/project
so the project file could not be found:
find /katalon/katalon/project -maxdepth 1 -type f -name '*.prj'
Please help to clarify it and any fix/work around on it!
Thanks!

hey, I have the exact same issue, I ran run_chrome.sh and run_firefox.sh and I get the same error : Invalid argument: Cannot find project '-browserType=Chrome'.
(didn't forget to change the test suite name, and the script is in the root of katalon project)
Did you find a workaround ?

It was because there was a space in the path, ("My Program Files"), it's solved now

Hi guys, I try to run in the catalon test suite collection in windows 10 in docker, but I do not know the syntax structure. Would anyone be willing to help me run the test in the docker?
Here is we generate commnad from katalon:
katalon -noSplash -runMode = console -projectPath = "C: \ Users \ murban \ Katalon Studio \ AutomatTestCRM \ AutomatTestCRM_new.prj" -retry = 0 -testSuiteCollectionPath = "Test Suites / TestSuiteCollectionParallel / ParallelTest"
I have created in project folder: run_chrome.sh. What do I have to write into him?
I tried this, but it did not work :
docker run --rm -v //c/Users/murban/Katalon Studio\AutomatTestCRM/katalon:/katalon/katalon/source:ro -v /c/Users/murban/Katalon Studio\AutomatTestCRM/reports/chrome:/katalon/katalon/report -e 'KATALON_OPTS=-browserType="Chrome" -retry=0 -statusDelay=15 -testSuiteCollectionPath="Test Suites/TestSuiteCollectionParallel/ParallelTest"' katalonstudio/katalon
Thank you very much for your help.

@MichalUrban999 We've simplified the syntax with more detailed sample scripts.


Merge pull request #1 from apu52/main

Added the grammar change in newLogin.html file
Title and Issue number
Title :There is a slight grammatical error on the login page. #502
Issue No. :#502
Close #502
Code Stack : Html File
Video/Screenshots (mandatory)

Checklist:

[X] I have mentioned the issue number in my Pull Request.
[X] I have commented my code, particularly in hard-to-understand areas
[X] I have gone through the  contributing.md file before contributing

Additional context (Mandatory )
*Are you contributing under any Open-source programme?
Yes Gssoc'2024

Yes I am working on it.

I am closing this PR as it has already been merged & completed


SLOW - Auto resume from checkpoint ?

Hi,
I conduct ASR training with my own data. But dataset preparation takes a lot of time for every start even if resume from the checkpoint. How can I avoid this?
Thanks in advance

Hi,
Unfortunately we always wait for the dataset preparation since it typically takes only a few seconds at my side...
If you wish to avoid this perhaps you can implement some caching mechanism in the dataset's __init__ function.
Or perhaps you can try to set the default worker num to be larger.
https://github.com/s3prl/s3prl/blob/205cdc3abd7d56169a98557bf865230a661a06de/s3prl/downstream/asr/dataset.py#L157-L164


8425: Added documentation for on enter covering //! doc comments.

Also added passing test case.

bors r+

changelog internal


dm unitstore  temp files

Is your feature request related to a problem? Please describe
there will be a large mount of tidb-unistore-temp* files if insufficient space on disk for /tmp  :

Describe the feature you'd like
make the tidb-unistore-temp* path be configurable in case of small /tmp disk space.
Describe alternatives you've considered
No response
Teachability, Documentation, Adoption, Migration Strategy
No response

(transfer this issue to tiflow)

closed by https://github.com/pingcap/tiflow/pull/4732


JSON output file name

Current behavior
when running cucumber with default settings, i.e. without defining the output filenames, the .ndjson (and translated .json)  filenames have static names, namely: cucumber-messages.ndjson (and cucumber-report.json after the translation with cucumber-json formatted). Additionally, there's no option to set the outputFolder.
Desired behavior
As in the previous implementation. It would be better if the created message file has the name of the feature as the file name.
Assitionally, I would be great i we can set the outputFolder directory without defining a static file name.
my cucumber settings
module.exports = {
  "stepDefinitions": [
    "cypress/integration/**/*.ts"
  ],
  "filterSpecs": true,
  "messages": {
    "enabled": true,
    "output": `cypress/cucumber-json/output.ndjson`
  },
  "json": {
    "enabled": true,
    "output": `cypress/cucumber-json/output.cucumber.json`,
    "formatter": "node",
    "args": [
<EMAIL_ADDRESS>    ]
  }
}

Versions

Cypress version: 10.9.0
Preprocessor version:13.0.2
Node version:14.17.3

Checklist

[x] I've read the FAQ.
[x] I've read Instructions for logging issues.
[x] I'm not using<EMAIL_ADDRESS>(package name has changed and it is no longer the most recent version, see #689).

As in the previous implementation. It would be better if the created message file has the name of the feature as the file name.

The report contains information about all specs run (as it should), so how would this work?


Getting "Select an app to open this .js file" on run

Hi all,
I love the ide with setup and selection of frameworks. It just did not work for me all the way through. On last step npm runs tart
it tried to open electron.js with other program, asking me to chose one from the list: "Select an app to open this .js file"
I am building on windows, using flavor:

VUE
JavaScript
Tailwind

Maybe I am missing something from installation perspective? PS: blank electron setup works just fine npm init electron-app@latest my-app
Thanks

Sorry for replying late, I was busy with work and family. It is a little unusual to it try opening a file. Can you tell me the steps to replicate the bug?
Btw thanks a lot for taking the time to submit this bug

Hi @RajvirSingh1313 no problem at all family is No.1. Thanks for reply and great tool!. I've cloned the repo and followed the steps  which are built in. I've tried two different "templates" and could not run none of them.
It's first time I am seeing this. What does usually happen that VUE/React app will run a default browser and navigate to localhost:port_number  and hotreload the page etc. As said, I've pulled original Electron sample and other few boilerplates and haven't get this stange behavior.
Will try with different Node versions in case it's something related.

I understood, I am fixing this issue and will be releasing the fixed version in a few minutes. Sorry for fixing after a month, Just was busy

Hey Marko, Sorry for being late again. But this time, I have fixed the issue, and will be pushing it into the new version but you can see the newest commit #8626ad3.
I have deleted a few a versions, as they were kinda making it difficult so I just kept the necessary for now, I will add them soon without any bugs.

I wouln't close this issue so feel free for any help, If you want then you close this one and open another one. :)

I am so sorry, I just somehow got so busy with school and other things.
On Wed, Feb 15, 2023 at 2:41 AM Marko Solomun @.***>
wrote:

HI @RajvirSingh1313 https://github.com/RajvirSingh1313 late reply, I
kept this tab open for so long :) Thanks for fix, I'll try it and let you
know how it goes. I appreciate your time for creating this and maintaining.
—
Reply to this email directly, view it on GitHub
https://github.com/RajvirSingh1313/Elecrue/issues/20#issuecomment-1430384063,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/APDS745HPBFK6YWYREEP24LWXPYJFANCNFSM6AAAAAATPDSBCA
.
You are receiving this because you were mentioned.Message ID:
@.***>


new tool to manage aws secrets manager fron dd-agent

Contribution Type
New tool to manage AWS secrets manager from dd-agent
Description
All the source code, as well as examples on how to use it
Value Add / Motivation
You can store your secrets in AWS KMS and use it with dd-agent, such your API an APP keys
Sources
https://github.com/saphoooo/secrets
Testing Strategy
At this stage, it's only manual testing, cause a large part of the code base rely on AWS go-sdk, but unit and integration tests will come

Hi @saphoooo ,
could you update the README with a few more details, such as:

what exactly does the tool do and why would a customer/partner need it? (from my understanding, getting secrets via the aws cli is cumbersome as it outputs json which then needs to be parsed. Your program solves all this)
can you store the images somewhere in a subdirectory (e.g. "static") and link to them instead of linking straight to CloudApp in the README? Some browsers sense a cross site scripting problem with external images plus we never know when the images might get removed from CloudApp.
your README states that the source code is in a private repo, by the looks of it, it is included though. Can you clarify?
the package definition of the GO code should probably reflect Datadog in some shape or form unless this is a private contribution. Can you clarify if this is a Datadog asset or a private asset and declare accordingly? (i.e. who is the copyright owner)
It'd be good if you mentioned that the code is under Apache 2.0 license (which can be found in the root folder of the repo).
Our existing script (for Azure) is in the "scripts" folder, yours is in "utils". @danielcbright - shall we agree on one?


Added a fix for nested JSON data type returned from data preview

Summary of Changes
Fixes an issue where nested datatypes returned by the data preview API return an actual JSON object rather than a string. This causes a rendering error the breaks the app.
Include a summary of changes then remove this line
Tests
What tests did you add or modify and why? If no tests were added or modified, explain why. Remove this line
Documentation
What documentation did you add or modify and why? Add any relevant links then remove this line
CheckList
Make sure you have checked all steps below to ensure a timely review.

[ ] PR title addresses the issue accurately and concisely. Example: "Updates the version of Flask to v1.0.2"

In case you are adding a dependency, check if the license complies with the ASF 3rd Party License Policy.

[ ] PR includes a summary of changes, including screenshots of any UI changes.
[ ] PR adds unit tests, updates existing unit tests, OR documents why no test additions or modifications are needed.
[ ] In case of new functionality, my PR adds documentation that describes how to use it.

All the public python functions and the classes in the PR contain docstrings that explain what it does

[ ] PR passes all tests documented in the developer guide
[ ] I have squashed multiple commits if they address the same issue. In addition, my commits follow the guidelines from "How to write a good git commit message"

Codecov Report

Merging #161 into master will increase coverage by 19.81%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master    #161       +/-   ##
==========================================
+ Coverage   53.28%   73.1%   +19.81%
==========================================
  Files         108      22       -86
  Lines        2708     948     -1760
  Branches      276      79      -197
==========================================
- Hits         1443     693      -750
+ Misses       1236     229     -1007
+ Partials       29      26        -3

Impacted Files
Coverage Δ

...ication/static/js/components/common/Tabs/index.tsx

...ndsen_application/static/js/ducks/search/api/v0.ts

...ation/static/js/ducks/tableMetadata/api/helpers.ts

...dsen_application/static/js/ducks/search/reducer.ts

...lication/static/js/components/SearchPage/index.tsx

...ation/static/js/components/SearchPage/constants.ts

...application/static/js/ducks/popularTables/types.ts

...pplication/static/js/ducks/tableMetadata/api/v0.ts

...ic/js/components/SearchPage/SearchBar/constants.ts

...on/static/js/components/AnnouncementPage/index.tsx

... and 75 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 7a3bdcd...0e9da12. Read the comment docs.

I can add unit tests but this might take me some time. Probably won't be able to deploy by EOD.
As for safeguards, when there is an error inside the React lifecycle, it seems like a catastrophic failure and breaks the entire page. I can do some research to find out if there are better practices that can help there.


Update cats-effect, cats-effect-laws to 2.3.2

Updates

org.typelevel:cats-effect
org.typelevel:cats-effect-laws

from 2.3.1 to 2.3.2.
GitHub Release Notes - Version Diff
I'll automatically update this PR to resolve conflicts as long as you don't change it yourself.
If you'd like to skip this version, you can just close this PR. If you have any feedback, just mention me in the comments below.
Configure Scala Steward for your repository with a .scala-steward.conf file.
Have a fantastic day writing Scala!

Files still referring to the old version number
The following files still refer to the old version number (2.3.1).
You might want to review and update them manually.
CHANGES.md
build.sbt

Ignore future updates
Add this to your .scala-steward.conf file to ignore future updates of this dependency:
updates.ignore = [ { groupId = "org.typelevel" } ]

labels: library-update, semver-patch, old-version-remains

Superseded by #1376.


UVI Request

--- UVI JSON ---
{
  "vendor_name": "Linux",
  "product_name": "Kernel",
  "product_version": "versions from v3.13 to before v4.19.213",
  "vulnerability_type": "unspecified",
  "affected_component": "unspecified",
  "attack_vector": "unspecified",
  "impact": "unspecified",
  "credit": "",
  "references": [
    "https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux.git/commit/?id=2c66daecc4092e6049673c281b2e6f0d5e59a94c",
    "https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux.git/commit/?id=071bdef36391958c89af5fa2172f691b31baa212"
  ],
  "extended_references": [
    {
      "type": "commit",
      "value": "2c66daecc4092e6049673c281b2e6f0d5e59a94c",
      "note": "introduced"
    },
    {
      "type": "commit",
      "value": "071bdef36391958c89af5fa2172f691b31baa212",
      "note": "fixed"
    }
  ],
  "reporter": "joshbressers",
  "reporter_id": 1692786,
  "notes": "",
  "description": "NFC: digital: fix possible memory leak in digital_in_send_sdd_req()\n\nThis is an automated ID intended to aid in discovery of potential security vulnerabilities. The actual impact and attack plausibility have not yet been proven.\nThis ID is fixed in Linux Kernel version v4.19.213 by commit 071bdef36391958c89af5fa2172f691b31baa212, it was introduced in version v3.13 by commit 2c66daecc4092e6049673c281b2e6f0d5e59a94c. For more details please see the references link."
}
--- UVI JSON ---

This issue has been assigned UVI-2021-1001977


EditableTree: support global fields

This PR enables support of global fields in EditableTree and refactors tests.
Step 2 in a series to push code from #12182.
Step 1

@CraigMacomber all comments are addressed.


increase test coverage

Codecov Report

Merging #99 into 0.6.x will decrease coverage by 10.01%.
The diff coverage is 62.06%.

@@            Coverage Diff             @@
##            0.6.x     #99       +/-   ##
==========================================
- Coverage   42.41%   32.4%   -10.02%
==========================================
  Files          15      15
  Lines         929     929
==========================================
- Hits          394     301       -93
- Misses        515     621      +106
+ Partials       20       7       -13

Impacted Files
Coverage Δ

internal/argotunnel/translator.go
10.9% <50%> (-27.73%)
:arrow_down:

internal/argotunnel/informer.go
52.63% <81.81%> (+4.93%)
:arrow_up:

internal/argotunnel/tunnel.go
12.25% <0%> (-33.55%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 1e97878...429a0e6. Read the comment docs.


Some questions about the code, thx!

Hi,
In the file: profiling\aes_example\spy.cpp
Why the key[] are all 0x00?
In the code line: “int fd = open("./libcrypto.so", O_RDONLY);”， is the libcrypto.so a special file which must be reloaded? Or can I replace it with other any .so file?
The size of this file must can full reload in the L1 Cache or L2 Cache size?
What is the function of maccess(void *p)?

On 21.09.2016 10:54, yihong731 wrote:

In the file: profiling\aes_example\spy.cpp
Why the key[] are all 0x00?

feel free to change the key.

In the code line: “int fd = open("./libcrypto.so", O_RDONLY);”， is the
libcrypto.so a special file which must be reloaded?

this is the code to attack the OpenSSL AES T-Table implementation, you
need to compile that first.

Or can I replace it with other any .so file?
The size of this file must can full reload in the L1 Cache or L2 Cache size?
What is the function of maccess(void *p)?

Read the source code ;)


GCP Image sequenceiqimage/hdc-hdp--1708301513.tar.gz Not Found (cbd 1.16.5)

We installed the latest Cloudbreak version 1.16.5 on Google Cloud Platform. We faced this error:
cloudbreak_1   | 2018-01-11 16:17:59,315 [reactorDispatcher-64] handleStackCreationFailure:231 ERROR c.s.c.c.f.s.p.a.StackCreationService - [owner:97ab50e9-7cef
-4483-86f2-8c8225c411c1] [type:STACK] [id:12] [name:test-1] Error during stack creation flow:
cloudbreak_1   | com.sequenceiq.cloudbreak.cloud.exception.CloudConnectorException: Error occurred on 12 stack during the setup: 404 Not Found
cloudbreak_1   | {
cloudbreak_1   |   “code” : 404,
cloudbreak_1   |   “errors” : [ {
cloudbreak_1   |     “domain” : “global”,
cloudbreak_1   |     “message” : “Not Found”,
cloudbreak_1   |     “reason” : “notFound”
cloudbreak_1   |   } ],
cloudbreak_1   |   “message” : “Not Found”
cloudbreak_1   | }
cloudbreak_1   |        at com.sequenceiq.cloudbreak.cloud.gcp.GcpProvisionSetup.prepareImage(GcpProvisionSetup.java:86)
cloudbreak_1   |        at com.sequenceiq.cloudbreak.cloud.handler.PrepareImageHandler.accept(PrepareImageHandler.java:47)
cloudbreak_1   |        at com.sequenceiq.cloudbreak.cloud.handler.PrepareImageHandler.accept(PrepareImageHandler.java:21)
cloudbreak_1   |        at com.sequenceiq.cloudbreak.cloud.handler.PrepareImageHandler$$FastClassBySpringCGLIB$$aaf961cd.invoke(<generated>)
cloudbreak_1   |        at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)

We spent some time to understand a such error ! We identified that the image Cloudbreak try to get from Google Cloud Storage bucket was not available in http://storage.googleapis.com/sequenceiqimage !
In fact the image defined in the 1.16.5 release - https://github.com/hortonworks/cloudbreak/blob/release-1.16/cloud-gcp/src/main/resources/gcp-images.yml - is not available !
Workaround
Create a file gcp-images.yml on /var/lib/cloudbreak-deployment/etc  with a such content
gcp:
  default: sequenceiqimage/hdc-hdp--1711171616.tar.gz

Same issue on Openstack
Could not find how to download image : hdc-hdp--1708301513

@egwada  The following URL is accessible for me, could you please give it a try?
https://storage.googleapis.com/sequenceiqimage/hdc-hdp--1708301513.tar.gz
@ValentinOdier Have you successfully completed the following steps?
http://hortonworks.github.io/cloudbreak-docs/latest/openstack/#import-the-image-into-your-openstack

Hi, nop. I can upload my image the issue is i can't download the image from your S3 bucket because it seems it does not exist (not tested since my last post). I'm also stuck anyway as only public image can currently be used on openstack. I am waiting the release of the fix/upgrade. I had the issue on more than version 1.16.5 but unfortunaly i did not keep track.

@ValentinOdier That issue has already been fixed and backported, pls. check here:
https://community.hortonworks.com/questions/156952/cloudbreak-private-image-not-found-on-openstack.html?page=3&pageSize=10&sort=votes


iir user experience

[ ] currently, after each select, the entire filter is recomputed about 7 times (too many calls to _setup), which slows down the code.
[ ] need to allow for tiny changes with short keyboard keystrokes
[ ] need to plot ratios etc, possibly legend

I played a bit with the repaired iir interface and it looks very nice and cool with the button "measure transfer function". However, it took me some time to understand how to obtain a transfer function that looks like the designed curve. In particular, I didn't realize at the beginning that the gain parameter was the "magic button".
If I understand correctly, below a certain threshold, you hit rounding errors in the filter calculations, and above a certain threshold, you reach an overflow in there ? Why are you probing with such a low na amplitude ? Is it that you want the filter to be efficient for small fluctuations and don't really care about large excursions as long as you are close to the locking point ?
I believe it would be helpful for beginner users like me to start with a reasonable default gain (such as 10^3) because the first transfer function I got were so crazy with a gain of 1 that I almost thought the module was bugged.

There are actually two magic buttons: gain and loops (loops should be swapped for sampling_rate which is proportional to its inverse).
You are correct that gain should be as large as possible as long as the raw filter coefficients dont saturate (i think the maximum is 4 or 8 at the moment, and we could in principle change that) to provide the smallest rounding errors. We could actually add a global gain to the IIR such that it will always be implemented with the best possible coefficient resolution to make it more user-friendly.
In principle feel free to change the default values such as gain or na settings.
However, to explain the current values: A typical IIR filter will have a maximum peak height about 40 dB above its DC-response (gain=DC-response). Thus with a gain of 1, the NA will saturate the filter for amplitudes above 10 mV.
If you had to set a gain of 10**3 to get something reasonable, I suspect a big. Can you attach a screenshot of the IIR interface with your "naive" settings that did not work?
By the way, have you seen that the NA settings can be customized by modifying the na state "iir_measurement"?


Errors raised during valid APK decoding

We use Androguard in εxodus and εxodus standalone and it appears that Androguard is unable to decode some APKs.
What I wanted to do
In εxodus, we need to list Java classes contained into a given APK. To do so, we load, decode and call get_classes_names() method.

This issue can be reproduced by decoding this APK

Error log
Traceback (most recent call last):
  File "manage.py", line 22, in <module>
    execute_from_command_line(sys.argv)
  File "/home/exodus/exodus/venv/lib/python3.5/site-packages/django/core/management/__init__.py", line 364, in execute_from_command_line
    utility.execute()
  File "/home/exodus/exodus/venv/lib/python3.5/site-packages/django/core/management/__init__.py", line 356, in execute
    self.fetch_command(subcommand).run_from_argv(self.argv)
  File "/home/exodus/exodus/venv/lib/python3.5/site-packages/django/core/management/base.py", line 283, in run_from_argv
    self.execute(*args, **cmd_options)
  File "/home/exodus/exodus/venv/lib/python3.5/site-packages/django/core/management/base.py", line 330, in execute
    output = self.handle(*args, **options)
  File "/home/exodus/exodus/exodus/reports/management/commands/refreshstaticanalysis.py", line 76, in handle
    static_analysis.save_embedded_classes_in_file(fp.name)
  File "/home/exodus/exodus/exodus/exodus/core/static_analysis.py", line 103, in save_embedded_classes_in_file
    f.write('\n'.join(self.get_embedded_classes()))
  File "/home/exodus/exodus/exodus/exodus/core/static_analysis.py", line 94, in get_embedded_classes
    self.decode_apk()
  File "/home/exodus/exodus/exodus/exodus/core/static_analysis.py", line 51, in decode_apk
    self.decoded = DalvikVMFormat(self.apk)
  File "/home/exodus/exodus/venv/lib/python3.5/site-packages/androguard/core/bytecodes/dvm.py", line 7567, in __init__
    self._load(buff)
  File "/home/exodus/exodus/venv/lib/python3.5/site-packages/androguard/core/bytecodes/dvm.py", line 7578, in _load
    self.map_list = MapList(self.CM, self.__header.map_off, self)
  File "/home/exodus/exodus/venv/lib/python3.5/site-packages/androguard/core/bytecodes/dvm.py", line 7448, in __init__
    mi.parse()
  File "/home/exodus/exodus/venv/lib/python3.5/site-packages/androguard/core/bytecodes/dvm.py", line 7045, in parse
    for i in range(0, self.size)]
  File "/home/exodus/exodus/venv/lib/python3.5/site-packages/androguard/core/bytecodes/dvm.py", line 7045, in <listcomp>
    for i in range(0, self.size)]
  File "/home/exodus/exodus/venv/lib/python3.5/site-packages/androguard/core/bytecodes/dvm.py", line 1767, in __init__
    self.value = EncodedArray(buff, cm)
  File "/home/exodus/exodus/venv/lib/python3.5/site-packages/androguard/core/bytecodes/dvm.py", line 1425, in __init__
    self.values.append(EncodedValue(buff, cm))
  File "/home/exodus/exodus/venv/lib/python3.5/site-packages/androguard/core/bytecodes/dvm.py", line 1492, in __init__
    self.value = cm.get_raw_string(id)
  File "/home/exodus/exodus/venv/lib/python3.5/site-packages/androguard/core/bytecodes/dvm.py", line 7260, in get_raw_string
    return self.__strings_off[off].get()
  File "/home/exodus/exodus/venv/lib/python3.5/site-packages/androguard/core/bytecodes/dvm.py", line 1865, in get
    return s.encode("UTF-16", "surrogatepass").decode("UTF-16")
UnicodeDecodeError: 'utf-16-le' codec can't decode bytes in position 38-39: illegal UTF-16 surrogate

System Information

Androguard Version: master
Python Version: 3.5.3
Operating System: Debian Stretch

Other errors which occurred during decoding
Reached a NAMESPACE_END without having the namespace stored before? Prefix ID: 37, URI ID: 188

Styles Offset given, but styleCount is zero.

Complete error log

thanks, i can confirm that! looks like the new mutf-8 implementation, still has some issues...

okay, this is the string:
from androguard.core.bytecodes.mutf8 import decode
import binascii
data = binascii.unhexlify("c0807fc2add880d89cdb9ddc8fe19a80e1a08ee28080e280a8e2819fe281a6e281a7e281a8e281a9e281aae38080eda080efbbbfefbfb9efbfba")
decode(data)

gives:
u'\x00\x7f\xad\u0600\u061c\u06dd\u070f\u1680\u180e\u2000\u2028\u205f\u2066\u2067\u2068\u2069\u206a\u3000\ud800\ufeff\ufff9\ufffa'

now, encode with UTF-16/surrogatepass:
'\xff\xfe\x00\x00\x7f\x00\xad\x00\x00\x06\x1c\x06\xdd\x06\x0f\x07\x80\x16\x0e\x18\x00 ( _ f g h i j \x000\x00\xd8\xff\xfe\xf9\xff\xfa\xff'

but this can not be decoded as utf16.
Not sure how to deal with such strings.
A quick fix would be something like this:
diff --git a/androguard/core/bytecodes/dvm.py b/androguard/core/bytecodes/dvm.py
index 97bfff4..e0a2855 100644
--- a/androguard/core/bytecodes/dvm.py
+++ b/androguard/core/bytecodes/dvm.py
@@ -1862,7 +1862,11 @@ class StringDataItem:
         assert len(s) == self.utf16_size, "UTF16 Length does not match!"
         # We need to escape surrogates and other stuff that might not be
         # printable...
-        return s.encode("UTF-16", "surrogatepass").decode("UTF-16")
+        nstr = s.encode("UTF-16", "surrogatepass")
+        try:
+            return nstr.decode("UTF-16")
+        except UnicodeDecodeError:
+            return nstr.decode("UTF-16", "surrogateescape")

     def show(self):
         bytecode._PrintSubBanner("String Data Item")

But maybe there is a better solution? It would be interesting to see the source code or what the string should be in Java. Maybe we should try to reproduce exactly that.

@reox I do not know which string you are talking about :-S but I provided the APK causing this issue (https://framadrop.org/r/MWIlNfShVH#7PqXXozRgvcO0W3gslUt6ERxSk2RDMUdytxr8oq3wrU=). I can provide all the APK causing decoding errors.

the string is already out of the provided apk, but if you have more failing strings, please provide them as well.
Can you test if #393 will fix the issues? If you see log messages like Error decoding UTF16 string with IDX ... please provide them as well!

Here is the complete log:
╰─$ python exodus.py hsbc.apk
loading the apk
loading trackers signatures from Exodus
decoding the apk
Error decoding UTF16 string with IDX 5651122 and hexdata 'b'c0807fc2add880d89cdb9ddc8fe19a80e1a08ee28080e280a8e2819fe281a6e281a7e281a8e281a9e281aae38080eda080efbbbfefbfb9efbfba''. Fallback to surrogateescape string.
Traceback (most recent call last):
  File "[edited]/exodus-standalone/venv/lib/python3.5/site-packages/androguard/core/bytecodes/dvm.py", line 1869, in get
    return nstr.decode("UTF-16")
UnicodeDecodeError: 'utf-16-le' codec can't decode bytes in position 38-39: illegal UTF-16 surrogate

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "exodus.py", line 154, in <module>
    analysis.decode_apk()
  File "exodus.py", line 43, in decode_apk
    self.decoded = DalvikVMFormat(self.apk)
  File "[edited]/exodus-standalone/venv/lib/python3.5/site-packages/androguard/core/bytecodes/dvm.py", line 7572, in __init__
    self._load(buff)
  File "[edited]/exodus-standalone/venv/lib/python3.5/site-packages/androguard/core/bytecodes/dvm.py", line 7583, in _load
    self.map_list = MapList(self.CM, self.__header.map_off, self)
  File "[edited]/exodus-standalone/venv/lib/python3.5/site-packages/androguard/core/bytecodes/dvm.py", line 7453, in __init__
    mi.parse()
  File "[edited]/exodus-standalone/venv/lib/python3.5/site-packages/androguard/core/bytecodes/dvm.py", line 7052, in parse
    for i in range(0, self.size)]
  File "[edited]/exodus-standalone/venv/lib/python3.5/site-packages/androguard/core/bytecodes/dvm.py", line 7052, in <listcomp>
    for i in range(0, self.size)]
  File "[edited]/exodus-standalone/venv/lib/python3.5/site-packages/androguard/core/bytecodes/dvm.py", line 1769, in __init__
    self.value = EncodedArray(buff, cm)
  File "[edited]/exodus-standalone/venv/lib/python3.5/site-packages/androguard/core/bytecodes/dvm.py", line 1427, in __init__
    self.values.append(EncodedValue(buff, cm))
  File "[edited]/exodus-standalone/venv/lib/python3.5/site-packages/androguard/core/bytecodes/dvm.py", line 1494, in __init__
    self.value = cm.get_raw_string(id)
  File "[edited]/exodus-standalone/venv/lib/python3.5/site-packages/androguard/core/bytecodes/dvm.py", line 7264, in get_raw_string
    return self.__strings_off[off].get()
  File "[edited]/exodus-standalone/venv/lib/python3.5/site-packages/androguard/core/bytecodes/dvm.py", line 1872, in get
    return nstr.decode("UTF-16", "surrogateescape")
UnicodeDecodeError: 'utf-16-le' codec can't decode bytes in position 38-39: illegal UTF-16 surrogate

AnalyzeAPK() systematically fails with the APKs I have. All the APKs are downloaded from Google Play.
AttributeError: 'NoneType' object has no attribute 'get_method_analysis'

thanks again!
looks like this is also different in python3...
for the get_method_analysis, can you send me the complete log?

As far as I understand the MUTF8 coding, this should be a Java code that produces this string:
class Str{

    public static void main(String args[]){

        String x = "\u0000\u007f\u00ad\u0600\u061c\u070f\u1680\u180e\u2000\u2028\u205f\u2066\u2067\u2068\u2069\u206a\u3000\ud800\ufeff\ufff9\ufffa";

        System.out.println(x);
    }
}

You can compile it and it will work fine...
As it matches the UTF16_size in the dexfile (both 22), I suspect this is the actual output we want somehow...
The question is further: Internally, no decoding/encoding is required to work. Everything you need to do is to call mutf8.decode and you have a unicode aware string that will work internally. The problem is always that you like to print the string somehow, somewhere... Then the question is how we should proceed with such strings. What is the wished outcome? In my opinion, the string should look like as it was a Java string, i.e. with 2 byte unicode escape sequences: https://docs.oracle.com/javase/specs/jls/se7/html/jls-3.html#jls-3.3
So the question is, if this resulting string should maybe only include chars from the ASCII table - i.e. everything that can be printed in ascii will be printed, and everything else is escaped.
This can be achieved using the unicode_escape encoder: https://docs.python.org/2/library/codecs.html#python-specific-encodings
But again here is a small drawback: in py2 a str is produced. In py3 a bytes object.
Interesstingly, both can now be decoded with utf-16 and will produce some output (which is also equal in both versions...).
I just did this now in #393 - maybe you can give it a try?

Error log for UTF-16 issue
╰─$ ./venv/bin/androlyze.py -s
Androguard version 3.1.0
In [1]: from androguard.core.androconf import show_logging

In [2]:  import logging
   ...:

In [3]: show_logging(logging.WARNING)

In [4]: a,d,dx = AnalyzeAPK("./hsbc.apk")
---------------------------------------------------------------------------
UnicodeDecodeError                        Traceback (most recent call last)
~/Make/exodus-standalone/venv/bin/androlyze.py in <module>()
----> 1 a,d,dx = AnalyzeAPK("./hsbc.apk")

~/Make/exodus-standalone/venv/lib/python3.5/site-packages/androguard/misc.py in AnalyzeAPK(_file, session, raw)
     50             filename = _file
     51
---> 52     digest = session.add(filename, data)
     53     return session.get_objects_apk(filename, digest)
     54

~/Make/exodus-standalone/venv/lib/python3.5/site-packages/androguard/session.py in add(self, filename, raw_data, dx)
    164             dx = self.analyzed_vms.get(digest)
    165             for dex in dex_files:
--> 166                 _, d, dx = self.addDEX(filename, dex, dx)
    167         elif ret == "DEX":
    168             digest, d, _ = self.addDEX(filename, raw_data)

~/Make/exodus-standalone/venv/lib/python3.5/site-packages/androguard/session.py in addDEX(self, filename, data, dx)
     98
     99         log.debug("Parsing format ...")
--> 100         d = DalvikVMFormat(data)
    101         log.debug("added DEX:%s" % digest)
    102

~/Make/exodus-standalone/venv/lib/python3.5/site-packages/androguard/core/bytecodes/dvm.py in __init__(self, buff, decompiler, config, using_api)
   7566
   7567         self._preload(buff)
-> 7568         self._load(buff)
   7569
   7570     def _preload(self, buff):

~/Make/exodus-standalone/venv/lib/python3.5/site-packages/androguard/core/bytecodes/dvm.py in _load(self, buff)
   7577             log.warning("no map list ...")
   7578         else:
-> 7579             self.map_list = MapList(self.CM, self.__header.map_off, self)
   7580
   7581             self.classes = self.map_list.get_item_type("TYPE_CLASS_DEF_ITEM")

~/Make/exodus-standalone/venv/lib/python3.5/site-packages/androguard/core/bytecodes/dvm.py in __init__(self, cm, off, buff)
   7447
   7448         for mi in ordered:
-> 7449             mi.parse()
   7450
   7451             c_item = mi.get_item()

~/Make/exodus-standalone/venv/lib/python3.5/site-packages/androguard/core/bytecodes/dvm.py in parse(self)
   7021
   7022         elif TYPE_MAP_ITEM[self.type] == "TYPE_ANNOTATION_ITEM":
-> 7023             self.item = [AnnotationItem(buff, cm) for i in range(0, self.size)]
   7024
   7025         elif TYPE_MAP_ITEM[self.type] == "TYPE_ANNOTATION_SET_ITEM":

~/Make/exodus-standalone/venv/lib/python3.5/site-packages/androguard/core/bytecodes/dvm.py in <listcomp>(.0)
   7021
   7022         elif TYPE_MAP_ITEM[self.type] == "TYPE_ANNOTATION_ITEM":
-> 7023             self.item = [AnnotationItem(buff, cm) for i in range(0, self.size)]
   7024
   7025         elif TYPE_MAP_ITEM[self.type] == "TYPE_ANNOTATION_SET_ITEM":

~/Make/exodus-standalone/venv/lib/python3.5/site-packages/androguard/core/bytecodes/dvm.py in __init__(self, buff, cm)
   1707
   1708         self.visibility = get_byte(buff)
-> 1709         self.annotation = EncodedAnnotation(buff, cm)
   1710
   1711     def get_visibility(self):

~/Make/exodus-standalone/venv/lib/python3.5/site-packages/androguard/core/bytecodes/dvm.py in __init__(self, buff, cm)
   1641         self.elements = []
   1642         for i in range(0, self.size):
-> 1643             self.elements.append(AnnotationElement(buff, cm))
   1644
   1645     def get_type_idx(self):

~/Make/exodus-standalone/venv/lib/python3.5/site-packages/androguard/core/bytecodes/dvm.py in __init__(self, buff, cm)
   1589
   1590         self.name_idx = readuleb128(buff)
-> 1591         self.value = EncodedValue(buff, cm)
   1592
   1593     def get_name_idx(self):

~/Make/exodus-standalone/venv/lib/python3.5/site-packages/androguard/core/bytecodes/dvm.py in __init__(self, buff, cm)
   1510             self.value = cm.get_field(id)
   1511         elif self.value_type == VALUE_ARRAY:
-> 1512             self.value = EncodedArray(buff, cm)
   1513         elif self.value_type == VALUE_ANNOTATION:
   1514             self.value = EncodedAnnotation(buff, cm)

~/Make/exodus-standalone/venv/lib/python3.5/site-packages/androguard/core/bytecodes/dvm.py in __init__(self, buff, cm)
   1425         self.values = []
   1426         for i in range(0, self.size):
-> 1427             self.values.append(EncodedValue(buff, cm))
   1428
   1429     def get_size(self):

~/Make/exodus-standalone/venv/lib/python3.5/site-packages/androguard/core/bytecodes/dvm.py in __init__(self, buff, cm)
   1492             id, self.raw_value = self._getintvalue(buff.read(self.value_arg +
   1493                                                              1))
-> 1494             self.value = cm.get_raw_string(id)
   1495         elif self.value_type == VALUE_TYPE:
   1496             id, self.raw_value = self._getintvalue(buff.read(self.value_arg +

~/Make/exodus-standalone/venv/lib/python3.5/site-packages/androguard/core/bytecodes/dvm.py in get_raw_string(self, idx)
   7258
   7259         try:
-> 7260             return self.__strings_off[off].get()
   7261         except KeyError:
   7262             log.warning("unknown string item @ 0x%x(%d)" % (off, idx))

~/Make/exodus-standalone/venv/lib/python3.5/site-packages/androguard/core/bytecodes/dvm.py in get(self)
   1866         # unicode_escape produces a string which is printable
   1867         # Then we decode that one as UTF-16
-> 1868         return s.encode("unicode_escape").decode("utf-16")
   1869
   1870     def show(self):

UnicodeDecodeError: 'utf-16-le' codec can't decode byte 0x3c in position 0: truncated data

BTW, if your new fix, Androguard is unable to decode APKs it was able to decode before.

Thanks for testing!
Okay, I'm still not entirely sure what to do, but maybe the string should be decoded as ascii?
I just pushed that change.

@subho007 do you have a good idea how we should deal with the unicode strings?

The problem is also the following: someone might have stored some data in a string, which is not exactly unicode. For example such a thing:
>>> (chr((0b110110 << 10) | 0b1010110011) + chr(0x0000)).encode("UTF-16", "surrogatepass").decode("UTF-16")
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
UnicodeDecodeError: 'utf-16-le' codec can't decode bytes in position 2-3: illegal UTF-16 surrogate

So, the approach of decoding everything as UTF-16 works only if there are actual utf16 strings stored... This is exactly the problem with the given string:
0xd800 is treated as an high surrogate, but the following 0xfeff is not a low surrogate.


Python Crashes at the end of websocket Implementation

I have noticed that "python crashed. windows is collecting information" constantly in Windows environment.
The program perfectly finishes and says goodbye, then python crashes with exit code 255
same crash on both 2.7 and 3.6
I modified the code a bit to avoid tihs error,
def onMessage(self, msg):
    print("Message type:", msg)
    self.MessageCount += 1
    if(self.MessageCount >= 100):
    	exit()

The last 2 lines are added in my program and it solved the issue.

Hello @yogamurthy --
Thanks for letting us know.  Would you please share with us the environment details as well as the fill script you are running?  Thanks!

OS: Windows 7
Python: tried in both 2.7 and 3.6
The following is the complete script im using now
import GDAX, time
class myWebsocketClient(GDAX.WebsocketClient):
def onOpen(self):
self.url = "wss://ws-feed.gdax.com/"
self.products = ["LTC-USD"]
self.MessageCount = 0
print("Lets count the messages!")
def onMessage(self, msg):
print("Message type:", msg["type"], "\t@ %.3f" % float(msg["price"]))
self.MessageCount += 1
if(self.MessageCount >= 100):
exit()
def onClose(self):
print("-- Goodbye! --")
wsClient = myWebsocketClient()
wsClient.start()
print(wsClient.url, wsClient.products)
while (wsClient.MessageCount < 500):
print("\nMessageCount =", "%i \n" % wsClient.MessageCount)
time.sleep(1)

Hi @yogamurthy - Firstly, I would like to state I do not encounter this issue on my current Python interpreters, but I will do my best to help you out given the information on hand.
Under initial inspection of your script, it seems as though you are missing the last line here:
wsClient.close()

...but you said it exits with the 'Goodbye!' message, so I'm going to assume you have this line.  Additionally, it would be better practice to change the onMessage method to the code following.  While it didn't change the behavior, it might be a better way to implement a fix to your issue.  The message count & close logic was to show how you might share variables between threads so feel free to modify this to suit your needs.
self.MessageCount += 1
if self.MessageCount >= 100 and 'type' in msg:
     print("Message type:", msg)

Please let me know if you have any additional questions!

I have been getting a similar issue on my mac

Hi @jwlondon98 thank you for sharing your issue! Hopefully we can get this cleared up ASAP.  Did the fixes above work?  Are you getting the same error?  What version of the project are you running?

My scripts have also been crashing near the end of any implementations of WebsocketClient.
I had been receiving a segmentation fault (core dump) error.
It happened most of the time but not all of the time. So probably a multithreading issue.
I think sometimes it was possible for the websocket connection in WebsocketClient to be called (in the secondary thread) after the socket had already closed (in the main thread).
If we join to the second thread after self.stop = True,but before self.ws.close(), the websocket connection can't close while the secondary thread is running.
In WebsocketClient.py:
Old code:
    def close(self):         if not self.stop:             if self.type == "heartbeat":                 self.ws.send(json.dumps({"type": "heartbeat", "on": False}))             self.onClose()             self.stop = True             # self.thread = None             self.ws.close()
Proposed code:
    def close(self):         if not self.stop:             if self.type == "heartbeat":                 self.ws.send(json.dumps({"type": "heartbeat", "on": False}))             self.onClose()             self.stop = True             # self.thread = None             self.thread.join()             self.ws.close()

This has been implemented in the most recent update to PyPI
@yogamurthy I will be closing this out within the next week -- please let us know if you encounter the same error with these changes.


SP800-56 rev3 support

Hi,
I have downloaded  kas_ecc vectors with a command :./app/acvp_app  --kas_ecc --vector_req  kas_ecc_req.json,  and i observed the fields in request file,    “algorithm”: “KAS-ECC-SSC”,“revision”: “Sp800-56Ar3".
When i generated the response  and results are passing with old unpatched openssl version[openssl-1.0.2l-fips] , i was expecting failure.
Does client support all the test cases of  SP800-56 rev3 testing or some of the cases are missing ?
I am using branch "libacvp-libacvp_1_4_0-throttle".
Regards,
Nag

Functionally KAS-ECC-SCC for SP800-56Ar3 is the same as KAS-ECC component mode form SP800-56Ar2 so the underlying crypto operation has not changed.

Functionally KAS-ECC-SCC for SP800-56Ar3 is the same as KAS-ECC component mode form SP800-56Ar2 so the underlying crypto operation has not changed.

Hello,
Thanks for the quick response.  So there is no specific tests required to prove SP800-56rev3 compliance to NIST ? existing tests are enough ?
Thanks,
Nag

For ECC, that's my understanding.
For FFC there are new requirements to use and test with safe primes. OpenSSL 1.0.2 does not support FFDHE safe primes.

Hello,
I am closing this issue due to inactivity. If you have further questions about this issue, you may reopen it.
Thanks,
Andrew