More examples/clarity on "Transform the data"

What are the recommended methods for transforming data within SQL DW itself? In the video on this page it looks like you can just connect with SSMS or something. Is that the general practice?

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 437b3c1e-b43f-360d-fb6f-27bb66b29a55
Version Independent ID: 96509a9c-d258-8956-a219-02d188c16d9b
Content: Instead of ETL, design ELT for Azure SQL Data Warehouse
Content Source: articles/sql-data-warehouse/design-elt-data-loading.md
Service: sql-data-warehouse
GitHub Login: @Ckarst
Microsoft Alias: cakarst

@dcbrown16 Thank you very much for your interest in Azure products and services. With regard to your question, you can transform data in what SQL Data Warehouse calls an external table (ex, ext.Date). In this section: Loading Data to a Staging Table, you load data from external sources in to the external tables, perform any transformations, and then import that 'clean' data into the final schema (ex, dbo.Date).
You can also use Azure Databricks or Azure Data Factory to build more complex data import pipelines to automate and combine data (from multiple sources), before importing to SQL Data Warehouse.

@dcbrown16 We will now proceed to close this thread. If there are further questions regarding this matter, please comment and we will gladly continue the discussion.


[WIP] [wait for #1463] [layers/manager] Set tensor to usage mapping

This patch creates a var_grad/weight to usage index mapping for both forwarding and backwarding.
These indexes will be used by the manager and the memory allocator for understanding the overlapping use of tensors.
The changes to achieve are (summarized per commit):

Move manager from NeuralNetwork class to NetworkGraph class.
Some corresponding minor adjustments are also added.
Update the layers to make the requested weights and tensors names to be
unique. This done using the layer name with the postfix of the
weights/tensors name making the combination unqiue as layer name is
unique.
InitLayerContext is updated to provide access to the layer name while
finalizing the layer.
Set default usage time index for all the tensors based on when the layer
is to be run in the sorted list.
The usage time indexes are stored in each GraphNode by the GraphCore.
When creating the sorted list, each layer is updated to store its
order location/index when executed in this sequence for forwarding as
well as backwarding.

NOTE: the time indexes for variable and gradient will be set individually by the manager.
The rule followed for this will be that each variable will be made available for forward as well as backward, but gradient will be made available only during backward.
TODO: updating the time index based on the lifespan set by the user is a TBD in this PR.
Signed-off-by: Parichay Kapoor<EMAIL_ADDRESS>

:memo: TAOS-CI Version: 1.5.20200925. Thank you for submitting PR #1464. Please a submit 1commit/1PR (one commit per one PR) policy to get comments quickly from reviewers. Your PR must pass all verificiation processes of cibot before starting a review process from reviewers. If you are new member to join this project, please read manuals in documentation folder and wiki page. In order to monitor a progress status of your PR in more detail, visit http://nnstreamer.mooo.com/.

:octocat: cibot: @kparichay, A builder checker could not be completed because one of the checkers is not completed. In order to find out a reason, please go to http://nnstreamer.mooo.com/nntrainer/ci/repo-workers/pr-checker/1464-202108042016030.15588092803955-ec2d17b88ee5ad6904cae91aa439d1c2d7cef216/.

:octocat: cibot: @kparichay, nntrainer/tensor/memoryAllocator.h does not include Doxygen tags such as @file @brief @author @bug. You must include the Doxygen tags in the source code. Please refer to a Doxygen manual at http://github.com/nnstreamer/TAOS-CI/blob/main/ci/doc/doxygen-documentation.md

:octocat: cibot: @kparichay, nntrainer/tensor/manager.cpp includes bug(s). Please fix incorrect coding constructs in your commit before entering a review process.

:octocat: cibot: @kparichay, A builder checker could not be completed because one of the checkers is not completed. In order to find out a reason, please go to http://nnstreamer.mooo.com/nntrainer/ci/repo-workers/pr-checker/1464-202108182050310.6437520980835-d0fdb6c0dee02e2373f0d04764dfccf6435da437/.

Could you clarify how many commits should be reviewed in this PR?

rebased.


FancyZones - is very often simply deactived :(((

ℹ Computer information

PowerToys version: v0.23.2
PowerToy Utility: FancyZones
Running PowerToys as Admin: NO
Windows build number: [run "winver"] 20H2

📝 Provide detailed reproduction steps (if any)

setting  a custom zone
next day on startup - lost - default settings active again
…

✔ Expected result
What is the expected result of the above steps?
if i set a custome zone... it should stick - no matter what.. be it updates, restarts, whatsoever
❌ Actual result
What is the actual result of the above steps?
always default setting active
📷 Screenshots
Are there any useful screenshots? WinKey+Shift+S and then just paste them directly into the form

Have you tried running PowerToys as admin (if possible)?

is the custom layout lost or the applied layout.
Are you on a laptop?  Desktop?


Datagrid Filter

Hi everyone,
There are some options in filter of datagrid like >= or <= or == to filter the report data. I need to a filter like below;
var <= x AND var >= y (var is column name, x and y are data that user entered.)
How should I do this?
Regards
Farzam

Hi @fsabeti
I need some time to investigate, will get back to you with the answer shortly

Try to use number-range filter type. An example you can find there.

I'm closing the issue because it has no activity. Feel free open it if you have any question.


Fix/sdk-user-agent product name

I noticed that the user-agent in the helper was not the right product name and did not have a version number, here is a pr setting the product name and adding the version.
I Chose minimouli-sdk for the product name and set the version to 1.0 please review and let me know what you think !

I deleted the version after review because it was hard coded i'll create an issue for the dynamic change


Cookie Authentication - Time out event

Salam brother,
when we using app.UseCookieAuthentication, do we have in active user session time out event available in code? so i can perfom logging or any  thing on that event.
Jazak Allah Khair
Kamran

Salam,
I believe this is what you are looking for https://stackoverflow.com/questions/23090706/how-to-know-when-owin-cookie-will-expire
Thanks.


Render external view

Suppose I have an external url example.com/aaaa, I want to have a route that would forward all requests to that domain and return the results ( NOTE: I do not want a redirect, I don't want the URL to change )
I tried this but it doesn't work:
$app->get('/mailers/{route}', function( $request, $response, $args) {
    $app->render('http://example.com/' . $args['route'] . '.html');
});

So basically both my-domain/aaaa and my-other-domain/aaaa should return the same page.
Is there a work around?

Maybe using a custom view and in the render method return  get_file_contents('http://example.com/xyz');

I'm closing this as resolved


Better handling of dynamic imports in dead code

Describe the bug
When working with SSR, one would expect patterns like this to work:
if (import.meta.env.SSR) {
  const { data } = await import('./loadServer');
  console.log(data);
} else {
  const data = await fetch('/data').then((r) => r.text());
  console.log(data);
}

I.e., ignore loadServer for the browser bundle. It actually works fine with the dev server, but when loadServer (transitively) imports node builtin modules, vite build fails with e.g.:
Error: 'readFile' is not exported by __vite-browser-external, imported by loadServer.js

It would be nice if vite could just figure out that loadServer will never be needed for the browser bundle, and don't try to analyze/resolve code in it. It would also make dev and build behavior more consistent and might perform better in some cases.
I also tried this with esbuild and it does just ignore loadServer in this case:
❯ npx esbuild --format=esm --bundle main.js --define:import.meta.env.SSR=false
// main.js
if (false) {
  const { data } = await null;
  console.log(data);
} else {
  const data = await fetch("/data").then((r) => r.text());
  console.log(data);
}

Reproduction
https://stackblitz.com/edit/vitejs-vite-ts9jc6?devtoolsheight=33&file=main.js
System Info
System:
    OS: Linux undefined
    CPU: (4) x64 Intel(R) Core(TM) i9-9880H CPU @ 2.30GHz
    Memory: 0 Bytes / 0 Bytes
    Shell: Unknown - /bin/jsh
  Binaries:
    Node: 14.16.0 - /usr/local/bin/node
    Yarn: 1.22.10 - /bin/yarn
    npm: 7.17.0 - /bin/npm
  npmPackages:
    vite: ^2.6.13 => 2.6.14

Used Package Manager
npm
Logs
No response
Validations

[X] Follow our Code of Conduct
[X] Read the Contributing Guidelines.
[X] Read the docs.
[X] Check that there isn't already an issue that reports the same bug to avoid creating a duplicate.
[X] Make sure this is a Vite issue and not a framework-specific issue. For example, if it's a Vue SFC related bug, it should likely be reported to https://github.com/vuejs/vue-next instead.
[ ] Check that this is a concrete bug. For Q&A open a GitHub Discussion or join our Discord Chat Server.
[X] The provided reproduction is a minimal reproducible example of the bug.

This plugin mitigates the issue but breaks vue SFC styling:

// Replace import.meta.env.SSR in a pre plugin so that esbuild can eliminate
// dynamic imports in the dead branch.
function DefineSSR(): PluginOption {
  return {
    name: "define ssr",
    async transform(code, _id, ssr) {
      if (!ssr && code.includes("import.meta.env.SSR")) {
        return code.replace(/import.meta.env.SSR/g, "false");
      }
      return undefined;
    },
    enforce: "pre",
  };
}

That's strange. Vite does replace import.meta.env.SSR here. Could be an issue with the order of Vite plugins being ran :thinking:

That's strange. Vite does replace import.meta.env.SSR here. Could be an issue with the order of Vite plugins being ran 🤔

Yes. Moving the define plugin before esbuild will solve this issue, but it breaks vue SFC styling.

$300 USD to anyone who can get this working (seriously) and create a working PR.
We're trying to replace a really bulky & clunky Nuxt app with a more sleek and streamlined Vite SSR version. The current app is a bit slow and customers are definitely aware of it!

Use the following configuration as a workaround to solve the problem, and the dead code is removed after a successful build.
import { defineConfig } from 'vite'
import { builtinModules } from 'module'

export default defineConfig({
  build: {
    rollupOptions: {
      external: builtinModules
    }
  }
})

This may not be the replacement of import.meta.env.SSR, because I just change it to false in the source code and still get the same error.
Perhaps we should adjust the order in which dead code is removed at build time, removing the dead code first and then performing subsequent build steps.

I use crypto inside if (import.meta.env.SSR) { check and get an warning: [plugin:vite:resolve] Module "crypto" has been externalized for browser compatibility, imported by "/path-to-script.ts". See http://vitejs.dev/guide/troubleshooting.html#module-externalized-for-browser-compatibility for more details.
in practice this code does not get into browser bundle, but this warning makes me worry
Info
vite/4.4.9 darwin-arm64 node-v20.5.1

I use crypto inside if (import.meta.env.SSR) { check and get an warning: [plugin:vite:resolve] Module "crypto" has been externalized for browser compatibility, imported by "/path-to-script.ts". See http://vitejs.dev/guide/troubleshooting.html#module-externalized-for-browser-compatibility for more details.
in practice this code does not get into browser bundle, but this warning makes me worry
Info
vite/4.4.9 darwin-arm64 node-v20.5.1

I have the same problem

Problem is still relevant

You could use define instead

You could use define instead

How do you dynamic setting it? Like yarn vite build --define XXX?

You could use define instead

i didn't notice the difference at all, warning remained

@Tnze either have multiple config files or have your config file change the defined value based on the mode or environment variable or something
@DaniilIsupov we can't help you if you don't share your code and config


Refactor the defination of transport topics

Signed-off-by: myan<EMAIL_ADDRESS>

/cc @ldpliu @clyang82

/hold

/cc @clyang82 @ldpliu

/retest


fixes issue https://github.com/apache/incubator-trafficcontrol/issues…

…/1696 ?region=regionid didn't return results.  Changed the query from regionName to regionId

Can one of the admins verify this patch?

If you add 'fixes #1707' in your original description, it will auto-close the issue when this PR is merged


azure interactive not working

This is autogenerated. Please review and update as needed.
Describe the bug
Command Name
az interactive
Errors:
UnrecognizedArgumentError: unrecognized arguments: e

To Reproduce:
Steps to reproduce the behavior. Note that argument values have been redacted, as they may contain sensitive information.

Put any pre-requisite steps here...
az interactive {}

Expected Behavior
Environment Summary
Linux-5.10.0-8parrot1-amd64-x86_64-with-glibc2.31
Python 3.9.2
Installer: DEB

azure-cli 2.18.0 *

Extensions:
interactive Unknown
azure-devops 0.19.0

Additional Context

interactive


Base Pagination

What is it?

[x] Feature/enhancement
[ ] Bug
[ ] Docs/tests

Description
Created a base pagination component
fully functional component for pagination
In the future, I will make it look better, add functionality, etc.
#130 - Add Pagination Component, no dependencies were affected
Screenshots/Demo

Checklist:

[x] My code follows the developer guidelines of this project
[x] I have performed a self-review of my own code
[x] I have made corresponding changes to the documentation
[ ] Added new tests to cover the fix/functionality

@all-contributors please add @yishayhaz for code


Extract the footnotes

We need to extract the footnotes of a document.
The contents of the footnote should be converted also to Markdown ((footnotes on Markdown)[https://www.markdownguide.org/extended-syntax/#footnotes])

It's already done, reference to wiki Text element conversion features. Closing this.


Version for 0.18

Would be great to have a version for 0.18, so that I can update my code dealing with dates/times before making the big switch for the code as a whole

Hey Simon!
There is a version out for 0.18 called ryannhg/elm-date-format, however it is deprecated and I won't be adding any additional features.
Happy date formatting!
Ryan

Thanks - sorry for my poor searching beforehand
Note that there is a typo in the readme
elm package install ryannhg/elm-date-format
elm-package install ryannhg/elm-date-format


Using garph's inbuilt relay schema builder types results in type errors.

Here's a codesandbox link:- https://codesandbox.io/p/sandbox/quizzical-wood-66llf3
Check out the index.ts file.

Good catch!
For now you might use try this:
https://codesandbox.io/p/sandbox/festive-leftpad-h8t3mj?file=%2Findex.ts%3A10%2C1


No simple way to parse from std::istream

There should be a quick and convenient way to parse JSON from std::istream. E.g.
std::ifstream f("path/to/file");
auto jv = json::parse(f);

there should be parse_istream and there should even be parse_file that takes the file name directly

Well, parse_istream can just be a parse overload.

@prince-chrismc I agree! Would you like to try your hand at it? Shouldn't be too hard...

I have a blueprint for the fix. I originally wanted to make the streambuffer to put all input into parser as soon as possible which would work OK with something like istream >> &json_buffer. But then I realized that
std::copy(
  std::istreambuf_iterator<char>(istream),
  std::istreambuf_iterator<char>(),
  std::ostreambuf_iterparsing(&json_buffer))

will push input into parser one byte a time, which is very ineffective.
So, my approach has to be changed to have a  proper buffer in the streambuf.


Update faq.rst

The documentation needed a minor typo fix.
The anchor text was "Parameter Tunning Guide" earlier. I just fixed it to "Parameter Tuning Guide"

Codecov Report

Merging #3521 into master will increase coverage by 0.09%.
The diff coverage is n/a.

@@             Coverage Diff              @@
##             master    #3521      +/-   ##
============================================
+ Coverage     45.64%   45.74%   +0.09%
  Complexity      188      188
============================================
  Files           166      166
  Lines         13219    13219
  Branches        445      445
============================================
+ Hits           6034     6047      +13
+ Misses         6981     6968      -13
  Partials        204      204

Impacted Files
Coverage Δ
Complexity Δ

src/data/sparse_page_dmatrix.cc
92.89% <0%> (+0.59%)
0% <0%> (ø)
:arrow_down:

src/data/sparse_page_raw_format.cc
64.15% <0%> (+22.64%)
0% <0%> (ø)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 07ff52d...1880e5a. Read the comment docs.


GitHub Actions - Workflow - linux python X.X unit tests

GitHub Actions workflow for linux python X.X unit tests.
Quip Doc: https://alteryx.quip.com/ZdlbAixZ9If3/Workflow-testallpythonversions

Reopening because we haven't migrated the linux unit tests and codecov over to GH actions yet

Ugh oops I'm completely wrong here... I meant to keep something open for verifying codecov. We're all set


Test the pipeline step (script)

A/C:

[x] Add "Test Script" button to step 2 in the add pipeline wizard
[x] The "Test Script" button sends the form data to the server through an hx-post (like on step 1)
[x] The view returns

[ ] an HTML div with the results from the script (refer to wireframes from @janelle-caktus), with placeholder results for now ("0" for exit status and 5-10 lines from the runserver logging as the script output), place the script output in a text-monospace p tag: https://getbootstrap.com/docs/4.1/utilities/text/#monospace, and
[x] the validated form HTML (via hx OOB div, like step 1)

[ ] User cannot click the next/save button until they test the script and the exit status is 0

This looks like a good possible solution, https://www.encodedna.com/javascript/practice-ground/default.htm?pg=javascript_disabled_property along with https://stackoverflow.com/questions/6008908/use-django-template-tags-in-jquery-javascript


keyutils-1.6.3 source tarball url is broken

Describe the bug
I mistakenly ran a nix build --offline on one of my flakes today, which tried to build a bunch of packages (to be expected), but the process failed when keyutils failed to download it's source tarball from https://git.kernel.org/pub/scm/linux/kernel/git/dhowells/keyutils.git/snapshot/keyutils-1.6.3.tar.gz .
Attempts to visit the download link with a web browser complain that the archive format is unsupported.  I can only assume upstream reconfigured the snapshots in their cgit.
The obvious work-around is to remove the --offline and pull substitutions from the cache, but I figured we might want to find a working url for this package at some point.
Expected behavior
I expected the source to download and build without error.
Notify maintainers
None listed.

Add a :+1: reaction to issues you find important.

This looks like it affects all tarballs from the git.kernel.org cgit instance. The download links are also gone from the UI. If there was no announcement about this, it feels unintentional.

(I've sent an e-mail to what I think is the instance administrator, but it's not exactly clear...)

The direct tarball links from www.kernel.org are also broken so this seems very unintentional. Maybe we can update the issue title?

Upstream got back to me,

Yes, this is a temporary measure to combat a denial of service by
Tencent. They have an aggressive bot that is crawling snapshot URLs from
thousands of IPs, using generic user-agent headers.
We will have a more fine-tuned block in place on Monday.

So it was intentional, and presumably this should be resolved sometime today. :)

It appears upstream have found a solution and the cgit snapshots are back online. I did a cursory check, but it appears to be fine across the board. :smile_cat:


IBM Maximo

Could you provide part numbers of Maximo  which are required by this project

CJ41KML according to https://www-356.ibm.com/partnerworld/wps/servlet/download/DownloadServlet?id=uruRYDTrjaWiPCA$cnt&attachmentName=Software_Access_Catalog_sample_list.pdf&token=MTU1Mjg3NDc5Nzk5Mw==&locale=en_ALL_ZZ


:pencil: impl readDependentJointsThatAreReady (#131)

impl readDependentJointsThatAreReady (#131)

@joyious please help to review the code and if necessary you can update this branch directly


How do I edit my planned cooldowns?

I play WHM and I was wanting to try out the cooldown planner, but whenever I open the window, all I see is a scrollable list of fight mechanics. There is nothing that is clickable or editable outside of the buttons and slider at the top of the window. Am I missing something here? Any help you can offer would be nice!

Try different class (WAR or BRD). WHM is in a bad state autorotation-wise.


Trouble with multiple SSH keys

Hi there,
I'm currently having trouble with a GitHub Actions workflow where I want to clone multiple private repositories (either hosted in Github or BitBucket). The main issue I'm facing is that I can't successfully clone more than one private GitHub repository. When running the action, the second repo always fails with error:
fatal: Could not read from remote repository.

Please make sure you have the correct access rights
and the repository exists.

The repository that's able to be successfully cloned corresponds to the first SSH key listed in my action .yml file... if I switch the order of the keys, the successfully cloned repo changes as well.
I've made a more detailed issue on a different, related repo, but I was hoping some additional eyes here might be able to help. Here's a link to the full issue:
https://github.com/ros-industrial/industrial_ci/issues/807
Thanks in advance

Does this help?
https://github.com/webfactory/ssh-agent#support-for-github-deploy-keys

@mpdude Thanks for the link. I have tried both with and without deploy key mapping but it doesn't seem to make a difference. When attempting to use deploy key mapping, the output from the ssh-agent step indicates that I have deploy keys mapped to the correct repos so I'm assuming that's "working", at least in the ssh-agent action:
...
Added deploy-key mapping: Use identity '/home/runner/.ssh/<key1>' for GitHub repository <repo1>
Added deploy-key mapping: Use identity '/home/runner/.ssh/<key2>' for GitHub repository <repo2>
...

Update
(see original post for details about each specific issue)
Issue 1
This is resolved by adding non-GitHub servers to the known_hosts file. Sample code is provided in this post from the original issue report.
Issue 2
The root cause is due to the configuration created by webfactory/ssh-agent with the deploy key mapping feature. The custom .gitconfig settings are not copied into the docker automatically, therefore not allowing more than one private GitHub repo to be cloned.
This can be resolved by passing both the ~/.gitconfig file and ~/.ssh directory as mapped locations into the docker container. Specifically for ros-industrial/industrial_ci, use the DOCKER_RUN_OPTS parameter to specify the locations to map.
A more permanent fix has been submitted as a PR to the ros-industrial repo, to incorporate mapping these locations as part of the standard codebase.


chore(*): tweak priorities to remove eta_experiment in linear algebra

!bench

This PR also solves the one remaining problem in #3805 (which looked kind of nasty)

Can someone explain the output of the bench command? I literally only want to check that green means "this PR has made the file compile faster" rather than "this PR has made the file compile slower"

I took a look at FieldTheory.Subfield (one of the few files which was red). The declaration Subfield.inclusion is slower now: the DefEq trace change is basically this:
/-
 -- SG_test3
 [] [3.928642s] ✅ Subsemiring.toNonAssocSemiring T.toSubring.toSubsemiring =?= SubsemiringClass.toNonAssocSemiring T

 -- master
 [] [1.761194s] ✅ Subsemiring.toNonAssocSemiring T.toSubring.toSubsemiring =?= SubsemiringClass.toNonAssocSemiring T
-/

Is there some modification of the trick involving these Class typeclasses which can deal with this?

This "change the order a bit and things get better" reminds me of this old thread https://leanprover.zulipchat.com/#narrow/stream/113488-general/topic/Problem.20with.20type.20class.20search/near/161848744

!bench

Better version, updated to current mathlib4 and ready for review, in #3840


requirements: Bump line_profiler to work on Apple M1s which compile it.

See https://github.com/pyutils/line_profiler/issues/204.

Self-review checklist

[ ] Self-reviewed the changes for clarity and maintainability
(variable names, code reuse, readability, etc.).

Communicate decisions, questions, and potential concerns.

[ ] Explains differences from previous plans (e.g., issue description).
[ ] Highlights technical choices and bugs encountered.
[ ] Calls out remaining decisions and concerns.
[ ] Automated tests verify logic where appropriate.

Individual commits are ready for review (see commit discipline).

[ ] Each commit is a coherent idea.
[ ] Commit message(s) explain reasoning and motivation for changes.

Completed manual review and testing of the following:

[ ] Visual appearance of the changes.
[ ] Responsiveness and internationalization.
[ ] Strings and tooltips.
[ ] End-to-end functionality of buttons, interactions and flows.
[ ] Corner cases, error conditions, and easily imagined bugs.

This is also part of

#24573


Run tests using Travis.

This repository urgently needs a .travis.yml file.

I have activated this repository in Travis so builds will start happening as soon as there is a .travis.yml file.


[Functional] --revert-from-portable works partially

Description
Well, i'm in situation where this flag is needed - fresh OS installation(old hard is on 600KB/s and old installation have too many faq-ups to restore it from backup). And while mostly this feature works, seems that cookies, last session and atleast one setting(Start-up) continue resets.
To Reproduce

Close browser, completely
Grab your profile folder in %localappdata%\Supermium (i not decrypt my profile)
Copy it to 2nd machine to same location
Start browser on 2nd machine with --revert-from-portable argument (one time action so no any pre(post)parations required)
Open any site where you previously was authorized (e.g. github, site should be able to save cookies)
Note that now you are un-authorized

Expected behavior
Seamless transition to new machine/system without any data losing
Desktop

OS: Windows 7 SP1 x64 -> Windows 7 SP1 x64
Supermium: 124.0.6367.245 R1 x64 -> 124.0.6367.245 R1 x64

Also

Text of --revert-from-portable' message as for me a bit confusing. Maybe instead of "Flag detected, if profile was transferred press yes, else no" display something like "Flag detected, press Yes to confirm profile transfering/adapting/reencrypting, No to cancel".
Browser window, that appear after message box resolved, has corrupted frame. any sizing-action with it and it's black, caption buttons does not works, but context menu is callable. probably due to profile has theme with custom frame

I tried this and it does occur to me as well. This is in spite of chrome://settings/content/all suggesting that the cookies still exist. A move from one drive to another in the same OS install using the same procedure does not have the same effect and the GitHub account authorization remains.

Just my 2c :stuck_out_tongue_winking_eye: :

Grab your profile folder in %localappdata%\Supermium (i not decrypt my profile)

I think this is the crux of OP's issue :wink: ; if the Sm profile is to be transferred to a different machine (i.e. H/W), then it has to be made "truly portable" first (IOW, decrypted and untied from the original H/W) before the migration.
From the relevant documentation:

--disable-machine-id and --disable-encryption switches will no longer result in profile data loss.
Furthermore, a new switch named --revert-from-portable will allow the user to revert a portable user data directory to non-portable without data loss as well.

Copy it to 2nd machine to same location
Start browser on 2nd machine with --revert-from-portable argument

The way I understood the documentation (sorry, I didn't delve into the code itself), step 3 will re-encrypt the profile (and presumably the transferred (decrypted) cookies, etc.) with new key tied to the second H/W...
Although, now that I think about it more, GitHub in particular might be a special case, because it stores a cookie called _device_id tied to the browser+machine combination current when you signed into your account - if the "device" somehow changes, that cookie data becomes non-valid and then you're auto logged out...

The switch -disable-encryption will also cause the loss of the GitHub account authentication (even if the profile remains in the same place as before the switch was set), but not --disable-machine-id. And this issue is not specific to GitHub, as I was able to reproduce it with other websites as well.

@Vangelis66
when i originally suggest such option and then mention it in another relevant issue, i not look closely at cookies(i was not aware of their encryption), only at configs and extensions. Config and extensions data stored in raw unencrypted form plus kind of hash of their data in certain place where machine id and encryption are really engaged. During startup browser read unencrypted values, encrypt them and compare with stored encrypted values. So, simple ignore or re-encryption will work for configs and extensions. You may think about this as file hashing(store file hash, update it during authorized modification, check file hash on authorization, all the way original content in plain form)
But for cookies probably their actual value are really encrypted, so first they should be decrypted with old key(machine and user ids), then re-encrypted with new. maybe i will look at cookies closely later

@win32ss
yep i also was confused with chrome://settings/content/all - we are here but will not be used for some reason :thinking:
Eliminating this issue will be useful in case of sudden death of system, unlike in my case where my hard give me a month from first bad sector in garbage file

luckily, not so many sites are allowed to store cookies in my config and all i lost is github, guest youtube(pity youtube, they lost my analytic' key :rofl: ), one forum, one local shops and... it's all, but it's me
and for me the local extensions was more problematic issue(bypassed) cuz i re-map some of my partitions includes one that i dedicate for users(some magic with registry envolved).

The cookies themselves are encrypted. Cookie decryption is performed through the function DecryptKeyWithDPAPI in the DPAPI key provider, using the win32 API function CryptUnprotectData which limits decryption to the Windows user account where encryption took place. If the returned value is invalid, then the cookies become unusable. And that value is invalid when the switch --disable-encryption is used or the profile is moved to another system.
So I decided to create a new switch named --prepare-to-move-profile, to be run once on the original system before moving it. And then --revert-from-portable must also be run once on the new system. This seems to work, although the problem is that now the encrypted value is now plaintext when outside the context of the user account that created the cookies.

which limits decryption to the Windows user account where encryption took place.
If the returned value is invalid, then the cookies become unusable.
And that value is invalid when the switch --disable-encryption is used

Many thanks for your continued work on this important issue :+1: ; can somebody explain to a layman why the cookie-decryption yields invalid values with --disable-encryption, if the decryption is performed by the same Win User Account and on the same system those cookies were originally created+encrypted?

can i ask a pretty strange question
is it possible to give a user the key, that later can be used for decryption of the encrypted profile?
if so transferring the profile between systems may be like:

obtain key on original system, the user will be responsible for its secure storing
placing encrypted profile in new system
specifying --revert-from-portable argument
ask user about his intends
if confirmed - ask user the key for decryption with warning that encrypted data like cookies would be lost in case of invalid or empty key
if key provided - attempt to decrypt cookies
if success - re-encrypt them for current system
re-hash remained data (like now)

and no plaindata on any step in user-space
think google-sync also have some similar mechanism, but without any interaction with user
but this require some functionality to obtain actual key and way to access this functionality (e.g. button somewhere in settings)
the goal is to be able to restore profile from backup without original system. as i understand this key is system/user persistent, so can be obtained once and used muuuch later. And right now i use SSD as system disk... usualy SSD death no so "data-friendly" and can be very dramatic
i can try to obtain the key of old-system
e.g. with VM or by unrolling it on real machine, cuz have full image of it.
But it's kind of problematic cuz it was segmented a lot(software was on separate disk and user-data on separate partition). although this segmentation helps a lot in data restore on system changing.

btw, --revert-from-portable not reflect suggested functionality, may be it should be keeped for exactly plaindata, and for suggested purpose extra argument should be provided (--import-encrypted-profile for example)? or maybe button in settings?..

which limits decryption to the Windows user account where encryption took place.
If the returned value is invalid, then the cookies become unusable.
And that value is invalid when the switch --disable-encryption is used

Many thanks for your continued work on this important issue 👍 ; can somebody explain to a layman why the cookie-decryption yields invalid values with --disable-encryption, if the decryption is performed by the same Win User Account and on the same system those cookies were originally created+encrypted?

In the case I am referring to, the browser profile had created most or all of its cookies with encryption enabled. If encryption is disabled, new cookies would not be encrypted, but old cookies are still encrypted, so the attempt to decrypt them will fail because the plaintext will be the same as the ciphertext/encrypted text as encryption is not expected on any cookie.

is it possible to give a user the key, that later can be used for decryption of the encrypted profile?

If the current encryption process is changed from using the same account/OS install/network-dependent win32 crypto API to using the internal encryption API in the crypto directory of the Chromium tree, then yes. That API supports custom keys. And then all that is needed are methods to get the valid key (possibly as part of the viewing of password manager passwords, as they are also affected and secured by the need for a user account authentication?) and then to submit the key if needed. And yes I will separate it from the standard non-encrypted pref importing routine.

probably i was not clear enough - is it possible to obtain and reveal key, that used by win32 API?
I talk not about using custom keys for this encryption(and possibility of changing encryption API), i talk about revealing key that generated and used by win32 API.
probably it's well stupid question... but i not well familiar with encryption part of windows, i just know it exists and also used in windows credential manager

The actual encryption/decryption is done in ksecdd.sys, which is accessed from user mode by DeviceIoControl calls. Once in there, a call to SeCaptureSubjectContext is made to receive a token. An authentication ID is then retrieved from the token and is used to create an AES128 key. NtQueryInformationToken may be able to receive this information in user mode, with the information class TokenGroupsAndPrivileges which returns an authentication ID (but would only work on Vista and up).

In the case I am referring to, the browser profile had created most or all of its cookies with encryption enabled.
If encryption is disabled, new cookies would not be encrypted, but old cookies are still encrypted

Thanks :smile: ; so, when someone issues --disable-encryption for the first time  (and keeps this flag set from then on) on an existing profile,
a. Already stored cookies are NOT being decrypted, their values still stay in encrypted form (tied to the Windows user account+machine)
b. Future cookies will be stored un-encrypted, thus resulting in a mix of encrypted+plaintext cookie values inside the profile...
FWIW, I created my Sm-122 profile from the very start with both flags --disable-machine-id+--disable-encryption; in my Sm profile, cookies are to be found inside ".\User Data\Default\Network\Cookies", with file Cookies being of the SQLite DB format; when I probed that file with DB Browser for SQLite, I wasn't able to see plaintext cookie values, only "encrypted value" blobs; so, what's the deal?

I talk about revealing the key that was generated and used by win32 API. (...) probably it's well stupid question...
but I'm not well familiar with the encryption part of Windows, Ii just know it exists and is also used in Windows credential manager...

@XakerTwo : You can have a look at this NirSoft utility and its documentation; its support includes encrypted cookies (by win32 API) inside Chrome profiles... In any case, you still need to have access to some form of the original setup :wink: ...
For me, loss of cookies during profile transfers between machines isn't a deal breaker; if lost cookies pertain to logged-in sessions, all I need are the login credentials for the sites affected; in any case, I also use Cookie Manager extensions in Supermium (e.g. MILK) ; on the original profile, one can export the whole Cookie database (or cookies particular to specific sites) in the form of un-encrypted JSON file and then import that JSON file (via a second MILK instance) in the transferred profile on the second machine - you can securely store that JSON file somewhere (just like you'd do with the encryption key you're requesting above); I realise this isn't a solution when your SSD suddenly dies on you (because the initial export requires a usable system), but if you're in the habit of making, say, weekly backups of your cookies, all is not lost... Still, (decrypted) cookie values somehow tied to the first machine, even when successfully transferred by the method detailed, may fail to work as expected on the second machine...
Kind regards.

@win32ss

NtQueryInformationToken may be able to receive key [...] but would only work on Vista and up

If the current encryption process is changed from [...] win32 crypto API to [...] API [...] of the Chromium, then yes

so what is about Vista- for Chromium API?
and will it be compatible with regular chrome and chromium profile? assume it's not, but if yes why not

@Vangelis66

For me, loss of cookies during profile transfers between machines isn't a deal breaker;

same for me except one nuance - dumned players volume! most of sites store volumes in cookies and by default set it to 100% while for me comfort level is about 2-10%, so you can imagine my rage on this

on the original profile, one can export the whole Cookie database [...] and then import that in the transferred profile on the second machine - you can securely store them somewhere (just like you'd do with the encryption key you're requesting above)

for me the issue here is the data desync and outdating on non-daily basis backup and that you should do extra backup for some data - why if have whole drive backup?! for me it's sounds like launcher for launchers for apps... the key is just a key that gain you access to data that will be as fresh as entire backup - no desync, no extra actions.

[...] thus resulting in a mix of encrypted+plaintext cookie values inside the profile

mixing is not the issue, issue is that with --disable-encryption encrypted cookies is not what the internal reader would expect - reader will expect plain data but meet encrypted and fails. in simple term - like changing door key but forgetting to change door lock and trying to open the old lock with a new key

I wasn't able to see plaintext cookie values, only "encrypted value" blobs

:smirk:
did you look at binary value?
here my value is encrypted, but try on your probe, probably you will see something readable or atleast processible
also by default this panel placed as tab on the right side, not bottom

mixing is not the issue, the issue is that with --disable-encryption the (previously) encrypted cookies are not what the internal cookie reader would expect; the reader would expect plain data but is faced with encrypted and thus fails; in simpler terms: it's like changing door key but forgetting to change door lock, then trying to open the old lock with a new key...

Thanks for your additional explanation and example :+1: !

I wasn't able to see plaintext cookie values, only "encrypted value" blobs

😏

did you look at binary value?

Yes I did; the profile in question is a Sm-124 one, created from the very beginning with both --disable-machine-id+--disable-encryption; below a github.com cookie named preferred_color_mode:

Can you make anything out of this? For plain-text cookies, I'd have expected the value column/cell be populated with unencrypted data...
FWIW, the plain text value of that cookie is just dark :smile: ...
Disclaimer: Since the OS in use is Vista SP2 32-bit, I'm using DBBrowserForSQLite-v3.11.2[Qt-5.7.1], as that's the EoS version for that OS...

not think that OS is matter for binary(raw) view
weeell... nothing what i can recognize immediately (base64, deflate and few other structs) but there one small signature - v10 which can means that data is somehow structurized and/or compressed
p.s. lol, thank you for correcting my grammar, reading quote for the first time i didn't believe that i wrote the quoted part so correctly


Implement SIMD comparison operations for types with less than 4 lanes (i128)

Which issue does this PR close?
Implements comparison for simd types with less than 8 lanes.
Closes #1136 .
What changes are included in this PR?
This PR changes the comparison kernel so that the simd portion can always append 64 bits at a time. Since the simd types are 512 bits wide, this means the inner comparison is unrolled, for example 8 times for Float64 (8 x 8lanes) or 4 times for Float32 (4 x 16lanes). For Int8 types it does not get unrolled since one comparison already results in 64 bits.
This should even speed up the comparison kernel a bit for common types, because there is less loop overhead.
On my laptop the simd version for i128 MonthDayNano types is not actually faster than the scalar version, on a more modern or server class machine there should be a slight speedup.
Unrelated to this change I also noticed that the code generation for non-avx512 machines is sub-optimal since the compiler has to emulate the 512bit wider operations using smaller vector registers, and for the bitmap generating code this has some overhead.

Are there any user-facing changes?

Codecov Report

Merging #1146 (1e25b3c) into master (719096b) will decrease coverage by 0.00%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master    #1146      +/-   ##
==========================================
- Coverage   82.55%   82.54%   -0.01%
==========================================
  Files         169      169
  Lines       50456    50456
==========================================
- Hits        41655    41651       -4
- Misses       8801     8805       +4

Impacted Files
Coverage Δ

arrow/src/compute/kernels/comparison.rs
91.96% <ø> (ø)

parquet_derive/src/parquet_field.rs
65.98% <0.00%> (-0.46%)
:arrow_down:

parquet/src/encodings/encoding.rs
93.52% <0.00%> (-0.20%)
:arrow_down:

arrow/src/array/transform/mod.rs
85.56% <0.00%> (-0.14%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 719096b...1e25b3c. Read the comment docs.

Thanks @jhorstmann
fyi @tustvold


when you try to close a tabbed app, the tab freezes and you cant do anything with it

here you can see it happening in the video - https://i.imgur.com/e8EAhMs.mp4
in the end of the video i tried closing the tabbed alacritty window and it just freezes

After this freezes you see in htop that process alacritty is done?

fixed in 22384869a63e5c9c46f2cfbd0c914ceb01ca9a2e

thanks


PackagesNotFoundError

Hi,
I attempted to install ConFindr using conda with the following command
>conda install -c bioconda confindr
But, I get the following PackagesNotFound Error.
Collecting package metadata: done
Solving environment: failed

PackagesNotFoundError: The following packages are not available from current channels:

  - confindr -> mash[version='>=2'] -> capnproto
  - confindr -> mash[version='>=2'] -> libcblas[version='>=3.8.0,<4.0a0']
  - confindr -> rauth

Wondering if you have a solution to this?
My conda is using Python 3.7.1.

My guess is that something is wrong with the channel setup within conda. Have you gotten bioconda set up as detailed at https://bioconda.github.io/#using-bioconda?
For more troubleshooting, can you let me know what the output of conda config --show channels is? You should see something like this:
channels:
  - conda-forge
  - bioconda
  - defaults

Yes, you are right. I didn't include conda-forge into my channels. I thought -c bioconda was enough.
Thank you for your prompt answer.
>conda config --show channels
channels:
  - defaults

I fixed this issue by add conda-forge and bioconda channels into conda config using the following commands:
conda config --add channels bioconda
conda config --add channels conda-forge


[dif/sensor_ctrl] add sensor ctrl autogen DIFs

This adds the autogenerated sensor controller DIFs and the meson build targets.
Note: this depends on #12076.

Added bazel build targets to this PR too.

As soon as #12076 is merged, I can merge this on top (just need an approval on #12076).


Added pointfree for toPromise

Added to help enable composition. This is based on a question asked on the gitter where it was pointed out that this function is missing from our pointfree funcs

LGTM but should maybe add a unit test for the case where f is not an async

Yeah fair point, let me add that now

Coverage remained the same at 100.0% when pulling 5be73d7d36ba0ed47476de5925befcb3a1561add on feature/toPromise into 7c15ec2f822a774413f751bec31a43c6e609d69b on master.

Do you want to merge this @bennypowers? :) I can't it seems

I'll defer to the big dogs, but thanks 🌟😉

I agree, good point :)
Change committed

Well spotted! I thought that was the first thing i did

Also, I noticed that we also don't have fromPromise and fromNode pointfree. Would you have the time to take that up as well?

 I have no problem locally though. Can you see what it is by looking?


Uses a parallelStream() to substantially improve performance on CPUs …

…with many cores
Not so nicely visible in the diff but the only change I have made is to add
.toList()
.parallelStream()

plus added indentation.
This change helps run the checks substantially faster on a multi-core CPU since multiple threads are started by parallelStream(). This is possible since the linting can be nicely done in parallel.

I would hesitate to do this for a number of reasons.

Using non-gradle-managed threads means we lose log output
This could exceed the maximum amount of work that is set for the build. On a small project, it might not be a big deal to spawn, say, 10 threads. But on a larger project, you'll have NumModules * 10 (or whatever), and now it's a problem. You're going to prevent gradle from running other tasks in parallel.
I have no idea if Reporters are thread-safe.

PS: We need to update the functional tests to catch potential issues like these.

First off, @samzurcher thank you so much for the contribution! I love when people find potential improvements and do the work to make them happen.
These are some valid concerns @autonomousapps. With reporters, I don't know about thread safety either. At a minimum it might report results in a different order each time, which may or may not impact anyone.
Is using the Gradle Worker API the right solution here? Perhaps it would need to be at the source set (task) level rather than per file if report generation is an obstacle. If so, I imagine formatting could be parallelized too?

@autonomousapps Ok, I see your points:

Ok, better to do this with https://guides.gradle.org/using-the-worker-api/ (as @jeremymailen has mentioned)
Using the worker api from 1. should solve this issue too; agreed?
Ok, I would need to investigate that or even better make a thread-safe wrapper for the reporters.

@jeremymailen Do you know of a use-case in which the order of the reports matter? If so, we could just collect the reports and write them in a sorted way as soon as the processing has finished. This adds the disadvantage though that the reports will be written only at the end.
To be honest, I very much prefer doing it at the file level instead of the source set level as this will allow for much greater use of the available cores.
And agreed, formatting could be parallelized too.
Please decline this pull request. You'll get a new one based on above (and potentially following) discussions one on Monday.

I use the reporters from ktlint and it does look like they are thread safe when it comes to logging each error and starting/ending the processing of the file:
https://github.com/pinterest/ktlint/blob/master/ktlint-core/src/main/kotlin/com/github/shyiko/ktlint/core/Reporter.kt#L4
I don't know if any use cases for the reports being ordered in a certain way, although I could imagine non-stable results could be confusing. I haven't looked at the reporter implementations in detail, but at a quick glance it seems they do some post work to group the results, so all might be well there.

Thank you and I look forward to your new implementation @samzurcher!

Using the Worker API would be preferred, but it still relies on the reporters being thread-safe (depending on how you implement your solution, see below). There are two ways to do it:

Push all the work, together (i.e., the entire source input) into a single work item. This is still better than the current situation, because now Gradle can schedule other tasks within that same project concurrently. (In general, tasks take a lock on a Project instance when they begin execution, preventing other tasks in that same project from executing.) With this scenario, I don't think we need to worry much about thread-safety, since all the "work" is still done in a single thread.
Try to push every file into a separate work item. This should be much faster, but it's more complex to implement, and now thread-safety matters.

And of course we can imagine doing (1) first, and then migrating to (2) later.
The order of reporters would matter if the output order changed between runs. This would have implications for the cacheability of the task. So long as the ordering is eventually sorted, I think it's fine.

As a follow-up to my earlier PS, I think that the functional tests should be updated to include a "multi-module" build. This will provide some guarantees that the Worker migration doesn't break anything. I'm open to working on this, but I don't know when I'll have time.

Closing in favor of https://github.com/jeremymailen/kotlinter-gradle/pull/87
Thank you!


multiple drains cause node context menu to close

https://youtu.be/E-gmK8_Jqfo

No longer an issue in at least 4.1.4


Bugfixes

Most of the fixes above are thanks to https://goreportcard.com/report/github.com/lxc/lxd

jenkins: test this please


readme have a little mistake

in Getting rid of the trophy warning 2
“Launch VitaShell and navigate to ux0:user/savedata/00” ==>>
“Launch VitaShell and navigate to ux0:user/00/savedata”
Think you very much!

ux0:user/savedata/00 ==>> ux0:user/00/savedata
in the 4,7,8

:) it really could be ux0:user/xx/savedata as it can be multiple on DEX

Fixed


Mark brotli as enabled for Chrome M51+

https://chromium.googlesource.com/chromium/src/+/52b672b2462d6a3751a13187a1003e6fffdfbfbd

Already added from another PR, but thanks!


rest: Remove kwargs from rest_path.

The only caller that passes the kwargs argument is the avatar rest path.
The application of kwargs can be rewritten inline with functools.
Self-review checklist

[ ] Self-reviewed the changes for clarity and maintainability
(variable names, code reuse, readability, etc.).

Communicate decisions, questions, and potential concerns.

[ ] Explains differences from previous plans (e.g., issue description).
[ ] Highlights technical choices and bugs encountered.
[ ] Calls out remaining decisions and concerns.
[ ] Automated tests verify logic where appropriate.

Individual commits are ready for review (see commit discipline).

[ ] Each commit is a coherent idea.
[ ] Commit message(s) explain reasoning and motivation for changes.

Completed manual review and testing of the following:

[ ] Visual appearance of the changes.
[ ] Responsiveness and internationalization.
[ ] Strings and tooltips.
[ ] End-to-end functionality of buttons, interactions and flows.
[ ] Corner cases, error conditions, and easily imagined bugs.

I'd expect removing this to let us also remove the Any and mutation rest_dispatch itself, unless I'm missing something?
In any case, did you consider just adding a wrapper function for avatar() called medium_avatar() that just passes an extra parameter?

In any case, did you consider just adding a wrapper function for avatar() called medium_avatar() that just passes an extra parameter?

Yes, that should work as well. My first thought was that partial save us from duplicating the function signature, but probably wrapper is better for readability.

I'd expect removing this to let us also remove the Any
Fixed.

and mutation rest_dispatch itself, unless I'm missing something?

We can't do that yet, because we also need to drop the kwargs for handlers as well. Our view functions aren't expecting keyword arguments like GET.

Yeah, I guess structurally, we need to separate the parameters that were passed to rest_dispatch from the ones that were extracted from by the patterns in the URL, and only pass the latter to the view function.

Merged, thanks @PIG208!


Fix preferences window crash

Closes #107.
Basically just removing some properties from the GtkFontChooserWidget which cause a crash (seemingly in older GTK3 versions)

Thanks! Would you mind adapting the commit msg to the one used in gxi? It looks like this:
fix():
Please see https://gist.github.com/stephenparish/9941e89d80e2bc58a153 for more info :)

And please ping me when you made adjustments, Github doesn't notify me when you push new commits

Maybe add the msg you have added to the PR to the commit too, otherwise it's rather non-obvious why this change has been made

Well, the commit is already paraphrasing the PR, which part do you feel is missing?

At least add a fixes #107 or similiar to the commit msg

Nevermind, mobile github just doesn't display that, sorry! ^^

Thanks!


Add database connection doesn't handle AAD

https://github.com/Microsoft/RTVS/commit/3899f4e70e0ce43eb4468d86de940aec2c0f3c4d


Added section with debug/logging

It's important to know how to log / debug http requests.
Feel free to edit / adapt the text bellow as you wish.

Thanks!


Add unit tests for TarFile class (for #668)

The unit tests mentioned in #668 .
This PR only covers unit tests for the case which #668 fixed, and a simple test for normalize_path interface. It's far from enough but a good start.

I need Windows environment to reproduce the test failure on Windows platform. I will fix it tomorrow.

I am unavailable for the next week or two, so I can't look deeply until March.
That aside, this seems too complex at first. All you needed for a test case was new test data that could exploit the old problem. Changing the test infrastructure at all seems far too complex.

In this PR, I did:

Move assertTarFileContent() function to helper.py which was in tar_write_test.py, because it could be used in both tar_write_test and my new unit test.
Add two simple tests for build_tar.TarFile, which is test_normalize_path and test_add_tree. The latter is to exploit the problem in #668.
Add new test data for the unit test test_add_tree, and append the information of the new file to glob_for_texts_manifest.golden, which is necessary. The new test data is for the case there is a folder to add and can improve the test coverage for test_add_tree.

To make the test simpler, what I can do is:

Remove the test for test_normalize_path.
Remove the new test data.

I'm glad to make those changes later. However, the PR may still look complex after that.

I have removed the test for normalize_path.
However, it seems when the test was running in Windows environment, all files under testdata were copied to runfiles.Create().Rlocation("rules_pkg/tests/testdata/") although I just declared data = [ "//tests:testdata/hello.txt" ] in the BUILD file. See error logs: https://buildkite.com/bazel/rules-pkg/builds/2248 .
I don't know how to fix that, so I still need a subdirectory and test files in this directory. The directory is named build_tar now.
Any ideas for removing the build_tar subdirectory would be appreciated.

I'm OOO this week. Will look next week.
On Wed, Feb 22, 2023, 2:35 AM Qingyu Sui @.***> wrote:

I have removed the test for normalize_path.
However, it seems when the test was running in Windows environment, all
files under testdata were copied to
runfiles.Create().Rlocation("rules_pkg/tests/testdata/") although I just
declared data = [ "//tests:testdata/hello.txt" ] in the BUILD file. See
error logs: https://buildkite.com/bazel/rules-pkg/builds/2248 .
I don't know how to fix that, so I still need a subdirectory and test
files in this directory. The directory is named build_tar now.
Any ideas for removing the build_tar subdirectory would be appreciated.
—
Reply to this email directly, view it on GitHub
https://github.com/bazelbuild/rules_pkg/pull/675#issuecomment-1439507826,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAXHHHFR5UU4GQGS2BUUNHLWYWXRRANCNFSM6AAAAAAU7H2V3U
.
You are receiving this because your review was requested.Message ID:
@.***>

I think this is not an effective test. It sets up the bad condition within the test harness instead of creating the problem situation with normal inputs such as pkg_files targets.
I am presuming you were motivated to #668 because you had a real situation where it occurred. Can you produce a scaled down version of that input, and the test is to simply built the tar file from that.

@aiuto Unfortunately we could never reproduce the issue with pkg_files-like targets.
It's because, in build_tar.py, there is a file_attributes() function which always generates a non-empty mode. See this link.
In our case, we made some modifications in this rules_pkg repo instead of just calling the targets. We called add_tree() from our code without calling main() and add_manifest_entry() -- that's the only way to reproduce this issue, as I did in the test.
However, I think we still need to fix this issue. That's because we may call add_tree() elsewhere someday in the future, and we should never assume that piece of code can generate a non-empty mode as file_attributes() did. After all, the default value of mode is None in the declaration of add_tree().


Support named pipes in PORT

From the report at https://github.com/strongloop/express/issues/2498

A community member submitted a PR to implement this here: https://github.com/expressjs/generator/pull/58


Fill HDR Side Data for HEVC Decoding

Structures for HDR side data have recently been added for HEVC encoding: https://github.com/Intel-Media-SDK/MediaSDK/commit/a9685bf658d1ec97ff44b614dcf75818ecc62819 :

mfxExtContentLightLevelInfo
mfxExtMasteringDisplayColourVolume

What missing is to fill those structures when decoding HEVC video.
Could this be added?

@softworkz , just to be on the same page: would you like to have this reporting from DecodeHeader and together with each output frame (if there're per frame SEI), right?

@softworkz , just to be on the same page: would you like to have this reporting from DecodeHeader and together with each output frame (if there're per frame SEI), right?

Correct. From all videos that I've seen so far, even with static HDR (like HDR10), the data is in every frame (SEI type 137 and 144 IIRC).
Purposes:

Re-Encoding while keeping HDR data
e.g. just scaling down while retaining color format and HDR (you've already done the encoding side)
The data is required for tone mapping

It's a prerequisite for this: https://github.com/Intel-Media-SDK/MediaSDK/issues/1949
But even right now it's a problem when doing tone mapping for example with OpenCL, because QuickSync decoders (unlike VAAPI) do bitstream and codec parsing, so it's not possible to get at this data (e.g. using ffmpeg)

Thanks for details. Yes, we can do it but please expect some delay, ~2 weeks.

2 weeks? That's not a delay - that would be awesome 😆

@pengxin99 Could you please take a look? Thanks.

Thanks for details. Yes, we can do it but please expect some delay, ~2 weeks.

@dmitryermilov  @pengxin99 - Is there any progress in sight on this issue?

@softworkz Sorry for slow response. As you know, we are transferring from MSDK legacy to oneVPL (https://github.com/oneapi-src/oneVPL-intel-gpu). For legacy branch, it has been implemented by @pengxin99 with extension buffer. But this flow cannot be used in VPL architecture. We are evaluating the path and will update it ASAP.

Only the "legacy" path is of interest at this time. Will the implementation from @pengxin99 be merged?

For Linux we could easily merge this patch ourselves, but not for Windows - that's the big problem.
Or is	 there a way how we could build our own libmfxhw64.dll for Windows?

@softworkz
In general, we will not add new feature into legacy path and just bug fix. Of course, you could use @pengxin99's legacy PR. Windows code isn't included in current repo (https://github.com/Intel-Media-SDK). @dmitryermilov @onabiull Could we provide binary build beyond the normal release build?

Or even better - could we get the Windows code (maybe under NDA) to build our own binaries?
Thanks,
sw

Binary for NDA user - I assume it's possible. Code for NDA user - there should be a very strong request, unlikely to be approved but I can double check. Please send me a formal email including company name.

Hi Dmitry, thanks I'll follow up offline!

Fixed by https://github.com/Intel-Media-SDK/MediaSDK/pull/2726. Manual update: https://github.com/Intel-Media-SDK/MediaSDK/pull/2876/files.
Windows changes will be merged today. Please expect a few (2-8) weeks delay to get updated msdk/vpl run-time library in public graphics driver packages.

Hey Dmitry,
thanks that's great news!
Now we will just need to let it land in ffmpeg ;-)
I'll check with @xhaihao whether he wants to do it. Otherwise I'll try to find some time.
Thanks again,
softworkz

@softworkz Yes, we will check the latest driver.
@dmitryermilov it is available in the latest oneVPL GPU runtime on both Linux & Windows, right ? Does MediaSDK support it ?

@xhaihao Yes, It is common code for both Windows and Linux. MediaSDK also supports it.

Right

@dmitryermilov @wangyan-intel If user provides MFX_EXTBUFF_MASTERING_DISPLAY_COLOUR_VOLUME & MFX_EXTBUFF_CONTENT_LIGHT_LEVEL_INFO extended buffers, is there a flag indicating valid HDR data is returned from the SDK?

Good question, @xhaihao . I have to admit it looks as a gap.
I can propose only to rely on checking non zero MaxDisplayMasteringLuminance/MaxContentLightLevel ..

however 0 is a valid value for max_content_light_level and max_pic_average_light_level

BTW is this added for av1 decoding ?

Not yet

@dmitryermilov @wangyan-intel If user provides MFX_EXTBUFF_MASTERING_DISPLAY_COLOUR_VOLUME & MFX_EXTBUFF_CONTENT_LIGHT_LEVEL_INFO extended buffers, is there a flag indicating valid HDR data is returned from the SDK?

@pengxin99 Could you please clarify it? Thanks

Are RGB x coordinates stored in DisplayPrimariesX[3] in R=>G=>B order, or G=>B=>R order ?

hi, @xhaihao , At first, we wanted to use InsertPayloadToggle in the struct mfxExtMasteringDisplayColourVolume to indicate whether the decoded clips have HDR SEI, but the  InsertPayloadToggle was designed for encoding originally, so we did not use this plan.
The current way is that if the value of all members in the struct mfxExtMasteringDisplayColourVolume are 0, it means that there is no HDR sei in the decoded clips, and vice versa.

is it possible to use a reserved byte in mfxExtMasteringDisplayColourVolume and mfxExtContentLightLevelInfo to indicate whether the driver writes valid data back ?

Are RGB x coordinates stored in DisplayPrimariesX[3] in R=>G=>B order, or G=>B=>R order ?

For the DisplayPrimariesX[3], We just parse the SEI of clips storage information in order, and according to the spec, it should be G=>B=>R order.

is it possible to use a reserved byte in mfxExtMasteringDisplayColourVolume and mfxExtContentLightLevelInfo to indicate whether the SDK writes valid data back ?

I think this way can be considered, I will discuss it with @wangyan-intel @dmitryermilov for this. If it is fine, I will continue to add this flag.

Are RGB x coordinates stored in DisplayPrimariesX[3] in R=>G=>B order, or G=>B=>R order ?

For the DisplayPrimariesX[3], We just parse the SEI of clips storage information in order, and according to the spec, it should be G=>B=>R order.

Thanks, so for encoding, user should pass RGB coordinates to the SDK in G=>B=>R order too, right ?

Yes, we can extend the API but then the solution would apply only for VPL API and only for VPL-run-times (>=TGL). In other words it won't work on BDW, APL, SKL, ICL systems.
What option I can suggest:

New API as discussed above
Rely on existing InsertPayloadToggle api field but in this case we break semantic of this API field.

Yes, we can extend the API but then the solution would apply only for VPL API and only for VPL-run-times (>=TGL). In other words it won't work on BDW, APL, SKL, ICL systems. What option I can suggest:
1. New API as discussed above

2. Rely on existing InsertPayloadToggle api field but in this case we break semantic of this API field.

If so, I think option 2 would be a better way because user may use this API on legacy devices.

@softworkz  https://github.com/intel-media-ci/ffmpeg/pull/518 may fetch HDR data when decoding and keep HDR data when encoding in FFmpeg-QSV, you may have a try if you're interested.
Note the SDK failed to fetch HDR data for some special clips.

Oh, that was quick! Thanks a lot for taking care of this.
I'll surely try in the next few days, I got some ffmpeg tasks anyway!

Note the SDK failed to fetch HDR data for some special clips.

@pengxin99  The SDK failed to parse SEI when SEI nal unit is located before a valid SPS, hence m_Headers.m_SEIParams.GetHeader(SEI_MASTERING_DISPLAY_COLOUR_VOLUME) return NULL.

Note the SDK failed to fetch HDR data for some special clips.

@pengxin99 The SDK failed to parse SEI when SEI nal unit is located before a valid SPS, hence m_Headers.m_SEIParams.GetHeader(SEI_MASTERING_DISPLAY_COLOUR_VOLUME) return NULL.

thanks for clarifying this, does this mean the special clip is an error clip?

Hi,
long time after I had asked here for providing the HDR data, I had discovered the existence of the MFXVideoDECODE_GetPayload API.
In December I had sent an ffmpeg patch to make use of this for retrieving various kinds of SEI data.
The weird thing is that I can get some SEI data this way, but I couldn’t get it working consistently for the HDR information (CLL and MDCV). Here's an excerpt;
while (1) {
    int start;
    memset(&data[0], 0, sizeof(data));

    ret = MFXVideoDECODE_GetPayload(q->session, &ts, &payload);
    if (ret != MFX_ERR_NONE) {
        av_log(avctx, AV_LOG_WARNING, "error getting SEI payload: %d \n", ret);
        return ret;
    }

    if (payload.NumBit == 0 || payload.NumBit >= sizeof(data) * 8) {
        break;
    }

    start = find_start_offset(data);

    switch (payload.Type) {
        case SEI_TYPE_BUFFERING_PERIOD:
        case SEI_TYPE_PIC_TIMING:
            continue;
        case SEI_TYPE_MASTERING_DISPLAY_COLOUR_VOLUME:
        case SEI_TYPE_CONTENT_LIGHT_LEVEL_INFO:
            // There seems to be a bug in MSDK for these
            payload.NumBit -= 8;
            break;
    }

    if (init_get_bits(&gb, &data[start], payload.NumBit - start * 8) < 0)
        av_log(avctx, AV_LOG_ERROR, "Error initializing bitstream reader");
    else
        ret = ff_hevc_decode_nal_sei(&gb, avctx, &sei, &ps, HEVC_NAL_SEI_PREFIX);
  .....
}

While I couldn't get the data properly, what does work though (IIRC) is to get the information whether the data exists. So maybe it would be possible to use a combined approach:
•	Use MFXVideoDECODE_GetPayload for checking whether the data exists
•	Use MFX ext buffers to retrieve the data
It’s not really elegant, but maybe it could work right now without needing to wait for any changes from the MSDK side?
softworkz

@softworkz ,
Code looks good except I don't see how you init data. App is responsible for memory allocation for mfxPayload.
@wangyan-intel , can you please ask someone to take a look at GetPayload when bitstream has HDR SEI?

Hi @softworkz ,

I couldn’t get it working consistently for the HDR information (CLL and MDCV)

do you mean the HDR sei get from MFXVideoDECODE_GetPayload is not aligned with the HDR sei from clips? if so, does all the HDR sei from MFXVideoDECODE_GetPayload are error values?

@pengxin99 will help this. Thanks

@dmitryermilov @pengxin99 @wangyan-intel  MFXVideoDECODE_DecodeFrameAsync output frame in display order, is the payload returned from MFXVideoDECODE_GetPayload in display order too ?

GetPayload returns payloads in FIFO order. Since bitstream is encodedOrder, payloads will be in encodedOrder as well. App is expected to associate payloads with frames by output timestamps "mfxU64 *ts".

GetPayload returns payloads in FIFO order. Since bitstream is encodedOrder, payloads will be in encodedOrder as well. App is expected to associate payloads with frames by output timestamps "mfxU64 *ts".

APP will have to maintain a payload list If user want to find out the right payload for the output frame returned from MFXVideoDECODE_DecodeFrameAsync,  right ?

Right

@softworkz , Code looks good except I don't see how you init data. App is responsible for memory allocation for mfxPayload. @wangyan-intel , can you please ask someone to take a look at GetPayload when bitstream has HDR SEI?

The full code is here (scroll down to "Patch"<EMAIL_ADDRESS>(complete patch series: https://patchwork.ffmpeg.org/project/ffmpeg/list/?series=5353)

Hi @softworkz ,

I couldn’t get it working consistently for the HDR information (CLL and MDCV)

do you mean the HDR sei get from MFXVideoDECODE_GetPayload is not aligned with the HDR sei from clips? if so, does all the HDR sei from MFXVideoDECODE_GetPayload are error values?

I don't remember exactly, but I think It was something regarding alignment. I'm not doing the side data decoding myself. Instead I'm just plumbing it together with ffmpeg's SEI decoding and this works fine for several SEI data types, but not for HDR data.

GetPayload returns payloads in FIFO order. Since bitstream is encodedOrder, payloads will be in encodedOrder as well. App is expected to associate payloads with frames by output timestamps "mfxU64 *ts".

APP will have to maintain a payload list If user want to find out the right payload for the output frame returned from MFXVideoDECODE_DecodeFrameAsync, right ?

My primary use case so far has been to decode closed captions side data (EIA-608/708) for

subtitle filtering (a new ffmpeg feature for which I have submitted a huge patch series)
re-injecting CC data when encoding

This has been working fine in all private and public tests with MPEG2, H.264 and H.265 without needing to re-order or re-associate side data to frames, so I'm wondering whether any re-ordering will be required.
The sequence is roughly like this:

MFXVideoDECODE_DecodeFrameAsync(q->session, avpkt->size ? &bs : NULL, insurf, &outsurf, sync);
...
out_frame = find_frame(q, outsurf);
...
Loop:
MFXVideoDECODE_GetPayload(q->session, &ts, &payload);
"Decode Payload"
"Add payload data to out_frame"
End loop

Are you saying that this could lead to incorrect association between frames and side data?

Hi @softworkz ,
I think it's not fully right. Firstly, there're might be several payloads per frame. Plus, let's keep in mind frames reordering. MFXVideoDECODE_GetPayload returns payload internally detected by decoder during bitstream parsing( which is always in decoded order). Let's consider IB1P1B2P2 pattern in display order. In decoded order it will be IP1B1P2B2. So e.g. when app gets B1 frame to displaying, it means P1 frame  is already decoded so CC data for P1/B1 are already consumed by decoder. If so, the first GetPayload() call return CC for P1, then 2nd GetPayload() returns CC for B1. Etc.. And app needs to maintain this association.

there're might be several payloads per frame

Note the "Loop".

Plus, let's keep in mind frames reordering. MFXVideoDECODE_GetPayload returns payload internally detected by decoder during bitstream parsing( which is always in decoded order). Let's consider IB1P1B2P2 pattern in display order. In decoded order it will be IP1B1P2B2. So e.g. when app gets B1 frame to displaying, it means P1 frame is already decoded so CC data for P1/B1 are already consumed by decoder. If so, the first GetPayload() call return CC for P1, then 2nd GetPayload() returns CC for B1. Etc.. And app needs to maintain this association.

In another conversation with HaiHao, we determined that the reason why I haven't seen any issues with CC so far is probably because B-frames usually don't occur in TV broadcast signals.
Thanks for the explanation, I will update my patch accordingly.
What remains is the issue about HDR side data. I will shortly look at in again, then I might be able to provide more information.
Thanks,
softworkz

Thank you

Earlier than expected I was able to do some more research on this subject. I compiled a collection of 14 HEVC HDR videos from different sources (Sony, Samsung, Doby, etc) and  I added some logging to document the loop of SEI reading and parsing, based on the code of the referenced patchset.
For starting I removed the Numbit corrections that I had. Starting with an arbitrary test file I got this output (for a single SEI loop):

What we can see from it is:

an error occurs when parsing MDD (137) data
but both, MDD and CLL data are parsed correctly

Last year I had researched the cause of that error: it's the mfxPayload.Numbit  field which is 8 bits too large in case of MDD data.
Today's tests have also shown that this is consistent and constant with all of my test files.
So I re-applied that fix:

which leads to the following result without errors:

Then I tried another file which gives this result:

This time, the error is about CLL (144). When we look at the NumBits value, it is 56, but in the working case above it was 8 bits less: 48. That's how I came to apply the same fix (NumBits -= 8) for CLL data last year.
When I do this, the error is gone;

But now, the first file will error out - this time on the CLL data:

Assuming that CLL data has a fixed size, I just set NumBits to 48:

With that change, all test files finally ran without errors with MDD and CLL data.

But there's a similar issue with closed captions data (4) but it manifests in a different way.
I had seen this in users' log files before, but now I could reproduce with one of the test files:
When start to run, there are at first dozens of errors about the NumBits value, which seems to be by 24 bits too large (552).
At some point, it suddenly changes to 528 and from then on, all goes well until the end of the file:

Conclusion
There's no misaligment of the payload data. The data is always offset correctly and can be parsed successfully.
It's the NumBits value that doesn't seem to be set correctly in all cases.
I don't think that there's anything wrong in ffmpeg, because the code is used by multiple decoders and other consumers of the decode API consider errors from the SEI parsing API as hard errors and are stopping ffmpeg. When I had encountered these issues last year, I had tested the same files with other decoders (hwa and software) and none of the others had errored. For that reason, I don't think this is an issues with some of the files.
I hope those details will be helpful for you to find out what's happening on your side.
Thanks,
sw

@softworkz , thank you for these details. Is the content, which you tried, public?

Partly. I'll contact you privately.


Fix curl importers when input contains escaped array params

In Chrome on Windows, the Copy as cURL (bash) action is escaping array query params.
We are getting the following url: 'http://example.com/?a\[0\]=1&a\[1\]=1'
Unfortunately, the importers will parse the params without unescaping the keys, which will create incorrect params:
{
  "disabled": false,
  "name": "a\[0\]",
  "value": "1"
}

To fix it, I did a simple change replacing any \[ \] into non-escaped value [ ] in the key name.
Closes #1963

Closed as stale.


High idle CPU usage with web app (conversations view)

Hello, new to BlueBubbles but very excited for the potential here. I haven't used the web app much, but off the bat I'm noticing very high CPU usage with the app idle, but focused (2 threads, 50% and 25% of an i5-1135G7). I've got the app "installed" to the desktop, so it's in its own window and the only Chromium window open, but I've reproduced the same behavior with the app as a tab. With the app in a standard tab and when it's not focused/foreground the CPU usage is not high, so that's a workaround. I've tried "low memory mode" so far without success. I've also tested in Firefox and CPU usage is perhaps a touch higher.
Host details

Pop!_OS 21.04 (Linux 5.15)
Chromium Version 96.0.4664.110 (Official Build) (64-bit)

Web app status

Connection Status: CONNECTED
Private API Status: ENABLED
Private API Helper Bundle Status: DISCONNECTED
Latency: 56 ms
Server Version: 0.4.0
macOS Version: 11.6.0

This may be a Flutter bug or a Chromium bug where the tab isn't suspended when it isn't functioning as a "normal" tab. We can try and look into it - the webapp is definitely on the heavy side just because it has a very similar feature set and functionality compared to the dedicated Android and Desktop apps (which I highly recommend checking out the latter on your main Linux machine - join our Discord to get a build).

Same here with latest Edge browser. CPU usage is constanstly 4%.

I just ried latest desktop alpha for windows, but eats 10% cpu :/

I just ried latest desktop alpha for windows, but eats 10% cpu :/

Are you viewing a lot of images in a chat? Try going in the settings page or something and seeing if the usage is still 10%.
Mine hovers between 5-10% in a chat, but in settings its 0-1%.

Yeah, it only seems to affect conversation view. If you haven't selected a convo, CPU usage is pretty tame.

Yeah, it only seems to affect conversation view. If you haven't selected a convo, CPU usage is pretty tame.

(Linux user, PopOs as well as Solus) Wow, Hadn't thought to unselect the message thread, but doing that drops the CPU usage down to almost nothing. Thanks for the tip!
It would be nice if minimizing the app did this automatically though. I usually keep it minimized in the tray and have always been surprised to see it constantly using ~30% of a single core, doing "nothing"

This is really wild. When I select a conversation in Chrome, CPU usage in the Chrome Task Manager for the tab shoots up to over 30%, sometimes over 60%. And yes, that happens while in focus, but that still seems wildly unacceptable to me. If I'm watching a YouTube video fullscreened on one monitor, and open the BlueBubbles web app on another monitor, YouTube playback slows to a crawl and eventually stops altogether. I've never seen any other page do this before. What's spinning on this page so hard?

What's spinning on this page so hard?

Its really hard to pinpoint this to be honest. We don't run background tasks or anything like that, I honestly think its just the complexity of the UI that causes the high CPU usage (graphics usage). Flutter Web doesn't use HTML elements in the same way React does, it draws stuff to canvas directly. Images and video especially are really unoptimized, but they've said they fixed this in the latest Flutter 3.0 update, so hopefully that improves the performance some.
Nevertheless we will keep trying to improve the performance as time goes on... if you are using this on your main machine I would highly recommend using our dedicated desktop app instead. Performs a lot better and is overall better UX.

Yeah, I think I've encountered a similar issue with another Flutter app. Note this behavior is consistent in the web app and Linux desktop app, or at least it was.

The issues with CPU usage have been found and fixed for the next update on the webapp.


VPN not working after update to 22.1.10

Hi,
after the update to OPNsense 22.1.10 the VPN Gateway is not created and therefore can't be used in firewall rules.
In the Wiregaurd settings there is a Endpoint configured and there is a Handshake been untertaken, so it seems the script partly works.

Set it up years ago, always worked fine.

Has the interface change?  I assume it was wg0 before, I can't see why it would have changed though.
SSH in and do /conf/PIAWireguard.py debug, can you show the output of the script in here please :-)

The script is failing to connect to the web server on OPNsense, have you changed the port it listens on?
TCP port for WebUI is listed here System: Settings: Administration


add travis_retry and Python 3.5 to install

I've added Python 3.5 to the .travis.yml and added some tricks to the install.sh that I found across SO and the conda travis recipe itself. Making it more reliable via travis_retry and downloading the slightly smaller miniconda2 when possible. Hope it's of use to you.

AppVeyor doesn't pass but I didn't change anything there. It seems to be a problem with the binstar token.


Update alm-examples in MongoDB CSV

This PR is for internal review. Once approved I'll make a PR into the upstream.
This removes the status fields from the examples, addressing https://github.com/mongodb/mongodb-enterprise-kubernetes/issues/48, and updates them to use non-deprecated fields. I also made it a lot easier to read them.
For easy comparison, this is what the unescaped fields were previously:
[
  {
    "kind": "MongoDB",
    "apiVersion": "mongodb.com/v1",
    "metadata": {
      "name": "sample-replica-set"
    },
    "spec": {
      "version": "4.0.10",
      "type": "ReplicaSet",
      "project": "my-project",
      "persistent": false,
      "members": 3,
      "credentials": "my-credentials"
    },
    "status": {
      "version": "4.0.10",
      "type": "ReplicaSet",
      "phase": "Running",
      "members": 3,
      "link": "https://cloud.mongodb.com/v2/5d35f7cdbf994268c3",
      "lastTransition": "2019-07-23T09:00:00Z"
    }
  },
  {
    "apiVersion": "mongodb.com/v1",
    "kind": "MongoDB",
    "metadata": {
      "name": "sample-sharded-cluster"
    },
    "spec": {
      "configServerCount": 3,
      "credentials": "my-credentials",
      "mongodsPerShardCount": 3,
      "mongosCount": 2,
      "persistent": false,
      "project": "my-project",
      "shardCount": 1,
      "type": "ShardedCluster",
      "version": "3.6.8"
    },
    "status": {
      "lastTransition": "2019-07-23T09:00:00Z",
      "phase": "Running"
    }
  },
  {
    "apiVersion": "mongodb.com/v1",
    "kind": "MongoDBUser",
    "metadata": {
      "name": "sample-user"
    },
    "spec": {
      "db": "$external",
      "project": "my-project",
      "roles": [
        {
          "db": "admin",
          "name": "clusterAdmin"
        }
      ],
      "username": "CN=mms-user-1,OU=cloud,O=MongoDB,L=New York,ST=New York,C=US"
    }
  },
  {
    "apiVersion": "mongodb.com/v1",
    "kind": "MongoDBOpsManager",
    "metadata": {
      "name": "ops-manager"
    },
    "spec": {
      "version": "4.2.0",
      "adminCredentials": "ops-manager-admin",
      "configuration": {
        "mms.fromEmailAddr"<EMAIL_ADDRESS>      },
      "applicationDatabase": {
        "members": 3,
        "version": "4.2.0",
        "persistent": true,
        "podSpec": {
          "cpu": "0.25"
        }
      }
    }
  }
]

@chatton @rodrigovalin @LouisPlisso @antonlisovenko to review


updating the program?

When changes come along do we just download & rerun the MSI? is there a place to check for upgrades built in?

Yes, just rerun the MSI. Updating is possible but I just wait for this to be implemented/

Can we please get local CKPT models to be implemented instead of running off the tokens through web


Build(deps-dev): Bump jest from 27.4.4 to 27.4.5 (#2175)

Pull request opened by the merge tool on behalf of #2175

Merged in 2cb708ead6942901b82a5f58dc83e79200f937d9


Improve resizing of long help-text boxes

Text boxes showing BIDS help for specific fields seem to be cut off

This should be fixed in the current dev version of ezBIDS. We should be release the new version by the end of this week (right @dlevitas?)

If its alright, let's hold off updating ezBIDS until next week.
Once updated, issues like this will be resolved.

Now fixed in latest ezBIDS update


Added Doucment.md content for nodejs pkce

Node js code is available in the branch, add the step by step document for node js and refer the link in the Readme.md file with node js heading.

I fixed it . please review.
https://github.com/pareek-narendra/pkce/pull/10

Thanks for the contribution @VershaGupta. This is under review.


Automated PR: Standardising Files

This PR will standardise the files we have with out agreed spec in sous-chefs/repo-management.
This repo has been identified by topic(s) of chef-cookbook

          1 Error

:no_entry_sign:
Please include a CHANGELOG entry.

  Generated by :no_entry_sign: Danger

Released as: 1.0.7


ci(.github/workflows): remove verbose and fix covermode

:heavy_check_mark: Checklist:

[ ] Have only one commit (if not, squash them into one commit)
[ ] Tests for the changes have been added (for features / bug fixes / refactoring)

Codecov Report

:exclamation: No coverage uploaded for pull request base (main@3bd3fed). Click here to learn what that means.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main     #245   +/-   ##
=======================================
  Coverage        ?   71.99%
=======================================
  Files           ?       16
  Lines           ?      582
  Branches        ?        0
=======================================
  Hits            ?      419
  Misses          ?      130
  Partials        ?       33

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 3bd3fed...e339a00. Read the comment docs.


feat(node-cpu-hog): Using custom input for number of cores in node cpu hog experiment

Signed-off-by: Udit Gaurav<EMAIL_ADDRESS>
What this PR does / why we need it:
We have to take the number of cores of CPU by user to run node CPU hog experiment. It will be an optional value to be passed. If the user choose to pass an empty value then the hogging will be done by checking the node CPU capacity (current way)
Which issue this PR fixes (optional, in fixes #<issue number>(, fixes #<issue_number>, ...) format, will close that issue when PR gets merged): fixes #
Checklist

[ ] Does this PR have a corresponding GitHub issue?
[ ] Have you included relevant README for the chaoslib/experiment with details?
[ ] Have you added debug messages where necessary?
[ ] Have you added task comments where necessary?
[ ] Have you tested the changes for possible failure conditions?
[ ] Have you provided the positive & negative test logs for the litmusbook execution?
[ ] Does the litmusbook ensure idempotency of cluster state?, i.e., is cluster restored to original state?
[ ] Have you used non-shell/command modules for Kubernetes tasks?
[ ] Have you (jinja) templatized custom scripts that is run by the litmusbook, if any?
[ ] Have you (jinja) templatized Kubernetes deployment manifests used by the litmusbook, if any?
[ ] Have you reused/created util functions instead of repeating tasks in the litmusbook?
[ ] Do the artifacts follow the appropriate directory structure?
[ ] Have you isolated storage (eg: OpenEBS) specific implementations, checks?
[ ] Have you isolated platform (eg: baremetal kubeadm/openshift/aws/gcloud) specific implementations, checks?
[ ] Are the ansible facts well defined? Is the scope explicitly set for playbook & included utils?
[ ] Have you ensured minimum/careful usage of shell utilities (awk, grep, sed, cut, xargs etc.,)?
[ ] Can the limtusbook be executed both from within & outside a container (configurable paths, no hardcode)?
[ ] Can you suggest the minimal resource requirements for the litmusbook execution?
[ ] Does the litmusbook job artifact carry comments/default options/range for the ENV tunables?
[ ] Has the litmusbooks been linted?

Special notes for your reviewer:

Logs:

node-cpu-core.txt


Cleanups for 2.1.1 proper version tagging

RC1 had improper version numbering, and the Makefile script fails when the RC number is 1. This isn't a full workaround but it gets us in place to build and release 2.1.1 proper.

@janl please review again.
To bump the version number, you'll still need to modify both version.mk and rel/reltool.config. I'll update the release procedure with this info for now.
The new command for building an RC, say RC2, is COUCH_RC=2 make dist. If accepted for merge I'll also merge to master and update the wiki page.
The nice thing is that make rc is completely gone, as it was mostly just redoing what make dist had been getting wrong. I dropped the git diff a) because it wouldn't work for RC1, b) it wouldn't show the changes from the last release, only the last RC, and c) there are ways of getting this info through GitHub anyway that are formatted more nicely for a release manager these days.

nice work

Wiki has been updated.


feat: remove info log when disable log

feat: remove info log when disable log

Logs are ignored when disabled.

I am not sure the question, I thought we should avoid logging too much as
info.
Best Regards,
Gene Woo
On Wed, Oct 19, 2022 at 11:19 AM chowyu12 @.***> wrote:

https://github.com/zeromicro/go-zero/blob/master/zrpc/internal/serverinterceptors/statinterceptor.go#L65
still info here?
@kevwan https://github.com/kevwan @genewoo https://github.com/genewoo
—
Reply to this email directly, view it on GitHub
https://github.com/zeromicro/go-zero/pull/2525#issuecomment-1281687909,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AACO6VMBFHWN7NWQNFE6M7DWD5SFVANCNFSM6AAAAAARGZITGQ
.
You are receiving this because you were mentioned.Message ID:
@.***>

@genewoo yes, especially , add to notLoggingContentMethods


Idea: Tag different shapes/slides so that they can be edited together...

Problem
I'm always frustrated when I have to create multiple "versions" of the same ppt file for different audiences [say, one for employees and one for contractors] or different purposes [one for printing, for presenting].
The frustration is because its only some slides that change or need to be hidden or grouped differently.
Solution
If we could tag the slides, then we could perform actions on slides/shapes based on which tag they have.....This is based on Microsofts own thought process available at [https://learn.microsoft.com/en-us/office/dev/add-ins/powerpoint/tagging-presentations-slides-shapes]
Alternatives
At this point creating text shapes and hiding them on slide or below the slide are kludgey and depend on search capability [manual and hence error-prone]
Additional context
Steve Rindsberg of ppttools has created [https://www.rdpslides.com/pptfaq/FAQ01017_Creating_Teacher_-_Student_editions_of_presentations.htm] a freeware add-in that could have served as a proof-of-concept. Unfortunately, it doesn't work with current version of powerpoint.

Hi, thanks for your feedback!
With Instrumenta you can already tag slides and select them based on the tag. In the Manage tags screen you can add custom tags to slides and perform actions based on it. Currently you can select slides (and e.g. remove them manually) that have a certain tag.

What you're suggesting is I guess broader. You want to be able to tag individual objects on the slide and perform certain actions based on that? That is possible (and quite easy to implement), but what would be the actions that you would need?

Unclear what the new functionality would be.


Updating unit tests

This is a work in progress for updating the unit tests for Poseidon.

[x] Unit test for k8sclient package
[x]  Unit test for the firmament package
[x] Running E2E test against local cluster with Firmament and Poseidon readily deployed
[x]  Unit tests for the stats package

/assign @dhilipkumars

/lgtm


3.2.0 does not handle Set-Cookie as expected

Here is a reproduction that sets two cookies and outputs them, once via getSetCookie, once via forEach:

r.mjs
import {Headers} from "headers-polyfill";
// import {Headers} from "undici";

const h = new Headers();
h.append(
    "set-cookie",
    "a=a; Expires=Wed, 21 Oct 2015 07:28:00 GMT",
);
h.append(
    "Set-Cookie",
    "b=b; Expires=Wed, 21 Oct 2015 07:28:00 GMT",
);

const cookies = [];
h.forEach((value, key) => {
    cookies.push(value);
});
console.log("cookies via forEach:", cookies);

console.log("cookeis via getSetCookie", h.getSetCookie())

$ node r.mjs
cookies via forEach: [
  'a=a; Expires=Wed, 21 Oct 2015 07:28:00 GMT, b=b; Expires=Wed, 21 Oct 2015 07:28:00 GMT'
]
cookeis via getSetCookie [
  'a=a; Expires=Wed',
  '21 Oct 2015 07:28:00 GMT',
  'b=b; Expires=Wed',
  '21 Oct 2015 07:28:00 GMT'
]

I would expect forEach and getSetCookie to produce the same result, an array with two entries, one for each cookie.
With undici, we get the expected result:
$ node r.mjs
cookies via forEach: [
  'a=a; Expires=Wed, 21 Oct 2015 07:28:00 GMT',
  'b=b; Expires=Wed, 21 Oct 2015 07:28:00 GMT'
]
cookeis via getSetCookie [
  'a=a; Expires=Wed, 21 Oct 2015 07:28:00 GMT',
  'b=b; Expires=Wed, 21 Oct 2015 07:28:00 GMT'
]

Released: v3.2.1 🎉
This has been released in v3.2.1!

📄 Release notes
📦 npm package

Make sure to always update to the latest version (npm i headers-polyfill@latest) to get the newest features and bug fixes.

Predictable release automation by @ossjs/release.


add logdiff.sh tool to help analyze test logs between runs.

This small tool should allow us to remove always changing information like UUIDS, timestamps, dates etc. from log files.
It can be used to easily diff two log files from different test runs. The diff should then show only significant differences.

This seems harmless. Could you please rebase?

Note that orthogonal changes don't need to be rebased by the contributor (it's nice but necessary as this can be done as part of accepting the pull request).

@domdom82 can you elaborate the instructions to show how to use this more fully - specifically, how does one get the activation logs to run this script.

I have added some more detailed info on how to get logs.
We usually copy out logs from a previous stable Jenkins build and a failed build after we detect errors. The readme describes how to do it manually using wskadmin.
Also rebased and squashed.

Excellent! Thanks.