Reload map on prefix+suffix change on a formula dataview

@alonsogarciapablo missed some attrs in #1048  :disappointed:

:+1:


ReferenceError: require is not defined in ES module scope, you can use import instead

Environment
What version are you running? Etc.
I'm running node 20 with SvelteKit. This happens inside my Docker container (node:20), and in my Windows PC.
Steps to Reproduce

Create a SvelteKit project
Use Sentry
pnpm build
node build (to serve)

Expected Result
Serve the bundled js with a node http server.
Actual Result
file:///D:/vscode/xxxx/build/server/chunks/index.server---lhU4i_.js:91216
var releaseInjectionFilePath = require.resolve("@sentry/bundler-plugin-core/sentry-release-injection-file");
                               ^

ReferenceError: require is not defined in ES module scope, you can use import instead
This file is being treated as an ES module because it has a '.js' file extension and 'D:\vscode\xxxx\package.json' contains "type": "module". To treat it as a CommonJS script, rename it to use the '.cjs' file extension.
    at file:///D:/vscode/xxxx/build/server/chunks/index.server---lhU4i_.js:91216:32
    at ModuleJob.run (node:internal/modules/esm/module_job:217:25)
    at async ModuleLoader.import (node:internal/modules/esm/loader:316:24)
    at async Server.init (file:///D:/vscode/xxxx/build/server/chunks/index-cn-9jQeW.js:3903:24)
    at async file:///D:/vscode/xxxx/build/handler.js:1130:1

Node.js v20.9.0

Hi @polvallverdu thanks for writing in! Would you mind sharing a minimal reproduction example (e.g. as a github repo) so we can debug this? Haven't seen this error before. Do you use other Vite plugins in your Sveltekit app or any special vite or svelte config that is not present by default? Thanks!

Non other than the one included with sveltekit. I'm using the node adapter (SSR). Here's a barebones repo I've created to actually reproduce the issue. When running pnpm build && pnpm preview it works, but when building the container and running it from the nodejs http server, it just doesn't (running node build locally also makes the error happen).
https://github.com/polvallverdu/sentry-svelte-test
2024-01-08 12:24:11 node:internal/modules/esm/resolve:844
2024-01-08 12:24:11   throw new ERR_MODULE_NOT_FOUND(packageName, fileURLToPath(base), null);
2024-01-08 12:24:11         ^
2024-01-08 12:24:11
2024-01-08 12:24:11 Error [ERR_MODULE_NOT_FOUND]: Cannot find package '@sentry/sveltekit' imported from /app/build/server/chunks/hooks.server-GtpXkpQ4.js
2024-01-08 12:24:11     at packageResolve (node:internal/modules/esm/resolve:844:9)
2024-01-08 12:24:11     at moduleResolve (node:internal/modules/esm/resolve:901:20)
2024-01-08 12:24:11     at defaultResolve (node:internal/modules/esm/resolve:1121:11)
2024-01-08 12:24:11     at ModuleLoader.defaultResolve (node:internal/modules/esm/loader:396:12)
2024-01-08 12:24:11     at ModuleLoader.resolve (node:internal/modules/esm/loader:365:25)
2024-01-08 12:24:11     at ModuleLoader.getModuleJob (node:internal/modules/esm/loader:240:38)
2024-01-08 12:24:11     at ModuleWrap.<anonymous> (node:internal/modules/esm/module_job:85:39)
2024-01-08 12:24:11     at link (node:internal/modules/esm/module_job:84:36) {
2024-01-08 12:24:11   code: 'ERR_MODULE_NOT_FOUND'
2024-01-08 12:24:11 }
2024-01-08 12:24:11
2024-01-08 12:24:11 Node.js v20.10.0

@polvallverdu I found the problem: @sentry/sveltekit was added to your devDependencies instead of dependencies. This will cause Vite and pnpm to treat the package differently, producing errors like the one you encountered.
If I move the package to dependencies in package.json, re-install and build with pnpm and run with node build, everything works again.
I'm gonna close this issue as I'm fairly certain that this is the cause for the reported error. Please let me know if the issue still persists on your end.
Our of curioisity: Did you install the SDK manually or via the wizard? If the wizard added the SDK to devDependencies then there's a bug in the wizard we should fix.

That was it! Thank you so much. Have a great day

Thank you for the suggestion. It worked for me too, just that in my case I was using another dependency that I installed in devDepencies.


Minor changes to payment page

On these two pages:
http://resourceprojects.org/transfers_by_gov
http://resourceprojects.org/transfers

In the table header rename column: Paid by -> Company

In the table header rename column: Paid to -> Country

Add a country filter next to other filters, in this order: Year, Currency, Country, Company (rename paid by), Type.
Default value for country should be show all countries.

4)Put all filters into a box
5) Move the two buttons further up.

Can we have the list in the filter boxes in alphabetical order? (except for show all..)

Should I implement such alphabetical filtering at all the pages? Or Just at 2 mentioned in the task?


UX reasons for dropdowns

A description of the functional and stylistic use of dropdowns for UX

[x] I have read freeCodeCamp's contribution guidelines.
[x] My pull request has a descriptive title (not a vague title like Update index.md)
[x] My pull request targets the master branch of freeCodeCamp.
[x] None of my changes are plagiarized from another source without proper attribution.
[x] My article does not contain shortened URLs or affiliate links.

If your pull request closes a GitHub issue, replace the XXXXX below with the issue number.
Closes #XXXXX

Thank you for opening this pull request.
This is a standard message notifying you that we’ve reviewed your pull request and have decided not to merge it. We would welcome future pull requests from you.
Thank you and happy coding. ✈


FileNotFoundError: [Errno 2] No such file or directory: '/src/cog.yaml'  in built container

Seems like cog is not copying the directory contents.
when I run the deployed image it fails with the error: Could not find /src/cog.yaml but during the build process there's a clear 12/12 step COPY . /src
What could be issue here ?
# cog.yaml
# This file is used for constructing replicate env
image: "r8.im/tencentarc/realesrgan"

build:
  gpu: true
  python_version: "3.8"
  system_packages:
    - "libgl1-mesa-glx"
    - "libglib2.0-0"
  python_packages:
    - "torch"
    - "torchvision==0.8.2"
    - "numpy==1.21.1"
    - "lmdb==1.2.1"
    - "opencv-python==<IP_ADDRESS>"
    - "PyYAML==5.4.1"
    - "tqdm==4.62.2"
    - "yapf==0.31.0"
    - "basicsr==1.4.2"
    - "facexlib==0.2.5"

predict: "cog_predict.py:Predictor"

error on run
docker run -it -p 5001:5000 --gpus all  cog-realesrgan-base
Traceback (most recent call last):
  File "/root/.pyenv/versions/3.8.16/lib/python3.8/site-packages/cog/predictor.py", line 57, in load_config
    with open(config_path) as fh:
FileNotFoundError: [Errno 2] No such file or directory: '/src/cog.yaml'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/root/.pyenv/versions/3.8.16/lib/python3.8/runpy.py", line 194, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/root/.pyenv/versions/3.8.16/lib/python3.8/runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "/root/.pyenv/versions/3.8.16/lib/python3.8/site-packages/cog/server/http.py", line 145, in <module>
    config = load_config()
  File "/root/.pyenv/versions/3.8.16/lib/python3.8/site-packages/cog/predictor.py", line 60, in load_config
    raise ConfigDoesNotExist(
cog.errors.ConfigDoesNotExist: Could not find /src/cog.yaml

output from build
Building Docker image from environment in cog.yaml as realsrgan...
[+] Building 13.7s (20/20) FINISHED
 => [internal] load build definition from Dockerfile                            0.0s
 => => transferring dockerfile: 2.17kB                                          0.0s
 => [internal] load .dockerignore                                               0.0s
 => => transferring context: 2B                                                 0.0s
 => resolve image config for docker.io/docker/dockerfile:1.2                    1.2s
 => CACHED docker-image://docker.io/docker/dockerfile:1.2@sha256:e2a8561e419ab  0.0s
 => [internal] load metadata for docker.io/nvidia/cuda:11.2.0-cudnn8-devel-ubu  0.9s
 => [stage-0  1/12] FROM docker.io/nvidia/cuda:11.2.0-cudnn8-devel-ubuntu20.04  0.0s
 => [internal] load build context                                               0.0s
 => => transferring context: 82.97kB                                            0.0s
 => CACHED [stage-0  2/12] RUN rm -f /etc/apt/sources.list.d/cuda.list &&       0.0s
 => CACHED [stage-0  3/12] RUN --mount=type=cache,target=/var/cache/apt set -e  0.0s
 => CACHED [stage-0  4/12] RUN --mount=type=cache,target=/var/cache/apt apt-ge  0.0s
 => CACHED [stage-0  5/12] RUN curl -s -S -L https://raw.githubusercontent.com  0.0s
 => CACHED [stage-0  6/12] COPY .cog/tmp/build385192808/cog-0.0.1.dev-py3-none  0.0s
 => CACHED [stage-0  7/12] RUN --mount=type=cache,target=/root/.cache/pip pip   0.0s
 => CACHED [stage-0  8/12] RUN --mount=type=cache,target=/var/cache/apt apt-ge  0.0s
 => CACHED [stage-0  9/12] COPY .cog/tmp/build385192808/requirements.txt /tmp/  0.0s
 => CACHED [stage-0 10/12] RUN --mount=type=cache,target=/root/.cache/pip pip   0.0s
 => CACHED [stage-0 11/12] WORKDIR /src                                         0.0s
 => [stage-0 12/12] COPY . /src                                                 3.5s
 => exporting to image                                                          0.0s
 => => exporting layers                                                         0.0s
 => => writing image sha256:5d773d33193e12f3e0a998b79c86c37f3b6c9b7ddd64db3603  0.0s
 => => naming to docker.io/library/realsrgan                                    0.0s
 => exporting cache                                                             0.0s
 => => preparing build cache for export                                         0.0s
Adding labels to image...

Image built as realsrgan

Asked bing chat and got some responses, however the command is failing with stat error for the host file

Cleared docker cache.
All works now.


refactor: chipped content to render on click

Dream of having same page with same code working with JavaScript enabled or disabled ends with this PR
The trade-off we're doing here is performance. And the main issue right now is number of DOM nodes is huge.
Why? Because of chipped content component. It renders all contents so that when JavaScript is disabled, they're shown all at once. Noice!
However, clients (browsers) with JavaScript enabled (most) will get loooots of DOM nodes that won't be visible. Hence impacting performance
In order to move forward, setting aside the fully functional without JavaScript feature.

It can be introduced later with a separate layout. This will also simplify things. As for now, any component testing was getting hard as apart from regular behaviour with JS on, the axis of no JS was also there introducing complexity. A raw idea could be a <meta refresh> inside <noscript> in <head> that takes the user to a non-JS compatible version of the site. For instance resume to /nojs/resume. Could do also via query params ?js=disabled but that would require either a routes file to take into account for prerendering or deploy the server somewhere.
Performance will be improved too for non JS version. As we can simplify UI for this specific case.
Indeed we could export same component interface and 2 implementations. One for non JS and one for JS enabled. So we can reuse general layout and use different low-level/ atom components for different versions.

#419  👈
main

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @davidlj95 and the rest of your teammates on  Graphite


please publish the 0.3.3 verison of akka-kryo-serialization_2.10

Hi
Not an issue in the project, but as this version used as in example in the readme.md, it supposed to be exist in the repo.
the version 0.3.3 is not published on
http://search.maven.org/#browse|-1023511903
<dependency>
    <groupId>com.github.romix.akka</groupId>
    <artifactId>akka-kryo-serialization_2.10</artifactId>
    <version>0.3.3</version>
</dependency>

Yes, it has to look like this:
<dependency>
    <groupId>com.github.romix.akka</groupId>
    <artifactId>akka-kryo-serialization_2.11</artifactId>
    <version>0.3.3</version>
</dependency>

could you publish version compiled with  scala 2.10  ?


docs/basics/qsql.md: Update broken hyperlink

The "By phrase" link points to a non-existent variable. I've updated it to point to the correct header in the reference, similar to what is done with the "Select phrase" and "Limit expression" headers.

David, thank you for your contributions. I’ve added you to the Honor Rollhttps://code.kx.com/q/about/thissite/#contribute.
How are you enjoying New York?
Stephen Taylor | Librarian | KX | +44 7713 400852 | @.***

From: David Lu @.>
Sent: 03 January 2022 23:40
To: KxSystems/docs @.>
Cc: Subscribed @.***>
Subject: [KxSystems/docs] docs/basics/qsql.md: Update broken hyperlink (PR #57)
CAUTION: This email originated from outside of the organisation. Do not click links or open attachments unless you recognise the sender and know the content is safe.
The "By phrase" link points to a non-existent variable. I've updated it to point to the correct header in the reference, similar to what is done with the "Select phrase" and "Limit expression" headers.

You can view, comment on, or merge this pull request online at:
https://github.com/KxSystems/docs/pull/57
Commit Summary

b61c7ebhttps://github.com/KxSystems/docs/pull/57/commits/b61c7ebf4595ba405d7f928669280d74ef1ede81 Update broken hyperlink in qsql basics docs

File Changes
(1 filehttps://github.com/KxSystems/docs/pull/57/files)

M docs/basics/qsql.mdhttps://github.com/KxSystems/docs/pull/57/files#diff-fcb23b9d7568a2cf2f7d3cd5b825caee98a960dc20a6ad1bf71c5f156ed96a65 (2)

Patch Links:

https://github.com/KxSystems/docs/pull/57.patch
https://github.com/KxSystems/docs/pull/57.diff

—
Reply to this email directly, view it on GitHubhttps://github.com/KxSystems/docs/pull/57, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AE62DABQ6HRKL5KZUVEJKTLUUIXYJANCNFSM5LGGXSMQ.
Triage notifications on the go with GitHub Mobile for iOShttps://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Androidhttps://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.
You are receiving this because you are subscribed to this thread.Message ID: @.***>

This email, its contents and any files attached are a confidential communication and are intended only for the named addressees indicated in the message. If you are not the named addressee or if you have received this email in error, you may not, without the consent of First Derivatives, copy, use or rely on any information or attachments in any way. Please notify the sender by return email and delete it from your email system.
Unless separately agreed, First Derivatives does not accept any responsibility for the accuracy or completeness of the contents of this email or its attachments. Please note that any views, opinion or advice contained in this communication are those of the sending individual and not those of First Derivatives and First Derivatives shall have no liability whatsoever in relation to this communication (or its content) unless separately agreed.


line-list-rwanda.csv

The current data for Rwanda. Most were reports on WHO, one local report.

@MikeMcMalace please check that the csv is properly formatted.


palomar: refactor query string parsing; updates to schemas and transform

TODO:

[x] normalize URLs: maybe with purell, maybe stripping tracking parameters
[x] date-level queries
[x] add end-to-end tests (similar to japanese queries)
[x] implement "merge" of query params (parsed and actual params)
[x] run lexgen and wire up actual query params
[x] from:me post search behavior (server-side, using viewer param)
[ ] alternate post "sort" order (top vs. latest)

Closes: https://github.com/bluesky-social/indigo/issues/191
Closes: https://github.com/bluesky-social/indigo/issues/593

going to do the query DSL tweaks (for "top", etc) in a follow-up!


Fix minor issues in Lambert

Follow-up from #492
Several things to do:

Fix chord calculation, see https://github.com/poliastro/poliastro/issues/492#issuecomment-438808398
Improve error message when the vectors are parallel, see https://github.com/poliastro/poliastro/issues/492#issuecomment-439071294
Remove misleading example from Lambert notebook (_, v_l), (_, v_r) = izzo.lambert(k, r0, r, tof, M=1) (do not remember what the intention was here), see https://space.stackexchange.com/questions/31967/multiple-revolution-lambert-problem/32020#comment97323_32020
Clarify multi-revolution API (isn't the number of branches always 1 or 2? is it necessary to use a generator?), no need to wait for #114

The first two have been addressed in #505.

@jorgepiloto now that we understand the algorithm a bit better, perhaps we can keep the "low level Lambert API" in this notebook https://docs.poliastro.space/en/latest/examples/Revisiting Lamberts problem in Python.html#Multiple-revolutions but decide whether we still want to use a generator, or at least change the (_, v_l), (_, v_r) = izzo.lambert(k, r0, r, tof, M=1)?

Done!


Make redraw interval changeable

Fixes https://github.com/nakabonne/ali/issues/39
Fixes https://github.com/nakabonne/ali/issues/35

Codecov Report

Merging #106 (a718d44) into master (e3f49a4) will decrease coverage by 1.04%.
The diff coverage is 73.92%.

@@            Coverage Diff             @@
##           master     #106      +/-   ##
==========================================
- Coverage   63.59%   62.56%   -1.03%
==========================================
  Files          11       11
  Lines         703      713      +10
==========================================
- Hits          447      446       -1
- Misses        220      233      +13
+ Partials       36       34       -2

Impacted Files
Coverage Δ

main.go
63.41% <33.34%> (-4.51%)
:arrow_down:

gui/drawer.go
58.27% <100.00%> (ø)

gui/gui.go
74.51% <100.00%> (+0.78%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update e3f49a4...a718d44. Read the comment docs.


tests: m2gl025_miv: exclude slow platform from some tests

This platform is slow on some tests and times out on non-hardware
related tests, so exclude it or increase timeout for some of the tests
to avoid false negatives in the test results due to timeouts.
Signed-off-by: Anas Nashif<EMAIL_ADDRESS>

This is causing failures in the main tree...


React-Buy_Me_Sip

The main purpose of this project is to develop a React application that focuses on providing a seamless and secure payment integration for coffee purchases.
It integrate with Stripe, a trusted and secure payment gateway, to handle all your transactions. Checkout is smooth, quick, and protected, allowing you to enjoy your coffee without any worries.
The app will have an intuitive and user-friendly interface, making it easy for users to navigate through the coffee menu, manage their cart, review order details, and access their order history.
Discover a diverse range of flavors and choose your favorites to enhance your coffee experience. Explore different coffee options, and add them to your cart with just a few taps.

@shagunZ  This project is based on node backend as you know this repo is beginner-friendly so we don't want to make them confused about anything please try to react-based front-end projects only, I hope you understand.


MXIDs with slashes (/) incorrectly rejected

Per the spec, MXIDs are allowed to contain forward slashes (/). However, matrix.to rejects such MXIDs:

The localpart of a user ID is an opaque identifier for that user. It MUST NOT be empty, and MUST contain only the characters a-z, 0-9, ., _, =, -, and /.

this probably happens because the parser does split the fragment by / (for the event id) before checking where the local part ends:
https://github.com/matrix-org/matrix.to/blob/fde53099eb2701bf975128aca64a7cf45cc2ec5a/src/Link.js#L114

this issue made me stop using https://cactus.chat/ in my static website and will instead use https://giscus.app/

Maintainer of Cactus Comments here.
I was just made aware of this bug in matrix.to because a friend of mine has broken links on their blog because of it as well.
It seems to still be an issue.

We have likely the same issue:
If I "copy the room link" in Element Desktop (or Web too BTW), https://matrix.to/#/#aboutcode-org/fosdem-2024:gitter.im is the link copied
But this is a dead, invalid link. It should have been
https://app.gitter.im/#/room/#aboutcode-org/fosdem-2024:gitter.im
matrix.to does not redirect correctly rooms with a slash.

I am experiencing the same issue and I originally thought this was an Element problem. https://github.com/element-hq/element-desktop/issues/1435 ... this makes life really difficult as the generated matrix.to links are useless and error out. So you cannot really share you room at all.

as @Zocker1999NET pointed out the split is the issue. Here is a simple excerpt:
function parseFragment(fragment) {
        let [linkStr, queryParamsStr] = fragment.split("?");
        linkStr = linkStr.slice(2);
        const [identifier, eventId] = linkStr.split("/");
        return {"identifier": identifier, "eventId": eventId};
    }
parseFragment("/#aboutcode-org/vulnerablecode:gitter.im")

returns:
Object { identifier: "aboutcode-org", eventId: "vulnerablecode:gitter.im" }

But should have returned:
Object { identifier: "aboutcode-org/vulnerablecode:gitter.im", eventId: "" }

Also I could not find a tests for this function... are they in another repository may be? :innocent:

Also the error message is misleading because the URL is actually valid
> new URL('https://matrix.to/#/@it/sme:matrix.org')
> URL {
hash: "#/@it/sme:matrix.org"
host: "matrix.to"
hostname: "matrix.to"
href: "https://matrix.to/#/@it/sme:matrix.org"
origin: "https://matrix.to/"
password: ""
pathname: "/"
port: ""
protocol: "https:"
search: ""
searchParams: URLSearchParams(0)
username: ""
}


container sharding (feature/deep branch) requires internal-client.conf

The sample from the master branch is sufficient.

So, my vsaio has /etc/swift/internal-client.conf and I think master already supports/sets-up container sharding [1].  I don't think there's anything more to do here, but feel free to set me straight and reopen!

https://github.com/swiftstack/vagrant-swift-all-in-one/blob/master/cookbooks/swift/templates/default/etc/swift/container-server/settings.conf.erb#L8


Create an escape hatch

Sometimes a single reference should be kept out of the inputs array, we could allow the user to specify it. A proposed syntax is:
import { stale, useAutoMemo } from 'hooks.macro';
import { useRandomValue } from 'minister-of-silly-hooks';

function MyComponent({ prop }) {
  const rnd = useRandomValue();
  const value = useAutoMemo(prop * stale(rnd));
}

IMHO, it should also be possible to specify multiple inputs that should be kept out of the input array 🙂
Not sure what the syntax for that would be like. The first thing that comes to mind is to use the same syntax that memo() uses, but have the array specify what arguments to exclude from memoization.
i.e.
function MyComponent({ prop }) {
  const rnd = useRandomValue();
  const value = useAutoMemo(prop, [rnd]);
}

😄

IMHO, it should also be possible to specify multiple inputs that should be kept out of the input array 🙂
Not sure what the syntax for that would be like. The first thing that comes to mind is to use the same syntax that memo() uses, but have the array specify what arguments to exclude from memoization.
i.e.
function MyComponent({ prop }) {
  const rnd = useRandomValue();
  const value = useAutoMemo(prop, [rnd]);
}

😄

This is both a fantastic and terrible idea. It does makes sense but it makes reading the syntax a nightmare.
It could also be useAutoMemo(……, { exclude: [ …… ] }) which makes it a little bit more explicit and opens the road to other configuration in the future

This is both a fantastic and terrible idea. It does makes sense but it makes reading the syntax a nightmare.
It could also be useAutoMemo(……, { exclude: [ …… ] }) which makes it a little bit more explicit and opens the road to other configuration in the future


removed invalid link and replaced new link

as per user report #5783
i replaced the invalid link to new link
https://support.microsoft.com/en-in/help/4046851/windows-10-allow-blocked-app-windows-security

@JohanFreelancer9 - kindly do the copy editor review for this PR. Thanks.


fix(middle-click): Allow middle click on links

We let middle clicks go through
Array.protoype.find does not have a large enough support. Let's use
lodash instead.
(Requires https://github.com/algolia/instantsearch.js/pull/480 being merged first)

merged #480

Thanks, I rebased


Allow BugBot to file and update bugs based on the hang stats data from BHR

This capability will look at the data from Florian's dashboard at https://fqueze.github.io/hang-stats/ and for the top N stacks, will file bugs for ones not associated yet with bugs.
Those new filed bugs will then:

Have the appropriate [bhr whiteboard tag applied so that the dashboard can associate the stacks with the bugs, and
Have the Performance Impact flag set to ?
Probably be filed under Core :: Performance, unless the BugBot knows how to guess the right component based on the stack / signature.

Just coming back around to this - @suhaibmujahid, is this still something we can do?

Sorry I haven't had time so far, I will get back to this soon.


Shouldn't the historical assessment plot show 2019 biomass from 2019 assessment?

I know it wouldn't be compared to anything else, but it would probably be helpful (to show here if it's vastly different to 2018).
Think just involves adding an empty column (and NA for 2019 assessment) to assessment-history.csv?

Yes, the 2018 assessment had it go until 2018, but I see in Figure 72 it only goes to 2018 (not 2019) as you say Andy.  Good catch.


ValCred Import from Definitions Error

Hi Experts,
we are testing out the DCM component for automated deployments within our enterprise, I have encountered an issue with importing validation credential object from definition approach. Please find the error logs
valcred-from-def:
    [nxslt] nxslt running ./src/remove-unwanted-elements.xsl on C:\Users\Bharath\Documents\Tools\dcm\easystart\ucdDemo\ucdDemo.valcred.dcm.xml producing tmp
    [nxslt] Warning:  The encoding 'UTF-8' is not supported by the Java runtime.
    [nxslt] Warning: encoding "UTF-8" not supported, using UTF-8
    [nxslt] nxslt running ./src/valcred-to-ant.xsl on tmp producing C:\Users\Bharath\Documents\Tools\dcm\tmp/valcred.ant.xml
    [nxslt] Warning:  The encoding 'UTF-8' is not supported by the Java runtime.
    [nxslt] Warning: encoding "UTF-8" not supported, using UTF-8
    [nxslt] SystemId Unknown; Line #74; Column #28; This file doesn't contain a dcm:valcred element!
    [nxslt] SystemId Unknown; Line #76; Column #42; Failed to generate internal template due to errors listed above.
    [nxslt] (Location of error unknown)Stylesheet directed termination

BUILD FAILED
C:\Users\Bharath\Documents\Tools\dcm\deploy.ant.xml:1427: The following error occurred while executing this line:
C:\Users\Bharath\Documents\Tools\dcm\tmp\valcred.ant.xml:1: Premature end of file.

Total time: 8 seconds

I have used the following command to execute this operation
command: ant -f deploy.ant.xml -Ddcm.dir=. -Dhost=<IP_ADDRESS> -Duid=bharath -Ddevice=dp01 -Denvironment=dp01 -Ddomain=udcDemo -Dvalcred.file="C:\Users\Bharath\Documents\Tools\dcm\easystart\ucdDemo\ucdDemo.valcred.dcm.xml" domain-create valcred-from-def save
I have attached the definition file along with this post for your reference, I guess the ANT script is able to find out the file as this error would have popped up otherwise, however, I have feeling that the issue is with UTF-8 encoding. Please, Advise.
ucdDemo.valcred.dcm.xml.zip
Thanks,
Bharath

Has anyone come across this issue, If so, Please let me know, how to resolve it ..
Thanks,
Bharath

It looks to me like the "dcm" namespace is being used without being defined
in the .dcm.xml file.  Try changing the root element to: <dcm:definition
xmlns:dcm="urn:datapower:configuration:manager">
Hope this helps.
Thanks,
Rich
On Wed, Jun 21, 2017 at 11:55 AM, bmarur<EMAIL_ADDRESS>wrote:

Has anyone come across this issue, If so, Please let me know, how to
resolve it ..
Thanks,
Bharath
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/ibm-datapower/datapower-configuration-manager/issues/51#issuecomment-310123998,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ADuMmixk51maBeQk5sE9BvmR_InDa6vAks5sGTzcgaJpZM4NjLnS
.

Did Groot's suggestion resolve this issue?

Closing due to inactivity.


Docs missing for FL.scrollbarSize

I couldn't find documentation for scrollbarSize; I expect it should be in http://hackage.haskell.org/package/fltkhs-<IP_ADDRESS>/docs/Graphics-UI-FLTK-LowLevel-FL.html.  I knew it existed from the fltk docs, but I had to dig through your source to find out where it was and what it was called in fltkhs.  I didn't check what other functions might be missing.

I see it. You seem to be looking a super old version.

Right you are!  Sorry about that--I blindly followed what turned up in Google's results.  Sorry about the noise.

Huh.  Oddly, every other page of docs I have open is in <IP_ADDRESS>; just that one was the old one.


[Bug]: after update to 2.13.2 can't add new cluster node or restart node status NotReady

Description
After update to 2.13.2 can't add new cluster node in status NotReady:
cilium container is not started with errors:
 Running                                                                                │
level=info msg=Invoked duration="546.384µs" function="github.com/cilium/cilium/cilium-dbg/cmd.glob..func39 (cmd/build-config.go:32)" subsys=hive                                             │
 level=info msg=Starting subsys=hive
 level=info msg="Establishing connection to apiserver" host="https://<IP_ADDRESS>:443" subsys=k8s-client
 level=info msg="Establishing connection to apiserver" host="https://<IP_ADDRESS>:443" subsys=k8s-client
 level=error msg="Unable to contact k8s api-server" error="Get \"https://<IP_ADDRESS>:443/api/v1/namespaces/kube-system\": dial tcp <IP_ADDRESS>:443: i/o timeout" ipAddr="https://<IP_ADDRESS>:443" s │
 level=error msg="Start hook failed" error="Get \"https://<IP_ADDRESS>:443/api/v1/namespaces/kube-system\": dial tcp <IP_ADDRESS>:443: i/o timeout" function="client.(*compositeClientset).onStart"
 level=info msg=Stopping subsys=hive
 Error: Build config failed: failed to start: Get "https://<IP_ADDRESS>:443/api/v1/namespaces/kube-system": dial tcp <IP_ADDRESS>:443: i/o timeout                                                  │

Kube.tf file
module "kube-hetzner" {
  providers = {
    hcloud = hcloud
  }
  hcloud_token = var.hcloud_token != "" ? var.hcloud_token : local.hcloud_token
  source = "kube-hetzner/kube-hetzner/hcloud"
  version = "2.13.2"

  ssh_port = 2222
  ssh_public_key = file("${path.module}/ssh/k8s-hetzner.pub")
  ssh_private_key = file("${path.module}/ssh/k8s-hetzner")

  network_ipv4_cidr = "<IP_ADDRESS>/8"
  cluster_ipv4_cidr = "<IP_ADDRESS>/16"

  control_plane_nodepools = [
    {
      name        = "control-plane-fsn1",
      server_type = "cpx21",
      location    = "fsn1",
      labels      = [],
      taints      = [],
      count       = 1
    },
    {
      name        = "control-plane-nbg1",
      server_type = "cpx21",
      location    = "nbg1",
      labels      = [],
      taints      = [],
      count       = 1
    },
  ]

  agent_nodepools = [
    {
      name        = "agent-small",
      server_type = "cpx11",
      location    = "fsn1",
      labels      = [],
      taints      = [],
      count       = 0
    },
    {
      name        = "agent-large",
      server_type = "ccx23",
      location    = "fsn1",
      labels      = [
        "nodetype=core-ccx23"
      ],
      taints      = [],
      count       = 3
    },
    {
      name        = "bots-large",
      server_type = "ccx23",
      location    = "fsn1",
      labels      = [
        "nodetype=bots-node"
      ],
      taints      = [],
      count       = 4
    },
    {
      name        = "agent-xsize",
      server_type = "ccx43",
      location    = "fsn1",
      labels      = [
        "nodetype=core-ccx43"
      ],
      taints      = [],
      count       = 0
    },
    {
      name        = "storage",
      server_type = "ccx23",
      location    = "fsn1",
      labels      = [
        "node.kubernetes.io/server-usage=storage"
      ],
      taints      = [],
      count       = 1
    },
    {
      name        = "egress",
      server_type = "cpx11",
      location    = "fsn1",
      labels = [
        "node.kubernetes.io/role=egress"
      ],
      taints = [
        "node.kubernetes.io/role=egress:NoSchedule"
      ],
      floating_ip = true
      count = 0
    },
    {
      name        = "agent-arm-small",
      server_type = "cax11",
      location    = "fsn1",
      labels      = [],
      taints      = [],
      count       = 0
    }
  ]

  load_balancer_type     = "lb11"
  load_balancer_location = "fsn1"

   autoscaler_nodepools = [
     {
       name        = "autoscaled-small"
       server_type = "ccx23"
       location    = "fsn1"
       min_nodes   = 0
       max_nodes   = 0
     },
     {
       name        = "autoscaled-large"
       server_type = "ccx23"
       location    = "fsn1"
       min_nodes   = 0
       max_nodes   = 6
       labels      = {
         nodetype: "bots-node"
         "node.kubernetes.io/role": "peak-workloads"
       }
       taints      = [{
          key: "node.kubernetes.io/role"
          value: "peak-workloads"
          effect: "NoExecute"
       }]
     }
   ]

   ingress_controller = "traefik"
   traefik_additional_options = ["--log.level=DEBUG"]
  initial_k3s_channel = "stable"
  cluster_name = "h-k3s-test"
  k3s_registries = <<-EOT
    mirrors:
      eu.gcr.io:
        endpoint:
          - "https://eu.gcr.io"
    configs:
      eu.gcr.io:
        auth:
          username: _json_key
          password: '{
  "type": "service_account",
  "project_id": "asset-management-ci-cd",
  "private_key_id": "********",
  "private_key": "*********",
  "client_email"<EMAIL_ADDRESS>  "client_id": "********",
  "auth_uri": "https://accounts.google.com/o/oauth2/auth",
  "token_uri": "https://oauth2.googleapis.com/token",
  "auth_provider_x509_cert_url": "https://www.googleapis.com/oauth2/v1/certs",
  "client_x509_cert_url": "https://www.googleapis.com/robot/v1/metadata/x509/image-puller%40asset-management-ci-cd.iam.gserviceaccount.com",
  "universe_domain": "googleapis.com"
}'
  EOT
  restrict_outbound_traffic = true
   extra_firewall_rules = [
     {
       description = "Allow out tcp"
       direction       = "out"
       protocol        = "tcp"
       port            = "any"
       destination_ips = ["<IP_ADDRESS>/0", "::/0"]
     },
     {
       description = "Allow out udp"
       direction       = "out"
       protocol        = "udp"
       port            = "any"
       destination_ips = ["<IP_ADDRESS>/0", "::/0"]
     }
   ]

   cni_plugin = "cilium"
   cilium_routing_mode = "native"
   disable_kube_proxy = true

   placement_group_disable = true
   enable_cert_manager = false
   dns_servers = [
     "<IP_ADDRESS>",
     "<IP_ADDRESS>",
     "<IP_ADDRESS>",
   ]

  cilium_values = <<EOT
ipam:
  mode: kubernetes
k8s:
  requireIPv4PodCIDR: true
kubeProxyReplacement: true
routingMode: native
ipv4NativeRoutingCIDR: "<IP_ADDRESS>/8"
endpointRoutes:
  enabled: true
loadBalancer:
  acceleration: native
bpf:
  masquerade: true
socketLB:
  hostNamespaceOnly: true
egressGateway:
  enabled: true
prometheus:
  enabled: true
operator:
  prometheus:
    enabled: true
envoy:
  enabled: true
hubble:
  prometheus:
    enabled: true
MTU: 1450
  EOT

  traefik_values = <<EOT
deployment:
  replicas: 1
globalArguments: []
service:
  enabled: true
  type: LoadBalancer
  annotations:
    "load-balancer.hetzner.cloud/name": "h-k3s-test"
    "load-balancer.hetzner.cloud/use-private-ip": "true"
    "load-balancer.hetzner.cloud/disable-private-ingress": "true"
    "load-balancer.hetzner.cloud/location": "nbg1"
    "load-balancer.hetzner.cloud/type": "lb11"
    "load-balancer.hetzner.cloud/uses-proxyprotocol": "true"
logs:
  general:
    level: DEBUG
ports:
  web:
    redirectTo: websecure
    proxyProtocol:
      trustedIPs:
        - <IP_ADDRESS>/32
        - <IP_ADDRESS>/8
    forwardedHeaders:
      trustedIPs:
        - <IP_ADDRESS>/32
        - <IP_ADDRESS>/8
  websecure:
    proxyProtocol:
      trustedIPs:
        - <IP_ADDRESS>/32
        - <IP_ADDRESS>/8
    forwardedHeaders:
      trustedIPs:
        - <IP_ADDRESS>/32
        - <IP_ADDRESS>/8
tlsOptions: {}
tlsStore: {}
tls:
  secretName: *********
certResolvers:
  letsencrypt:
    email: maxim.*******@*******
    tlsChallenge: true
    httpChallenge:
      entryPoint: "web"
    storage: /data/acme.json
  EOT

}

provider "hcloud" {
  token = var.hcloud_token != "" ? var.hcloud_token : local.hcloud_token
}
terraform {
  required_version = ">= 1.5.0"
  required_providers {
    hcloud = {
      source  = "hetznercloud/hcloud"
      version = ">= 1.43.0"
    }
  }
}

Screenshots

Platform
Linux

I comment:
cilium_routing_mode = "native"
disable_kube_proxy = true
and recreated node, issue is fixed

Good find, important for backward compatibility during upgrades from previous versions.

This configuration cannot work because Cilium is not set up to fully replace kube-proxy. It lacks the necessary configuration at this part: https://github.com/kube-hetzner/terraform-hcloud-kube-hetzner/blob/da24fd260b060038630a72b121f06288bc6b8e56/locals.tf#L453-L455
See also to the warning here, indicating that the CNI must completely take over kube-proxy's functionality: https://github.com/kube-hetzner/terraform-hcloud-kube-hetzner/blob/da24fd260b060038630a72b121f06288bc6b8e56/kube.tf.example#L720-L722


Add new asserts

Adding new asserts:

for matching strings by regexp
for checking that one JSON contains another

Fixed in this Pull Request


Pair programming session 13 part 2

@awalterschulze this has a conflict that I can't solve at a glance.


Minecraft crash

After I installed the mod, I can no longer enter the game because it just crashes. I checked on a completely clean assembly, everything is in order there, so I think that there is a compatibility problem from some mod. Can you fix this?
Mod version: 1.0.14
Fabric api: 0.24.1+build.412-1.16
mc version: 1.16.3
crash-2020-10-21_09.29.59-server.txt

Fixed in 1.0.15. My other library wasn't being bundled properly :(

@Hephaestus-Dev
Thanks. Can you update the mod description? I did not know about the existence of a function for double opening of doors, it is not written about it anywhere.


Add PR and Issue template

Fixes : #16
Used the templates from https://github.com/inlets/cloud-provision repo

Sorry to see that you had issues getting your sign off correct.
I think this PR might still be needed?


Yield doesn't work with empty set

Let's say I have a tag named account. It has a username property.
Before creating a new account I want to check if anyone is already having an account with the same username and to prevent the creation if any.
So I have an index for username property.
I use this command:
LOOKUP ON account WHERE account.username == "non_existing_username" | YIELD count(*)
DB shows "Empty set"
However when I search with existing username it shows:
COUNT(*)
1
So, in the first example it should show:
COUNT(*)
0

Probably fixed on master


Upgrated kibana to version 6.X

Info:

Docker version ($ docker --version): Docker version 17.09.1-ce, build 19e2cf6

Laradock commit ($ git rev-parse HEAD): ad3698670bd31528acdf5f125b39a78c24413c0e

System info (Mac, PC, Linux):  Linux

System info disto/version:
Ubuntu 17 10

Issue:

feature update elastisearch and kibana
Expected behavior:

_____ the newest version

Only upgraded kibana because elastisearch elasticsearch_1        | org.elasticsearch.bootstrap.StartupException: java.lang.IllegalArgumentException: plugin [x-pack] is incompatible with version [6.1.1]; was designed for version [5.4.1]


Dataset Checksums

Addresses https://github.com/mlcommons/algorithmic-efficiency/issues/647

For librispeech and wmt, the generated hashes do not contain the tokenizer vocabulary.
For Imagenet-pytorch, I have generated the checksum by keeping the imagenet-v2 together with the train and val files similar to imagenet-jax.
I have included outputs of the tree command to show exactly what folders were considered for the checksum.

Hello! Thanks so much for publicly sharing the checksums. It's incredibly helpful to be able to check that datasets were correctly downloaded.
I've run the checksumdir command on my directories, and get completely different values? (incl ogbg, etc)
Assuming not all my datasets were downloaded incorrectly, I am curious if there could be another reason for the difference in checksum values. Do you have any idea what could be causing this? Thanks!!

Hi! Thanks for giving this a try! Yes, there is certainly something else going on -- but, i don't know what could be causing this! Did you check the output of the tree commands? Could you share your checksum of a couple simple ones like ogbg/criteo1tb? I don't know how to debug this but perhaps having your checksum values might help in some way :)

Hi @chandramouli-sastry,
thanks a lot for adding this. I think this could be very beneficial.
However, I am also getting different checksums, while the tree output (and file sizes and numbers) are identical. Below, I am posting my checksums, perhaps they are identical to @tfaod ?

OGBG: 4808a6652bc4d129c1638ac55b219bfe
WMT: 3764a73cdc19d7572c042ce19e59c74b (but this is after generating the wmt_sentencepiece_model)
FastMRI: cd8c6452d9fa5fe89d050df969e98f70
ImageNet: Both the JAX and the PyTorch versions look slightly different in our Cluster setup (e.g. additional files that other groups need) so I didn't compare the checksums here. So I only provide the checksum for the separate ImageNet v2 directory, i.e. checksumdir imagenet_v2: a7f24a2250469706827eb2dff360590d.
Criteo1TB: aeb5217d11610ab6c679df572faadc7e. But here I also get a different output when running the tree --filelimit 30. It reports that 885 (not 347) entries exceeds the filelimit, which is also aligned with the total of 885 files I find via find -type f | wc -l.
LibriSpeech: 071e7582d63c92e51797f3f11967fb74 (but this is after generating spm_model.vocab. The tree output is identical to what you reported, minus the additional spm_model.vocab file.

@tfaod did you check the number of files (e.g. via find -type f | wc -l) and total file size (e.g. via du -sch --apparent-size librispeech/)vs. what we report? This was intended as a first check whether all the data downloading worked.

Thanks for the quick reply!
I've checked all our 1/ file counts (find -type f | wc -l) and 2/ dir size du -sch --apparent-size wmt/), and they are all consistent with the mlcommons provided values.
I've included my outputs for the tree and checksumdir commands for ogbg. wmt, and criteo1tb.
There are 2 differences in the tree results:

criteo1tb displays 885 entries exceeds filelimit rather than 347 from the README
wmt has an additional file wmt_sentencepiece_model that the README has in the final directory but not the tree output

ogbg

tree $DATA_DIR/ogbg --filelimit 30

└── ogbg_molpcba
    └── 0.1.3
        ├── dataset_info.json
        ├── features.json
        ├── metadata.json
        ├── ogbg_molpcba-test.tfrecord-00000-of-00001
        ├── ogbg_molpcba-train.tfrecord-00000-of-00008
        ├── ogbg_molpcba-train.tfrecord-00001-of-00008
        ├── ogbg_molpcba-train.tfrecord-00002-of-00008
        ├── ogbg_molpcba-train.tfrecord-00003-of-00008
        ├── ogbg_molpcba-train.tfrecord-00004-of-00008
        ├── ogbg_molpcba-train.tfrecord-00005-of-00008
        ├── ogbg_molpcba-train.tfrecord-00006-of-00008
        ├── ogbg_molpcba-train.tfrecord-00007-of-00008
        └── ogbg_molpcba-validation.tfrecord-00000-of-00001

2 directories, 13 files

checksumdir $DATA_DIR/ogbg: 88420b94329a574d9308360dacf0778f

criteo1tb

tree $DATA_DIR/criteo1tb --filelimit 30

criteo1tb  [885 entries exceeds filelimit, not opening dir]

0 directories, 0 files

checksumdir $DATA_DIR/criteo1tb: aeb5217d11610ab6c679df572faadc7e

wmt:

tree wmt --filelimit 30

├── wmt14_translate
│   └── de-en
│       └── 1.0.0
│           ├── dataset_info.json
│           ├── features.json
│           ├── wmt14_translate-test.tfrecord-00000-of-00001
│           ├── wmt14_translate-train.tfrecord-00000-of-00016
│           ├── wmt14_translate-train.tfrecord-00001-of-00016
│           ├── wmt14_translate-train.tfrecord-00002-of-00016
│           ├── wmt14_translate-train.tfrecord-00003-of-00016
│           ├── wmt14_translate-train.tfrecord-00004-of-00016
│           ├── wmt14_translate-train.tfrecord-00005-of-00016
│           ├── wmt14_translate-train.tfrecord-00006-of-00016
│           ├── wmt14_translate-train.tfrecord-00007-of-00016
│           ├── wmt14_translate-train.tfrecord-00008-of-00016
│           ├── wmt14_translate-train.tfrecord-00009-of-00016
│           ├── wmt14_translate-train.tfrecord-00010-of-00016
│           ├── wmt14_translate-train.tfrecord-00011-of-00016
│           ├── wmt14_translate-train.tfrecord-00012-of-00016
│           ├── wmt14_translate-train.tfrecord-00013-of-00016
│           ├── wmt14_translate-train.tfrecord-00014-of-00016
│           ├── wmt14_translate-train.tfrecord-00015-of-00016
│           └── wmt14_translate-validation.tfrecord-00000-of-00001
├── wmt17_translate
│   └── de-en
│           ├── wmt14_translate-train.tfrecord-00000-of-00016
│           ├── wmt14_translate-train.tfrecord-00001-of-00016
│           ├── wmt14_translate-train.tfrecord-00002-of-00016
│           ├── wmt14_translate-train.tfrecord-00003-of-00016
│           ├── wmt14_translate-train.tfrecord-00004-of-00016
│           ├── wmt14_translate-train.tfrecord-00005-of-00016
│           ├── wmt14_translate-train.tfrecord-00006-of-00016
│           ├── wmt14_translate-train.tfrecord-00007-of-00016
│           ├── wmt14_translate-train.tfrecord-00008-of-00016
│           ├── wmt14_translate-train.tfrecord-00009-of-00016
│           ├── wmt14_translate-train.tfrecord-00010-of-00016
│           ├── wmt14_translate-train.tfrecord-00011-of-00016
│           ├── wmt14_translate-train.tfrecord-00012-of-00016
│           ├── wmt14_translate-train.tfrecord-00013-of-00016
│           ├── wmt14_translate-train.tfrecord-00014-of-00016
│           ├── wmt14_translate-train.tfrecord-00015-of-00016
│           └── wmt14_translate-validation.tfrecord-00000-of-00001
├── wmt17_translate
│   └── de-en
│       └── 1.0.0
│           ├── dataset_info.json
│           ├── features.json
│           ├── wmt17_translate-test.tfrecord-00000-of-00001
│           ├── wmt17_translate-train.tfrecord-00000-of-00016
│           ├── wmt17_translate-train.tfrecord-00001-of-00016
│           ├── wmt17_translate-train.tfrecord-00002-of-00016
│           ├── wmt17_translate-train.tfrecord-00003-of-00016
│           ├── wmt17_translate-train.tfrecord-00004-of-00016
│           ├── wmt17_translate-train.tfrecord-00005-of-00016
│           ├── wmt17_translate-train.tfrecord-00006-of-00016
│           ├── wmt17_translate-train.tfrecord-00007-of-00016
│           ├── wmt17_translate-train.tfrecord-00008-of-00016
│           ├── wmt17_translate-train.tfrecord-00009-of-00016
│           ├── wmt17_translate-train.tfrecord-00010-of-00016
│           ├── wmt17_translate-train.tfrecord-00011-of-00016
│           ├── wmt17_translate-train.tfrecord-00012-of-00016
│           ├── wmt17_translate-train.tfrecord-00013-of-00016
│           ├── wmt17_translate-train.tfrecord-00014-of-00016
│           ├── wmt17_translate-train.tfrecord-00015-of-00016
│           └── wmt17_translate-validation.tfrecord-00000-of-00001
└── wmt_sentencepiece_model

6 directories, 41 files

checksumdir $DATA_DIR/wmt: 5921e54f13a9968d31dc2e3eec4f9f34

Thanks @fsschneider for generating the checksums! I think all of this suggests that the data downloaded on kasimbeg-8 in /home/kasimbeg/data is incomplete/corrupted -- i had to re-download and extract fastmri and that seems to match with the one generated by Frank, so thats good! Its also good that the checksum obtained by @tfaod on criteo matches with that of Frank's! I wanted to avoid considering the vocab files in the checksum because the serialized data might not be consistent across runs -- but not sure!
I mainly only wrote this script and copy-pasted the outputs into the readme:
import os
for dirname in glob.glob("data/*"):
    os.system(f"tree {dirname} --filelimit 30")
    os.system(f"checksumdir {dirname}")```

I think that we could just include the output of this code on the data directory we believe is correctly downloaded at the end of the README?

@chandramouli-sastry did you detect any differences on kasimbeg-8 with the directory structure and file sizes that @fsschneider reported in the README before running your script?  If so can you please document them in this thread.
To resolve this I think we should use @fsschneider's data setup as the source of truth. @fsschneider could you start a new PR that contains just the hash commands and results?

I just downloaded ogbg twice on the same computer (within seconds). Even without any apparent differences, the checksum provided by checksumdir doesn't match. So I am assuming (judging by the fact that we (mainly) see differences for TFDS datasets) that TFDS uses a timestamp (from downloading) or something similarly non-deterministic within the .tfrecord files.
As a result, I don't think that the checksums by checksumdir provide meaningful information. I would suggest closing this PR and not providing checksums.

@priyakasimbeg I closed this PR. Feel free to reopen if you disagree.


chore(deps): update ci dependencies

This PR contains the following updates:

Package
Type
Update
Change

common-dev-assets

digest
ab267b7 -> f6f565f

github.com/terraform-ibm-modules/ibmcloud-terratest-wrapper
require
patch
v1.26.0 -> v1.26.1

Release Notes

terraform-ibm-modules/ibmcloud-terratest-wrapper (github.com/terraform-ibm-modules/ibmcloud-terratest-wrapper)
v1.26.1
Compare Source
Bug Fixes

deps: update gomod (#726) (a42f8cf)

Configuration
📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).
🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
👻 Immortal: This PR will be recreated if closed unmerged. Get config help if that's undesired.

[ ] If you want to rebase/retry this PR, check this box

This PR has been generated by Renovate Bot.

/run pipeline

:tada: This PR is included in version 1.0.0 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


Subsets Generation using Bit Masking

Description
Algorithm that takes an array of characters or integers as input and outputs all possible subsets (Power Set) using BitMask.
Domain
Competitive Programming
Type of Contribution
Addition
Code of Conduct

[X] I follow Contributing Guidelines & Code of conduct of LearnCPP.

/assign


[Snyk] Security upgrade werkzeug from 2.2.3 to 2.3.8

This PR was automatically created by Snyk using the credentials of a real user.Snyk has created this PR to fix one or more vulnerable packages in the `pip` dependencies of this project.
Changes included in this PR

Changes to the following files to upgrade the vulnerable dependencies to a fixed version:

python/requirements.txt

Vulnerabilities that will be fixed
By pinning:

Severity
Priority Score (*)
Issue
Upgrade
Breaking Change
Exploit Maturity

539/1000  Why? Has a fix available, CVSS 6.5
Inefficient Algorithmic Complexity SNYK-PYTHON-WERKZEUG-6035177
werkzeug:  2.2.3 -> 2.3.8
No
No Known Exploit

(*) Note that the real score may have changed since the PR was raised.
Some vulnerabilities couldn't be fully fixed and so Snyk will still find them when the project is tested again. This may be because the vulnerability existed within more than one direct dependency, but not all of the affected dependencies could be upgraded.
Check the changes in this PR to ensure they won't cause issues with your project.

Note: You are seeing this because you or someone else with access to this repository has authorized Snyk to open fix PRs.
For more information:
🧐 View latest project report
🛠 Adjust project settings
📚 Read more about Snyk's upgrade and patch logic

Learn how to fix vulnerabilities with free interactive lessons:
🦉 Learn about vulnerability in an interactive lesson of Snyk Learn.

Already fixed by #112


F401 use BTreeMap instead of FxHashMap

Potentially resolves #11619 (nondeterministic hashmap order across different architectures) in F401 by replacing a hashmap with nondeterministic traversal order with an ordered mapping.

I'm not sure how to test this with our CI/CD. I don't have an s390x machine at home. Should I try it in Qemu?

I would just ship it and ask the original filer if it's resolved.

SGTM. I was having "uncompression error" trying to get an alpine s390x iso to start in qemu. Merging now.


What type of update are you requesting?
A new version of an existing package
Current Package Identifier
Spacemesh.Spacemesh
Package Version
0.2.6+
Please describe the changes you would like to see

Reference: https://github.com/microsoft/winget-pkgs/pull/164053

[!NOTE]
Issue should be closed as "completed", since #164212 resolve this.

#163332

Close with reason: Resolved; by #164212


replace 0 cmdThreads with getNumProcessors in earlier so it's used everywhere

fixes -j not actually doing any work in parallel (except gc)
noticed this because --threads=8 performed very different than -j but getNumProcessors returns 8 for me
on my other machine with more cores
before:
hlint . -j 3m54s
hlint --threads=24 29s
after this -j is also ~29s

Oops! Great spot!
I think the real fix is to change https://github.com/ndmitchell/hlint/blob/466ed41c491eff616281adc46b104b6045e6c8c8/src/HLint.hs#L148 to add the line  to become:
    cmdThreads <- if cmdThreads == 0 then getNumProcessors else pure cmdThreads
    cmd <- pure CmdMain{..}

Or alternatively, to push the defaulting of cmdThreads up to https://github.com/ndmitchell/hlint/blob/466ed41c491eff616281adc46b104b6045e6c8c8/src/CmdLine.hs.

how's this :) not quite either of your suggestions 😅

mmm also a high thread count actually ends up performing worse than --threads=2 due to the parallel gc being too eager. I'm using +RTS -A64m which makes parallel gc behave much better

My experience is that parallel GC is garbage - its always slower than serial GC. I'm a fan of the RTS flags "-with-rtsopts=-I0 -qg" - does that help (probably wants adding https://github.com/ndmitchell/hlint/blob/master/hlint.cabal#L170)

Thanks, great work! Keen to see the effect of -qg, and if that helps further, we can reduce times even more

Oh, and as for the code, it looks like where you put it is a bit better than either of my suggestions!

I think -I0 should make no difference here cause hlint doesn't idle?
fresh results run back to back on 4core ht
-A64m 44s with 587% cpu utilisation (according to gnu time)
-I0 -qg  1m52s with 239% cpu util
-I0 -qg -A64m  54s with 443% cpu util
-A64m 44s with 584% cpu util (ran again to check fluke)

So sounds like adding -A32 is a good idea? And parallel GC is now not as harmful as it used to be.

I pushed a change to move us to -A32m.


K3s script does not apply correctly

Describe the bug
While following the directions for installing to k3s, the generated YAML does not apply and returns a BadRequest error.
To Reproduce
Steps to reproduce the behavior:

Generate the manifest curl -sL kube-vip.io/k3s | vipAddress=<IP_ADDRESS> vipInterface=eth0 sh | tee /tmp/vip.yaml
Run  kubectl apply -f /tmp/vip.yaml
See error

Error from server (BadRequest): error when creating "/tmp/vip.yaml": DaemonSet in version "v1" cannot be handled as a DaemonSet: v1.DaemonSet.Spec: v1.DaemonSetSpec.Template: v1.PodTemplateSpec.Spec: v1.PodSpec.Containers: []v1.Container: v1.Container.Env: []v1.EnvVar: v1.EnvVar.Value: ReadString: expects " or n, but found t, error found in #10 byte of ...|,"value":true},{"nam|..., bigger context ...|gs":["manager"],"env":[{"name":"vip_arp","value":true},{"name":"vip_interface","value":"eth0"},{"nam|...

Expected behavior
The manifest should apply cleanly with no error.
Environment (please complete the following information):

OS/Distro: Photon OS 4.0
Kubernetes Version: v1.21.0
Kube-vip Version: From kube-vip.io/k3s

Kube-vip.yaml:
apiVersion: apps/v1
kind: DaemonSet
metadata:
  creationTimestamp: null
  name: kube-vip-ds
  namespace: kube-system
spec:
  selector:
    matchLabels:
      name: kube-vip-ds
  template:
    metadata:
      creationTimestamp: null
      labels:
        name: kube-vip-ds
    spec:
      containers:
      - args:
        - manager
        env:
        - name: vip_arp
          value: true
        - name: vip_interface
          value: eth0
        - name: port
          value: 6443
        - name: vip_cidr
          value: 32
        - name: cp_enable
          value: true
        - name: cp_namespace
          value: kube-system
        - name: svc_enable
          value: false
        - name: vip_address
          value: <IP_ADDRESS>
        image: plndr/kube-vip:0.3.2
        imagePullPolicy: Always
        name: kube-vip
        resources: {}
        securityContext:
          capabilities:
            add:
            - NET_ADMIN
            - NET_RAW
            - SYS_TIME
      hostNetwork: true
      nodeSelector:
        node-role.kubernetes.io/master: true
      serviceAccountName: kube-vip
      tolerations:
      - effect: NoSchedule
        key: node-role.kubernetes.io/master
  updateStrategy: {}
status:
  currentNumberScheduled: 0
  desiredNumberScheduled: 0
  numberMisscheduled: 0
  numberReady: 0

As crazy as this may sound..  put true in quotes.  aka, true => "true".
I don't know why it can't handle it otherwise..
an example:
        env:
          - name: vip_interface
            value: enp1s0
          - name: vip_arp
            value: "true"
          - name: port

It will also not work correctly, it's missing the serviceaccount, role and rolebinding information.
Here's what I am using on k3s v1.20+k31
apiVersion: v1
kind: ServiceAccount
metadata:
  namespace: kube-system
  name: kube-vip
---
kind: Role
apiVersion: rbac.authorization.k8s.io/v1
metadata:
  name: vip-role
  namespace: kube-system
rules:
  - apiGroups: ["coordination.k8s.io"]
    resources: ["leases"]
    verbs: ["get", "create", "update", "list", "put"]
  - apiGroups: [""]
    resources: ["configmaps", "endpoints"]
    verbs: ["watch", "get"]
---
kind: RoleBinding
apiVersion: rbac.authorization.k8s.io/v1
metadata:
  namespace: kube-system
  name: vip-role-bind
subjects:
  - kind: ServiceAccount
    name: kube-vip
    apiGroup: ""
roleRef:
  kind: Role
  name: vip-role
  apiGroup: ""
---
apiVersion: apps/v1
kind: DaemonSet
metadata:
  creationTimestamp: null
  name: kube-vip-ds
  namespace: kube-system
spec:
  selector:
    matchLabels:
      name: kube-vip-ds
  template:
    metadata:
      creationTimestamp: null
      labels:
        name: kube-vip-ds
    spec:
      containers:
      - args:
        - manager
        env:
          - name: vip_interface
            value: enp1s0
          - name: vip_arp
            value: "true"
          - name: port
            value: "6443"
          - name: vip_cidr
            value: "32"
          - name: cp_enable
            value: "true"
          - name: cp_namespace
            value: "kube-system"
          - name: svc_enable
            value: "false"
          - name: vip_address
            value: <IP_ADDRESS>
        image: plndr/kube-vip:0.3.3
        imagePullPolicy: Always
        name: kube-vip
        securityContext:
          capabilities:
            add:
            - NET_ADMIN
            - NET_RAW
            - SYS_TIME
      hostNetwork: true
      nodeSelector:
        node-role.kubernetes.io/master: "true"
      serviceAccountName: kube-vip
      tolerations:
      - effect: NoSchedule
        key: node-role.kubernetes.io/master

it's a etcd cluster, so I bind kube-vip to just the master nodes.

Apologies, the documentation really needs re-writing in a clearer way => https://kube-vip.io/hybrid/daemonset/#k3s-overview-on-equinix-metal
is the updates k3s docs.

The k3s script has now been fixed!


How it works? private api

Hello,
How it works, there is a instagram private api?
Why there is instagram private api and not for facebook?
This works like selenium webdriver for mobile?
It is only doubt lol

It simulates the way that the Instagram mobile app accesses the APIs. It's private because it's not publicly documented, and usually, the way to do it has to be figured out from reverse engineering of source code and/or monitoring network traffic.


Preventing problem within form view when import model is service type

Basically, when a url was submitted, form data view was resetting the import model type, so it was always 'url' type :(. Also, ArcGIS was considered as url, so double fault.
REVIEWER: @javierarce
Fixes #4080
cc @Kartones @iriberri

Frontend tests were OK :+1: (details)

:+1:

Frontend tests were OK :+1: (details)

Frontend tests were OK :+1: (details)


Add update/patching ability to bootstrap script.

While the original functionality didn't call for this specifically, it has become apparent that over time there will be a need to update the packages on the host machines. It's not clear how or where this logic makes the most sense, but essentially, when a user updates the nanoagents from within the dashboard, we also want to to update the packages if anything is out of date. So, we'll need to add this logic to either:
1 - The current nanoagent-update script.
2 - The bootstrap script
3 - A separate script altogether that gets called separately on update.
@glinton, @notxarb thoughts or preferences?

If we go with option 3, it would be easier to support more platforms down the line.


Windows 10 built-in vpn

After using hosts file it's not working anymore is there a way to get it work ?

Hello @MidnightD4wn thank you for this question.
I'm going to need more information to interpret what you are trying to say.

What, exactly, is not working anymore.
Whatever is not working anymore, was it working before, and with or without the hosts file.
Which hosts file are we talking about here.  We offer 16 different hosts files.

Finally, have you read the repo readme?  In particular this section: Warning: Using this hosts file in Windows may require disabling DNS Cache service.

i used the one at releases page, Release 3.11.28
after updating host file
using this file

and i disabled DNS Cashe service
windows 10 built-in vpn became broken for some reason

and yea it was working before updating hosts file

@NaniDaFuck have you tried downloading the precompiled host file listed in the readme and manually install it? releases are source only and may not work on all systems automagically because of many varying factors. simply download the raw hosts file from the readme at the main page of this repo and follow the instructions on where to put it:
Location of your hosts file
To modify your current hosts file, look for it in the following places and modify it with a text editor.

macOS (until 10.14.x macOS Mojave), iOS, Android, Linux: /etc/hosts.
macOS Catalina: /private/etc/hosts.
Windows: %SystemRoot%\system32\drivers\etc\hosts.

and replace the preexisting file.
hope this helps

It works now thanks however i think the issue was with dns i was using

i used the one at releases page, Release 3.11.28 after updating host file using this file  and i disabled DNS Cashe service windows 10 built-in vpn became broken for some reason microsoft store too

Win10 21H2 build 19044.4894
Hello, i've got same issue, and after some research found dependency of DNScache service and Win10 VPN connections - somehow disabling that service also delete all WAN-adapters from Device manager.
Tried to reproduce 3 times and every time when i change Registry parameter from 2 to "4"(disabled)  Adapters dissapearing from list of installed devices when i change Registry parameter from 2 to "4"(disabled) - thus making unable to connect via VPN or PPPOE
@StevenBlack - perhaps it is worth adding this warning to the documentation?

I have always been against disabling the DNS caching service as it also disables things like WSL (among these other stated issues) and so I recommend compressing the hosts file as I prove time and time again on various machines with various versions of Window that compressing massive hosts files works very well. It's actually already mentioned in the Steven's README (under: Warning: Using this hosts file in Windows may require disabling DNS Cache service in the second paragraph) along with a link to to my hostscompress tool which a link is also found here (under: Interesting Applications).
This is the paragraph excerpt mentioned above:

Disabling the DNS Cache Service can cause issues with services and applications like WSL and it's possible to compress the hosts file and negate the need to disable the DNS caching service. You can try the C++ Windows command line tool at Hosts Compress - Windows (the recommended method) or the PowerShell compression script and check out the guide located at the Hosts Compression Scripts repository.

The problem is the number of entries that the DNS Service has to process which makes Windows networks hang for far too long my tool (and other compression tool) reduces the number of lines by combining multiple hostnames (up to 9) into each IP line, essentially reducing the service workload by up to 9 times. More information can be found at my program's repository.
Once compressed it should work like a charm and there's no need disable or alter anything. You can just compress the HOSTS file and use it in anyway you already were.
I am actually in the process of writing a Powershell script (I have a tool (BlackHosts) already, but it has issues with it's downloading limits so I need to fix it) for downloading, compressing (with my hostscompress), and installing HOSTS files from here, but it's not ready yet. For now you'll have to compress and replace it manually.

Thank you for the assist here Ian @Lateralus138!


Updated info.md to add space between images

A blank line was inserted between images in the markdown to ensure proper rendering in the final datasheet. Fig.22 appearing upside down in datasheet. Don't know why ?

@urish  Please suggest why images are not appearing properly in final datasheet as per sequence in info.md file.


Actor Critic for Mountain Car

Hi,
Thanks a lot for the wonderful work, the code is well written and modular, it helped me a lot to play with RL in general.  I want to know if you have an opinion on using Actor Critic methods on control problem such as Mountain Car.  I added Mountain Car to the environment and ran A2C and A3C, both of them never converged to a solution.  I modified the hyperparameter discount factor to 0.9 and got both Actor loss and Critic Loss to be zero but the reward never reduced below -200.  I then tried adding Entropy to improve exploaration but that leads to exploding gradients.  Looking deeper, it looks like Actor Critic methods are not good at exploring the space if the return is constant.
I looked at the other implementations of solving Mountain Car and it is solved either using Function Approximation (Tile coding) or DPG, there was no one who had used Actor Critic.

Hello,
Thank you for the feedback about my code! I'm glad that I can help other people using my repository.
I have experienced the same issue with the MountainCar-v0 environment. The problem is that we have an on-policy method (A2C and A3C) applied to an environment that rarely gives useful rewards (i.e. only at the end).
I have only used Sarsa with function approximation (not DPG), and I believe this algorithm works quite good on the MountainCar-v0 environment because in this case it favors actions that haven't been tried yet in the current state. This is the case because the thetas are initialized randomly uniform. Whenever a reward (for this environment -1) is received, it only changes thetas for the previous state and action.
I haven't studied and implemented DPG yet. I am interested in how that algorithm is able to "solve" this environment.
In contrary to Sarsa+F.A., updates using A3C can influence all the parameters (in this case the neural network weights) and thus the result for every state (the input to the neural net of the actor) can be influenced. I ran an experiment, and the network always seems to output the same probabilities, as the feedback to the network is also always the same.
Thus, you can only get at the finish by luck. Once the agent "discovered" the finish, the performance should improve. In fact, some people report to have successfully learned using A3C.
I hope my explanation is clear. Feel free to ask more questions otherwise.
I also don't fully understand it yet. Unfortunately, I don't have enough time right now to investigate the problem more thoroughly.

By the way, the weights of the networks in my A2C and A3C algorithms weren't initialized properly. The standard deviation was 1, which is too big and can lead to a big difference in probabilities for the action to be selected. Sometimes an action had only a probability of 0.5% for example. As I explained, the probabilities never change much and thus sometimes an action is rarely selected. I changed it now by using as weight initializer tf.truncated_normal_initializer(mean=0.0, stddev=0.02).

Thanks for your explanation, that helps.  It seems that on-policy have bad exploration compared to off-policy so, in situations where the rewards are not changing with state changes, it is better to use off-policy methods.  At a simple level, off-policy is just using a Max (Q(S,A)) instead of the Q(S,A) according to the policy.  Looking at the Critic Loss
critic_loss = tf.reduce_mean(tf.square(self.critic_target - self.critic_value), name="loss")
will replacing the self.critic_target with the Max value from the array make it off-policy?
BTW, I tried various things on A2C to make it work such as added reward for movement
           for _ in range(self.config["repeat_n_actions"]):                 state, rew, done, _ = self.step_env(action)                 stateDelta = np.mean(np.square(state-old_state))                 # Good rewards if agent moved the car                 if stateDelta > 0.0001:                     rew = 0                 if done:  # Don't continue if episode has already ended                     break
and Experience Replay and epilson greedy            if np.random.rand() <= self.config["epsilon"]:                 action = np.random.randint(0,3,size=1)[0]             else:                 action = self.choose_action(state) but the network still won't converge to less than 200 steps.   I don't know why but I will investigate.
Thanks again for your help in understanding


Want analog battery circuit indicator.

the esp32 marauder github repo has analog battery indicator developed by @Joshinken
https://github.com/justcallmekoko/ESP32Marauder/pull/35
https://github.com/justcallmekoko/ESP32Marauder/pull/31
https://github.com/justcallmekoko/ESP32Marauder/pull/30
I want to be able to do that on cyd marauder.

oh hey thats me!
im skimming over it, doesnt the cyd use the marauder code? shouldnt it be merged in automatically?
hardware wise my method only needs 2 mosfets and a few resistors, though if youre not bothered by a small amount of background battery drain you can skip the mosfets

im looking at it more closely now, yeah hardware wise this is doable, though id need some wrangling to make it not interfere with the boot process. using the power/uart header, have IO0/tx as the battery enable, IO2/rx as the battery measurement, 5v as 5v and gnd as gnd. youd need a secondary board containing charge and boost circuitry but all that is fairly easy
if youre willing to wait a few weeks i could get these parts and probably prototype a board for this tbh

I thought you only needed 1 pin, I've seen some esp8266 battery indicator examples on youtube which only use one gpio pin, they use a voltage divider and connect the voltage to the battery
using io35 pin which only supports input according the  cyd-repo
This would free up the tx and rx pins which are usually used for gps for wardriving
also the secondary board your referring to is something like a tp4056?
also take your time, not like I'm paying you.

you only need 1 pin to measure the battery, you need 2 pins if you dont want the battery to be drained 24/7 by the voltage divider
i need the pin header with rx and tx to get access to the 5v line so i thought id use those pins, though i guess you could plug a usb in or have a passthrough for the uart
secondary board means something containing all the electronics? you cant plug a battery straight into an esp32, you need to make a voltage that is used by the board, in this case thats 5v. to make a reasonable battery pack for this board you need a charge circuit to get power into the battery, a step up converter to get 5v, a voltage divider, and if you want the battery to not get drained, 2 mosfets and some pullup resistors

A lot of this went over my head, I'll just wait for you to figure it out.
On Tue, May 28, 2024 at 3:32 PM Joshinken @.***> wrote:

you only need 1 pin to measure the battery, you need 2 pins if you dont
want the battery to be drained 24/7 by the voltage divider
i need the pin header with rx and tx to get access to the 5v line so i
thought id use those pins, though i guess you could plug a usb in or have a
passthrough for the uart
secondary board means something containing all the electronics? you cant
plug a battery straight into an esp32, you need to make a voltage that is
used by the board, in this case thats 5v. to make a reasonable battery pack
for this board you need a charge circuit to get power into the battery, a
step up converter to get 5v, a voltage divider, and if you want the battery
to not get drained, 2 mosfets and some pullup resistors
—
Reply to this email directly, view it on GitHub
https://github.com/Fr4nkFletcher/ESP32-Marauder-Cheap-Yellow-Display/issues/25#issuecomment-2134991909,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/APV23XDDGPKYP4PHMDO7URDZERTL7AVCNFSM6AAAAABIJAKB2WVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCMZUHE4TCOJQHE
.
You are receiving this because you authored the thread.Message ID:
<Fr4nkFletcher/ESP32-Marauder-Cheap-Yellow-Display/issues/25/2134991909@
github.com>

ok: a voltage divider relies on power flowing. power flowing means power flowing OUT OF your battery. this is generally considered "not good", so we build a circuit that disabled the voltage divider while it isnt needed. this isnt strictly necessary, but its good practice and doesnt cost much to do
an esp32 wants 3.3v and any more will kill it. the CYD provides that, but needs 5v itself, and any less wont work. a battery is between 3.2 and 4.2v, depending on how full it is, so if you plug it straight into any part of this you get a choice of either blowing up the esp or underpowering the CYD. so we need to get it up to 5v first, give that to the CYD, and let it provide the 3.3v to the esp32
you also need something to charge it, because batteries are very particular about their voltages and will decide to catch fire if you, say, try to give it 5v straight over usb; and something protect it from being discharged to much, and protect it from having too much power drawn at once. luckily something like a 4056 will handle those last 3, but it wont do either of the first 2, so we need a board that has all of these parts


Failed to download on everything

Ive been using this wonderful tool ever since it wasnt even a tool (browser version)
I have two of them "installed" one in my portable hard drive and one in my local PC, the one on my local hard drive that i use when in my office works fine but recently on the version of it on my home PC,
EVERY attempt to download comes up with the "failed to download" error string.
ive tried turing windows firewall on and off,uninstalling my new anti virus and even deleting the ripper and re-downloading a new one.nothing does the trick.
the problem started when around my old anti virus just uninstalled itself out of the blue and left all my programs unable to connect to the internet, i managed to get the complete remover for that program which fixed most of my programs. though after that, the ripper and some other small applications of mine just cant even connect anymore.

It's likely there's an operating-system level proxy that you're using. There's been other issues about RipMe not respecting system proxies.
Leaving this open until I can setup a proxy on my own computer for testing.

@4pr0n incidentally, ive had my PC reformatted the other day(for different reasons), starting out with a fresh PC seems to have solved the problem.
all i can say is, stay away from norton antivirus


[ROCKETMQ-256] Clean commit log files manually to specified disk usage watermark

Associated JIRA ticket is: https://issues.apache.org/jira/browse/ROCKETMQ-256

Coverage decreased (-0.1%) to 38.612% when pulling c967102209c27f268fb1c058263c909474d46b00 on lizhanhui:store_clean into 98bd032454c9dd01bcaea0f4c92abfa0b1847bac on apache:develop.

Coverage decreased (-0.1%) to 38.612% when pulling c967102209c27f268fb1c058263c909474d46b00 on lizhanhui:store_clean into 98bd032454c9dd01bcaea0f4c92abfa0b1847bac on apache:develop.

Coverage decreased (-0.1%) to 38.612% when pulling c967102209c27f268fb1c058263c909474d46b00 on lizhanhui:store_clean into 98bd032454c9dd01bcaea0f4c92abfa0b1847bac on apache:develop.

Thanks for contribution. As force delete may cause message lost,how about add a warnning in command help? And also add a monitor disk usage tool command for check.

"As force delete may cause message lost,how about add a warnning in command help?"--->Added.
"And also add a monitor disk usage tool command for check." --> I do not follow this comment, could you please  articulate it more specifically?

Coverage increased (+0.03%) to 38.772% when pulling e767801526ef804a4945270720bba59a490bfc03 on lizhanhui:store_clean into 98bd032454c9dd01bcaea0f4c92abfa0b1847bac on apache:develop.

Coverage increased (+0.03%) to 38.772% when pulling e767801526ef804a4945270720bba59a490bfc03 on lizhanhui:store_clean into 98bd032454c9dd01bcaea0f4c92abfa0b1847bac on apache:develop.

@zhouxinyu @dongeforever please help review this PR.

@lizhanhui This purge is not be safe for scheduled message.

I will close the pr, if you happened to the same question, please let me know.


Overlapping tabs

I tried to achieve this in my project,

However, I am facing this issue where the tabs become overlapping and not scrollable.

I am using the latest version of super-tabs. Is there any solution for the tabs to become like one above? Help! Thank you in advance..

Are you using the scrollTabs attribute?

Having same issue and not using scrollTabs property. Please help me out. Thanks in advance.

@ihadeed thank you for your reply, so sorry I didn't read the documentation well enough.. Thank you for your time. Really appreciate!


ARROW-18290: [C++] Escape all special chars in URI-encoding

By default, the AWS SDK doesn't URI-escape some special chars such as '='. This works fine with AWS endpoints, but not with some non-AWS S3-compatible endpoints.

Great, thank you! Will merge then.


No need for node_modules to be checked in

please update the .gitignore

Thanks, will fix. Did that because I saw existing projects had it checked in.


fixaccess HMS need ugiDoAs

Proposed changes
merge from https://github.com/apache/doris/pull/30595

Further comments
If this is a relatively large or complex change, kick off the discussion at<EMAIL_ADDRESS>by explaining why you chose the solution you did and what alternatives you considered, etc...

run buildall


Risingwave manifest for SQLite as meta store and local disk as storage

What's changed and what's your intention?
Added a manifest that's really easy to use -- just sqlite and local disk. Very easy for folks to POC to.
I replicated risingwave-sqlite-s3 and risingwave-etcd-local-disk. I made the version in 2.1.0
Checklist

[x] I have written the necessary docs and comments
[ ] I have added necessary unit tests and integration tests

Refer to a related PR or issue link (optional)

The test failed because of some deleted files. I opened a PR to fix it. Let's rebase the PR onto main once it's merged.


"Errors in activity functions" - JavaScript example doesn't work

Trying to catch an error from a failed activity function and then run another error handling activity function in the catch block isn't working as documented.  The error handling activity never runs.  The orchestration simply completes.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 53ea12e4-9fad-88f3-7aa5-c1f323b62071
Version Independent ID: a9bdbd18-3850-4dbc-5aaf-36afef0b30ae
Content: Handling errors in Durable Functions - Azure
Content Source: articles/azure-functions/durable-functions-error-handling.md
Service: azure-functions
GitHub Login: @kashimiz
Microsoft Alias: azfuncdf

Thanks for reporting this, @lbrillhart . What version of the durable-functions npm package are you using?

Hi Katy,
We're pulling 1.0.0.
from the package.json file:
"_from": "durable-functions",
"_id"<EMAIL_ADDRESS>"_inBundle": false,
"_integrity":
"sha512-nlECj0km6VrGSV9oWj5SqV3c0h1+2vbPDr+EUb3UNRRLlVYaVljahnT+MQ7hIsD6+YOFSY6Mml4HeaCUClFE2w=="
,
Thanks,
Locke
On Fri, Nov 16, 2018 at 2:37 PM Katy Shimizu<EMAIL_ADDRESS>wrote:

Thanks for reporting this, @lbrillhart https://github.com/lbrillhart .
What version of the durable-functions npm package are you using?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/MicrosoftDocs/azure-docs/issues/19097#issuecomment-439536714,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AB2wQhD7TiCaJwZqnASjsvum1MKxnGr7ks5uvy_9gaJpZM4YnAQz
.

Thanks for confirming, Locke. I've been able to reproduce the issue you described; this looks like a bug on our end. I'll investigate this - much appreciation to you for finding it. I've opened an issue in the Durable JS repo to track this: Azure/azure-functions-durable-js#23

Ok very good.  Glad it's not my dumb coding error ;)
FWIW, my work email is<EMAIL_ADDRESS> Kleinfelder is a MS EA
customer.    These durable functions are very
cool and we're trying to leverage them heavily.  Looking forward to the
progress.
Thanks,
Locke
On Fri, Nov 16, 2018 at 4:02 PM Katy Shimizu<EMAIL_ADDRESS>wrote:

Thanks for confirming, Locke. I've been able to reproduce the issue you
described; this looks like a bug on our end. I'll investigate this - much
appreciation to you for finding it. I've opened an issue in the Durable JS
repo to track this: Azure/azure-functions-durable-js#23
https://github.com/Azure/azure-functions-durable-js/issues/23
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/MicrosoftDocs/azure-docs/issues/19097#issuecomment-439555292,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AB2wQuDeeoO6OvsDVfoAJj74qiSoDELlks5uv0QRgaJpZM4YnAQz
.

Thank you, Locke! It's always exciting to hear from someone using Durable in the field.
Please reach out with questions or feedback at any time. Our main repo is Azure/azure-functions-durable-extension. We're always happy to help and learn how we can improve. :)

The fix for this issue has been released. #please-close

@lbrillhart
Thanks for bringing this to our attention. We will now close this issue. If there are further questions regarding this matter, please tag me in a comment. I will reopen it and we will gladly continue the discussion.


JRuby: setCommInactivityTimeout causes a NullPointerException when Webmock is active

We're in a process of migrating a Rails application from MRI to Jruby and have noticed a weird issue when running our tests: if we use stub_request for a specific URL and then hit that URL with em-http-request, EventMachine blows up with a NullPointerException error. When the same call is made without a mock, then it works as expected.
The issue is 100% reproducible and I've created a repository to demonstrate it: https://github.com/kovyrin/test-em-vs-webmock.
If we could provide any additional information about the issue, please let me know.

WebMock does not support EM HttpRequest on JRuby https://github.com/bblimke/webmock/blob/master/spec/acceptance/em_http_request/em_http_request_spec.rb#L6
This lack of support comes from the days when EM HttpRequest did not support JRuby at all,
therefore probably it's now worth adding back this support.


maintainers: update GitHub names

It is important to have a usable mapping of maintainers -> GH handles to ping maintainers for reviews or bugs.
This PR updates all outdated GitHub names based on the provided ID (note: I only fixed the casing up to JanLikar). I have included the checking script in the commit message.
For the affected entries, I checked that the ID is correct by looking at one of their PRs.

nerdypepper https://github.com/NixOS/nixpkgs/pull/134110/files
osener https://github.com/NixOS/nixpkgs/pull/5838/files
oxapentane https://github.com/NixOS/nixpkgs/pull/195000/files
paddygord https://github.com/NixOS/nixpkgs/pull/48214/files
patricksjohnson https://github.com/NixOS/nixpkgs/pull/192643/files
pawelpacana https://github.com/NixOS/nixpkgs/pull/14980
realsnick https://github.com/NixOS/nixpkgs/pull/217725/files
sanana https://github.com/NixOS/nixpkgs/pull/341087
tomsiewert https://github.com/NixOS/nixpkgs/pull/179450/files
voidIess https://github.com/NixOS/nixpkgs/pull/95422/files

The following maintainers were not found. Probably they should be removed.

cyewashish
galaxy
gm6k
hikari
infinitivewitch
liberatys
lw
mjanczyk
ne9z
snowflake
tomkoid
vector1dev

Things done

[x] Fits CONTRIBUTING.md.

Add a :+1: reaction to pull requests you find important.

Could you just simply put the script into the tree instead? Nobody is going to find this in a commit message.
We could even turn this into a CI check at some point.

Script added in-tree.
The trouble with a CI check is that it will faily randomly. Perhaps it could be run periodically like the staging merges, and notify someone when it fails.

Separate commit please.
Ah, I think I misunderstood the problem then. If this happens outside of our control, then yes a CI check doesn't make sense. We'd need a bot to run this regularly instead but I don't think this happens frequently enough to justify setting one up.

Contrary to @Atemu in this PR but in accordance with @Atemu in https://github.com/NixOS/nixpkgs/issues/327064, I'd prefer this not go into the nixpkgs tree. @FliegendeWurst, want to make a tiny @nix-community repo for this? Or see what the delta between https://github.com/nix-community/rfc55 and your script is?

Or see what the delta between nix-community/rfc55 and your script is?

That script seems to serve a different purpose. It looks through the committers team and finds inactive users.
My script checks the maintainer-list.nix for changed GH usernames.

We could just skip the lock file.

Yeah exactly. Having a repo for a 42 lines script is just creating repo brawl.

We could just skip the lock file.

Yeah exactly. Having a repo for a 42 lines script is just creating repo brawl.

Removed as suggested. And it probably also makes more sense to keep this script next to all the other scripts in maintainers/scripts.

Ah, one last thing: Could you add the description you put into the PR message into the commit message too?
PRs can suddenly become non-permanent quickly and this would make it more accessible if the history is queried from git too.
I'd also order the commits the other way around but that's a nit.

Description updated.
GitHub is stuck at "Processing updates", so I have opened #362419 instead.


feat: dynamic-upstream plugin support domain.

fix #2

this PR depends on: https://github.com/apache/apisix/pull/2424


change from openstreetmaps to HERE but it doesn't work

Hi,
my plan is to switch from openstreetmaps to HERE. As I'm a beginner, can you please help me to get it done properly?
I have already an API key from HERE. The test example gives me an error. Therefore I ask for help.
Even with the description it's impossible for me to get it work.
Thanks in advance
This is my current code:
`var NodeGeocoder = require('node-geocoder');
var options = {
provider: 'openstreetmap',
httpAdapter: 'https', // Default
apiKey: ' ', // for Mapquest, OpenCage, Google Premier
formatter: 'json' // 'gpx', 'string', ...
};
var geocoder = NodeGeocoder(options);
geocoder.reverse({lat:xx.xxxxxx, lon:xx.xxxxxx}, function(err, res) {
console.log(res);
console.log(res[0].city);
console.log(res[0].state);
console.log(res[0].zipcode);
console.log(res[0].streetName);
console.log(res[0].streetNumber);
});`

I use nodejs-geolocation which works perfectly with here


Nomad provider fails to load initial nomad services

Welcome!

[X] Yes, I've searched similar issues on GitHub and didn't find any.
[X] Yes, I've searched similar issues on the Traefik community forum and didn't find any.

What did you do?
A configured the new nomad provider in traefik like this:
  nomad:
    prefix: "traefik"
    endpoint:
      token: MY_TOKEN
      address: https://url_to_nomad

What did you see instead?
When calling https://url_to_nomad/v1/services with the proper X-Nomad-Token header it works (I get a HTTP 200 response) but when that same call is made in the nomad provider it returns a 403 (see log below)
It looks like the token isn't passed at all.
I assume the configuration is read correctly because before that I encountered other errors where my endpoint was logged.
What version of Traefik are you using?
2.8
What is your environment & configuration?
# (paste your configuration here)

Add more configuration information here.
If applicable, please paste the log output in DEBUG level
{"level":"error","msg":"Provider connection error failed to load initial nomad services: Unexpected response code: 403 (Permission denied), retrying in 2.382501263s","providerName":"nomad","time":"2022-06-21T16:15:46Z"}

Hello @DamboisP,
Thanks for your interest in Traefik,
In https://github.com/traefik/traefik/pull/9111 we fixed an issue with the Nomad token not being used by the Nomad client.
We will release a v2.8.0-rc2 in the coming days, in the meantime, you could use the traefik/traefik:experimental-v2.8 image which is built from the v2.8 branch.
Does that fix your issue?

Hello, yes it fixed my issue ! Thanks for answering so quickly and sorry for not being able to find it myself before opening that issue.
Have a nice day


Proposal: spam-wave tool

I've been thinking on and off recently about spam waves. Every now and then, a site gets hit by a wave of spam, usually for a particular product or by a particular user (the last one was Web Apps, spamming a Google "support number"). Almost invariably, once we're alerted of it, our response is to try to kick the posts over the autoflagging threshold, and then let the system work its magic.
This kicking of posts over the threshold is usually done by manipulating the blacklists or other reasons to catch the posts - and while that's nominally fine, it's usually done with less care for false positives than regular everyday activities, and more of a hack-it-until-it-works attitude.
My thought is that having a dedicated tool for this kind of thing could help us be more efficient around spam waves and put us in a better position to help site moderators and CMs more directly. So, I'm suggesting a tool that allows an admin to define a search for which, for 24 hours, every matching post gets autoflagged.
We had a bit of a discussion of this in chat last night. Obviously, this tool comes with suitable safeguards:

Allow admins to set the duration for which the wave lasts, with a maximum of 24 hours, but allow it to be renewed when it's almost up. This forces it to be regularly reviewed so that it gets stopped when the spam has stopped. (Optionally, also drop a message in Charcoal HQ when the wave is ~90% done, to alert people that it needs review/renewal).
Require the search used to define the wave to have a minimum accuracy and post count. These figures will be lower than required for flag conditions, by the nature of spam waves, but could perhaps be in the 95%/10 ballpark.
Potentially, we could allow admins to set a max_flags for the wave, which could be above the regular max_flags. With site mod + CM buy-in (which is easier to get on one site than network-wide), we could 5-flag matching posts to get them destroyed quicker.

This does raise questions of sockpuppetry, which is partially why I want to discuss this here - obviously allowing one person to 4-flag a single post is out of the question, but is defining a search as opposed to picking posts far enough removed that it's okay?
What else does this idea need?

[status-completed]

https://metasmoke.erwaysoftware.com/spam-waves


Scalafix rules for Monocle 3

Monocle 3 deprecates lots of methods, it would be great to use scalafix to automatically refactor the ones that have replacements. Here is a list of changes:

[ ] set to replace
[ ] setOption to replaceOption

Shortcuts for popular optics

[ ] composeLens(at(x)) to at(x)
[ ] composePrism(some) to some
[ ] composeOptional(index(x)) to index(x)
[ ] composeTraversal(each) to each
[ ] composeTraversal(filterIndex(predicate)) to filterIndex(predicate)
[ ] composeLens(first) or composeLens(_1) to  at(1)
[ ] composeLens(second) or composeLens(_2) to at(2)
[ ] composeLens(third) or composeLens(_3) to at(3)
[ ] composeLens(fourth) or composeLens(_4) to at(4)
[ ] composeLens(fifth) or composeLens(_5) to at(5)
[ ] composeLens(sixth) or composeLens(_6) to at(6)
[ ] composeOptional(headOption) to index(0)

Overloaded compose method

[ ] composeFold(x) to andThen(x)
[ ] composeGetter(x) to andThen(x)
[ ] composeIso(x) to andThen(x)
[ ] composeLens(x) to andThen(x)
[ ] composePrism(x) to andThen(x)
[ ] composeOptional(x) to andThen(x)
[ ] composeTraversal(x) to andThen(x)
[ ] composeSetter(x) to andThen(x)

Remove symbolic compose operators

[ ] ^|->> x to andThen(x)
[ ] ^|-? x to andThen(x)
[ ] ^<-? x to andThen(x)
[ ] ^|-> x to andThen(x)
[ ] ^<-> x to andThen(x)

ApplyOptics

[ ] applyLens(at(x)) to optics.at(x)
[ ] applyPrism(some) to optics.some
[ ] applyOptional(index(x)) to optics.index(x)
[ ] applyTraversal(each) to optics.each
[ ] applyTraversal(filterIndex(predicate)) to optics.filterIndex(predicate)
[ ] applyLens(first) or applyLens(_1) to  optics.at(1)
[ ] applyLens(second) or applyLens(_2) to optics.at(2)
[ ] applyLens(third) or applyLens(_3) to optics.at(3)
[ ] applyLens(fourth) or applyLens(_4) to optics.at(4)
[ ] applyLens(fifth) or applyLens(_5) to optics.at(5)
[ ] applyLens(sixth) or applyLens(_6) to optics.at(6)
[ ] applyOptional(headOption) to optics.index(0)
[ ] applyFold(x) to optics.andThen(x)
[ ] applyGetter(x) to optics.andThen(x)
[ ] applyIso(x) to optics.andThen(x)
[ ] applyLens(x) to optics.andThen(x)
[ ] applyPrism(x) to optics.andThen(x)
[ ] applyOptional(x) to optics.andThen(x)
[ ] applyTraversal(x) to optics.andThen(x)
[ ] applySetter(x) to optics.andThen(x)

Reference: https://github.com/fthomas/scala-steward/blob/master/docs/scalafix-migrations.md
Originally proposed in https://github.com/optics-dev/Monocle/issues/684

Do we have a list of scalafix migration rules that we need to apply for the project ?

@chaitanyawaikar no, sorry I am not familiar with scalafix.

I will take this one


[BUG] Investigate huge per capita numbers for age in mountain view, ar

http://staging.datacommons.org/place?dcid=geoId%2F0547540&topic=Demographics

Check Muncie, IN:
http://staging.datacommons.org/place?dcid=geoId%2F1851876&topic=Demographics

The population data of Muncle has some issue:

this is in prod now: https://screenshot.googleplex.com/6KBngDebxtgLVUG

Moving discussion offline.


Unexpected error occurred when listening to order book streams

Describe the bug
// A clear and concise description of what the bug is.
unexpected disconnection very frequently when using hedge strategy or spot_perp_strategy on 1.8.0
when i catch the error in the exception in ws_connection.py, I got:
RuntimeError: Concurrent call to receive() is not allowed
Steps To Reproduce
// A concise description of the steps to reproduce the buggy behavior:
Here are the steps to reproduce the issue (see attachments in the section below):
create a hedge strategy with dydx or bybit_perpetual (the one I tested)

Set up your configuration file with these parameters:  see screenshot for hedge strategy
Start the bot using this command:  start

Screenshots
// If applicable, add screenshots to help explain your problem.
see log and config screenshot
Release version
// Include your bot's version number (Can be found at the upper left corner of your CLI).
1.8
Attachments
// Please attach your config file and log file to help us debug. It would be difficult for us to help you without those!
WARNING: Do NOT publish any exchange API keys or your wallet's private key. Whoever has access to them may steal your assets!
Optional: your discord username:
![hb_log](https://user-images.githubuserconte

logs_dydx_hedge.log
nt.com/45716874/198382608-9c400e53-0028-4aba-8a27-1302dac4d28a.jpeg)

mainly in dydx, I tested on bybit and its working fine

Also happened to bybit spot, not affected the pureMM strategy

Issue was related to dydx connector,
dydx_perpetual was refactored with this PR https://github.com/hummingbot/hummingbot/pull/5849