define a ResourceMapper

Resource Mapper will be used to convert QuestionnaireResponse to FHIR resources.
Documentation: FHIR SDC Extraction. Current resource mapper is definition-based extraction.
The current resourcemapper is still at early stages and needs some work. This was done as PoC.
Open Items

[x] Moving away from extending HAPI fhir objects
[ ] Refactor ResourceMapper code
[ ] Testing parsing different types of widgets: string, date, radio button, checkboxes, integer
[x] Merge ResourceMapperHAPI with the current ResourceMapper
[ ] Have the pr on android-fhir merged

Am I currently looking at moving away from extending HAPI fhir models to using Kotlin extensions. The jvm seems not to recognize the Kotlin extension that I have created (Could be because resourcemapper is using dynamic Java classes).

With the below code, Kotlin is able to use the extension functions I define
val patient = Patient::class.createInstance()
However, I am yet to figure out how to get a method in patient object and invoke it.  Links:-
https://stackoverflow.com/questions/31060995/how-do-i-get-the-declared-functions-of-a-kotlin-class-kclass-in-m12
https://www.baeldung.com/kotlin/reflection

Kotlin extensions are not visible from java. We might have to stick to extends HAPI models.
https://stackoverflow.com/questions/33911457/how-can-one-add-static-methods-to-java-classes-in-kotlin
https://youtrack.jetbrains.com/issue/KT-11968
I have done 50% of bullet 3 and I'll be completing tomorrow

Item 3 is done.
After discussion with Jing, using Kotlin extension functions is also not the best way to go.
And so I am looking into converting String to code(http://hl7.org/fhir/datatypes.html#code) (question items whose type is code e.g. Patient gender) and invoke a set method on HAPI models without extending the HAPI models

Item 1 is finally done (or so I hope)

Resource mapper is currently using questionnaire item extension to identify the data type to be created. This might be breaking SDC standard (An analyst can't create a questionnaire without some technical knowledge of HAPI models).
Options:-

Research on how to identify data type given a questionnaire item definition
Look into other forms of data extraction especially StructureMap-based extraction

The third option(not the best though), is to create a mapping of resources that maps from questionnaire item definition to HAPI object (Fred's idea)


dbeaver/dbeaver#16795 fix cache synchronization(hopefully)

Closes #16795
It should fix the behavior, but please review it.
Acceptance:
Could you check if indexes are correctly synchronized and if nothing was broken?
Contains additional fixes:

Nodes deletion for composite cache should delete both nodes in schema and table

This breaks index deletion in the navigator. Previously index deleted directly from navigator disappeared right after deletion, now it persists until manual refresh

Looks like too serious change in the model of cachinbg and navigator. It may break almost anything.
I had an impression that can just fix cokmposite cache items add.

Please try another solution: https://github.com/dbeaver/dbeaver/pull/19440


Will this plugin be updated for Godot v4.x?

Was wondering if there are plans to update this plugin for Godot v4.x? I am moving to version 4 and the plugin is incompatible. Love this plugin as I am Mac and don't have to hassle with rcedit.

I think I answered my own question, it appears that version 1.0.1 works with Godot 4. I missed it on the plugin site. Sorry to bother you.

@keithrdavis PLEASE add a comment about using it on Mac here
If there is enough comments in this thread we have chance native support for icon is added to 4.1.
You're right, there is a 4.0 plugin version but as you can see it can create icon for you but not replace it with standard 4.0 template.
Support for GodotIcon plugin (replace part) was broken with Godot 4.0 beta 7.
Still you can create your own template with these steps:
Login to your GitHub account.
Add your public SSH key to GitHub so you can push your changes later.
Fork Godot sources with button on top right part of screen.
Clone sources to your computer, remember to replace YOUR_LOGIN with real one:
git clone git@github.com:YOUR_LOGIN/godot.git

By default you should be on master branch.
cd godot

If you want to have official Godot 4.0 template:
git checkout 92bee43ad
git switch -c template

And if you want to use up to date sources:
git checkout -b template

Prepare icon with GodotIcon script or plugin and save it as:
godot/platform/windows/godot.ico

You can check that it's only file changed:
git status

Add your change:
git add *

Commit it to branch:
git commit -m "Fixed size icon template"

Push your changes to remote repository:
git push --set-upstream origin template

Visit your repository (replace login with real one):
https://github.com/YOUR_LOGIN/godot/actions

It will take about an hour to build your template.
When it's ready open Windows builds workflow.
On the bottom there's Artifacts section which should contain windows-template file.
Download it and set in your project as export template.
It will have icon you already set.
All binaries exported with this template will work with GodotIcon plugin.

Thanks for leaving comment. Closing this as I assume you'll be able to build your own template now.


Apollo Federation 2 support

Hi all! We (Apollo) are getting ready to publish a new major version of https://github.com/apollographql/federation-jvm that includes Federation 2 support. We just finished testing the latest Federation JVM alpha (com.apollographql.federation:federation-graphql-java-support:2.0.0-alpha.5) with DGS and the great news is that everything appears to be working well:

After we've published Federation JVM 2.0, would you be interested in a PR to update DGS accordingly? Thanks!

@hwillson - that's awesome and thank you for testing it with the DGS! We do have a few users who have asked about this already, so this is great timing. If you are able to contribute a PR that would be super helpful. The question I have is whether this is fully backwards compatible with existing federation. Our internal services and gateway will still be on Federation 1.x and will not be ready to switch till later this year. If not, we'll need to make it a conditional so that users are able to opt-in.
@berngp - any thoughts?

@hwillson thanks for doing all these work. I agree with @srinivasankavitha's point.

The question I have is whether this is fully backwards compatible with existing federation.

Just looked at the docs and seems like 1) They don't require any changes to
stay on Federation 1.x and 2) We can explicitly opt in to Federation 2.0.
The only catch seems to be that some situations where the schema is not
fully federation compliant may fail because they were not correct to begin
with. We just need to watch out for those for internal usage.
On Thu, Apr 21, 2022 at 10:06 AM Bernardo Gomez Palacio <
@.***> wrote:

@hwillson https://github.com/hwillson thanks for doing all these work.
I agree with @srinivasankavitha https://github.com/srinivasankavitha's
point.
The question I have is whether this is fully backwards compatible with
existing federation.
—
Reply to this email directly, view it on GitHub
https://github.com/Netflix/dgs-framework/issues/997#issuecomment-1105477277,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AJ5JPXP4DCFTJD37VNX7IVTVGGDHXANCNFSM5T5JEVKA
.
You are receiving this because you were mentioned.Message ID:
@.***>

@srinivasankavitha @berngp correct, this is all fully backwards compatible. Fed 2 support is opt in - we'll get a PR together, thanks!
And regarding:

The only catch seems to be that some situations where the schema is not fully federation compliant may fail because they were not correct to begin with.

we've developed a tool to check federated schema's for Fed 2 compatibility to help find any issues before migrating: https://github.com/apollosolutions/federation-2-readiness

👋 all - @dariuszkuc is going to be helping with this shortly. Thanks!

Hi @dariuszkuc, thanks for helping out. We recently merged  PR #1056  with the upgrade to federation 2.0, is there anything else we should be doing?

Hello 👋
Yeah I just started looking into this and it seems like #1056 resolves this issue. I believe this can be closed.

Thanks @dariuszkuc !

Is there anything we need to do on our side from a validation perspective?

@srinivasankavitha I've opened a draft PR https://github.com/apollographql/apollo-federation-subgraph-compatibility/pull/96 that validates framework compatibility with Apollo Federation. I'll update the PR once new version of DGS is released.


Add the form parameter

Bing now requires the form parameter to be present and valid to get points from the search.
The form parameter value used is "QBRE" and is obtained when you initiate a search from the search box of another search.
This should fix: #132, #142, and #144.

Thank for for pushing the fix. Sorry for the delay in responding.


Documentation - app.config.ts

Describe the feature
There is some documentation about how to define the config, however no example of how to use it.
https://nuxt.com/docs/guide/directory-structure/app-config
Could you please provide some examples and use cases?
I'm struggling how to use it. How does this differ from the runtimeConfig.public ?
https://nuxt.com/docs/api/configuration/nuxt-config#runtimeconfig
I tried this with no success...
app.config.ts
export default defineAppConfig({
  foo: "bar",
});

app.vue
const nuxtApp = useNuxtApp();

console.log(nuxtApp.$config.foo); // undefined

Additional information

[X] Would you be willing to help implement this feature?
[ ] Could this feature be implemented as a module?

Final checks

[X] Read the contribution guide.
[X] Check existing discussions and issues.

You use it with useAppConfig(), which can be used in both the vue and nitro parts of your app.
I think there's an example here: https://nuxt.com/docs/guide/directory-structure/app-config#defining-app-config. But I'd be very open for any improvements/examples in the docs.


Tag resolve change

Fixes #N/A
Description
How was this change tested?
Does this change impact docs?

[ ] Yes, PR includes docs updates
[ ] Yes, issue opened: #
[x] No

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

Pull Request Test Coverage Report for Build<PHONE_NUMBER>0
Details

22 of 24 (91.67%)  changed or added relevant lines in 5 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage increased (+0.08%) to 82.548%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

pkg/controllers/controllers.go
0
1
0.0%

pkg/operator/operator.go
0
1
0.0%

Totals

Change from base Build<PHONE_NUMBER>4:
0.08%

Covered Lines:
5714

Relevant Lines:
6922

💛  - Coveralls


Unable to Create Python Virtual Environment

[X ] bug report -> please search issues before submitting
[ ] feature request
[ ] documentation issue or request
[ ] regression (a behavior that used to work and stopped in a new release)

### Minimal steps to reproduce
>

### Any log messages given by the failure
![image](https://github.com/Azure-Samples/azure-search-openai-demo/assets/144109804/41c430fe-236d-4bf0-ae18-106891bb363d)

Creating python virtual environment "scripts/.venv"
Start-Process: C:\IT\Openai\scripts\prepdocs.ps1:26
Line |
  26 |  Start-Process -FilePath ($pythonCmd).Source -ArgumentList "-m venv ./ …
     |                          ~~~~~~~~~~~~~~~~~~~
     | Cannot validate argument on parameter 'FilePath'. The argument is null or empty. Provide an argument that is not null or empty, and then try the command again.
Installing dependencies from "requirements.txt" into virtual environment
Start-Process: C:\IT\Openai\scripts\prepdocs.ps1:35
Line |
  35 |  Start-Process -FilePath $venvPythonPath -ArgumentList "-m pip install …
     |  ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
     | This command cannot be run due to the error: The system cannot find the file specified.
Running "prepdocs.py"
Start-Process: C:\IT\Openai\scripts\prepdocs.ps1:39
Line |
  39 |  Start-Process -FilePath $venvPythonPath -ArgumentList "./scripts/prep …
     |  ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
     | This command cannot be run due to the error: The system cannot find the file specified.

### Expected/desired behavior
Trying to deploy using AZD UP but it fails when trying to create the Python Virtual Environment

### OS and Version?
Win 10 Enterprise 22H2

### azd version?
azd version 1.3.0

### Versions
>

### Mention any other details that might be useful

> ---------------------------------------------------------------
> Thanks! We'll be in touch soon.

Here's what our readme says about Python requirements:
Important: Python and the pip package manager must be in the path in Windows for the setup scripts to work.
Important: Ensure you can run python --version from console. On Ubuntu, you might need to run sudo apt install python-is-python3 to link python to python3.
Are you able to run python --version normally?

Hello Pamela,
Thank you for taking the time to reply. It was indeed Python that was causing the issue. I had it installed but not in the right location so Powershell wouldn't recognize it. I switched to Visual Studio Code and installed the Python plugin and then the demo deployed alright.
Thank you again,
Dan


Created a backend file and add server and make all data store in mongodb as database

Pull Request Description
fixes #12
Overview
This pull request implements a comprehensive backend solution for user authentication and post management in our application. Users can now sign up and log in using both Google OAuth and manual registration. Each user can add posts, which are stored in a MongoDB database. All posts created by a user can be retrieved and displayed, ensuring a personalized experience.
Features
User Authentication:
Google OAuth: Users can sign up and log in using their Google accounts, streamlining the authentication process and reducing friction for users.
Manual Registration and Login: A standard registration and login system is implemented, allowing users to create accounts using their email and password.
Post Management:
Add Posts: Users can create and submit posts. Each post is associated with the authenticated user, ensuring that only the respective user can manage their posts.
View User Posts: A feature is included to fetch and display all posts created by the logged-in user, providing a personal dashboard of their contributions.
Database Integration:
The backend server is set up to interact with a MongoDB database, facilitating efficient storage and retrieval of user data and posts.
Data models are defined for users and posts, ensuring a structured approach to data handling.

@Manishkr1007  I have created backend and made all changes accordingly.
This pr cant be merged automatically and it is not allowing to resolve conflicts since new folder is added and alot changes are made.
Please dont ignore the PR for that reason .


Java issue when launching

When I launch goofy I get the following error but goofy still seems to be working.
Uncaught Exception:
Error: Code signature at URL file:///Users/wew/Library/Caches/cc.buechele.Goofy.ShipIt/update.ZztvJVp/Goofy.app/ did not pass validation: code failed to satisfy specified code requirement(s)

+1

@gwylym @dotdeas That's weird is it a popup or alert that you get? I don't suppose you have the screen shot?  Oh and does it happen every time you launch Goofy?
One solution, if you could delete the app and re-install, and see if it still occurs.
If that doesn't work, could you try uninstalling the app, then deleting the following folders:

/Users/{your)user_name}/Library/Application Support/goofy-core
/Users/{your_user_name}/Library/Caches/cc.buechele.Goofy.ShipIt

And then seeing if you get the same error?
Thanks!

Tried your second solution and can't seem to get the error anymore. Tried restarting the app multiple times but no error so far.
Here is a screenshot of the error I got before

I can verify the same issue.

Seems to have coincided with the introduction of the notice to use the FB official client.

Same issue here, same error message.


Unable to Change the data sources and Update Parameter using Power BI Actions

We are working on CICD Pipeline using Power BI Actions in Azure DevOps.

We created release pipeline using Power BI Actions, we got the output for Publishing, adding user, creating workspaces.
But
for our case, we have 2 environments, Dev and Test.
We are using SQL Server as Datasource.
we have 2 databases DEV_Database for DEV environment and Test_Database for Test environment.
As of now, we are using DEV_database for developing reports.
We are trying to publish the report from DEV to Test workspaces. We need to use Test_database in Test workspace. Therefore, we are trying to do this using parameters. But Power Bi actions showing "Bad request " and "Invalidstatus " like this.
Please consider this request and help me to find the solution.
Thanks.

Hi @nikmk05,
Can you provide more details on the settings that you use for the release pipeline?
Example if you use the Power BI Actions in a yml file:
- task: PowerBIActions@5
   displayName: 'Update parameters'
   inputs:
      PowerBIServiceEndpoint: ${{ variables.serviceConnection }}
      Action: 'UpdateParameters'
      WorkspaceName: ${{ variables.powerbiWorkspace }}
      DatasetName: ${{ variables.dataSetName }}
      ParameterInput: '[{"name":"Environment","newValue":"${{ parameters.env }}"}]'

In above example, the parameter env stores the reference to the environment (e.g. dev, acc, test etc.).
Kind regards,
Pim


Adds 'docker for desktop' support to local seed setup

What this PR does / why we need it:
Adds support for docker for desktop to the dev-setup-local script.
Which issue(s) this PR fixes:
None
Special notes for your reviewer:
The kubernetes apiserver is additionally exposed with a service of type NodePort to keep the local seed setup logic simpler and similar to the setup for minikube.
Release note:
None

Hello @ialidzhikov and thanks for the review.

I will add Docker for Desktop/Mac Edge support to the documentation
As for the sed command in the [local_setup.md] instructions - it works for me. Do you have gnu-sed installed and configured to be used instead of the MacOS sed?
I am using Docker for Mac Edge where the kubernetes version is 1.13. The kubernetes version in Docker for Mac is 1.10 (I think).


Topic/template refactor

Add and use a base template that can be reused.
Use style library from free CDN.
Adjust detail view to display "violation paths" as a list.

👍


BUILD-260: auto provision tekton via tekton operator if necessary

Changes
Fixes #8
/kind feature
Submitter Checklist

[/ ] Includes tests if functionality changed/was added
[/ ] Includes docs if changes are user-facing
[/ ] Set a kind label on this PR
[/ ] Release notes block has been filled in, or marked NONE

Release Notes
The Shipwright operator will now install Tekton as needed via the Tekton operatoar

/assign @adambkaplan
/assign @otaviof
I've marked this WIP guys, as I just made coding changes so far, so if you want to hold off on any review, I understand.  But if you have enough cycles to take a quick glance and see any glaring red flags, do feel free to comment here as you see fit.

OK just got clean PR runs.  I am retrying after pushing a brief README update.
I've removed WIP @otaviof @adambkaplan to indicate this should be "ready for review"
that said, I'll
/hold
for now as I still have not gone through the local dev flow to actually installing tekton operator (but not having it install tekton yet), then running this PRs changes
I'll unhold once that is done.
But in the meantime, I think it is OK to start gather comments from you guys, to start pulling in those changes as well.
thanks

OK the rerun of default_test.go (the ginkgo only test that launches an etc server) flaked this time (it passed last time before the readme update).
I seen weirdness locally as well.
I'd like to cover in office hours (I"m not sure how to debug these at first blush) when we next can all talk.
thanks

talked to @otaviof today

he seen some flakes in the past too, and the latest CI error looks like a timing/race condition with some of the delete related tests; if they persist enough to block merge I'll try to fix them with separate commits in this PR; otherwise, may just open an issue for them; or if I can sort out the fix quickly while working this PR, I will
my local env needs some work; I have an old operator-sdk that is possibly getting in the way; also, he did not have to download/install etcd, where his local test runs use the etcd that the test scripts download to testbin

yeah removing operator-sdk and etcd on my system, make test works fine for me locally :-)

ok pushed commit for last flake found .... e2e's green

ok @adambkaplan thanks for the confirmation on the "outside scope of this jira" items
I've pushed as separate commits a squashed commit of your log update, and then a separate commit of the changes for when to error out vs. requeue, and the unit/integration test changes to account for that
I'll reorg/squash once we are good on those changes
the only comment which did not result in a code change is the one around no deployment specific SA's existing for tekton/shipwright operators

@adambkaplan @otaviof - another item I did not add to the PR, since it was not explicitly called out in the BUILD-260, is the creation of the target namesapce for shipwright.
If you look at https://github.com/shipwright-io/operator/blob/a9c5e270d1452163f0a162f7e414bb1940ad03a0/controllers/shipwrightbuild_controller.go#L95-L103 there was that comment about not "accidentally" creating a new namespace.
And I confirmed that manifestival call there only changes the namespace ref in the other objects being created by manifestival.
Also, if you look at the top level usage example at https://github.com/shipwright-io/operator/blob/a9c5e270d1452163f0a162f7e414bb1940ad03a0/README.md#usage the namespace creation is there.
So with that background, my question:  do we want to take on creating the namespace in the operator ?
Pluses: it is arguably an ease of use improvement
Negatives: given the operator the ability to create namespaces  .... would security concerned folks care?
WDYT?

So with that background, my question: do we want to take on creating the namespace in the operator ?

@gabemontero, @adambkaplan In my opinion namespaces should exist before anything is installed, so maybe we could simply pass the namespace name as a configuration entry, instead of creating the namespace.

So with that background, my question: do we want to take on creating the namespace in the operator ?

@gabemontero, @adambkaplan In my opinion namespaces should exist before anything is installed, so maybe we could simply pass the namespace name as a configuration entry, instead of creating the namespace.

Either I'm missing something you are getting at, or we are not on the same page @otaviof ..... let me try to at least clarify what I am saying.
To do so, let me post the current yaml contents at https://github.com/shipwright-io/operator/blob/a9c5e270d1452163f0a162f7e414bb1940ad03a0/README.md#usage :+1:
---
apiVersion: v1
kind: Namespace
metadata:
  name: shipwright-build
spec: {}

---
apiVersion: operator.shipwright.io/v1alpha1
kind: ShipwrightBuild
metadata:
  name: shipwright-operator
spec:
  targetNamespace: shipwright-build
  namespace: default

So the namespace in question which we currently have the user create prior to poking the operator is shipwright-build
Then, in shipwrightbuild.operator.shipwright.io.spec.targetNamespace, we again specify shipwright-build
So we you say "pass the namespace name as a configuration entry", do you mean we should capture it?  If so, we are already doing that, right?  Or did you mean something else.
Lastly, what I'm saying is making sure that namespace exists and creating it if need be before calling manifestival.
Given my clarification, are you saying we should just not do that ?

ok target namespace creation added (e2e's work for me locally, simply removing the creation of the target namespace in the e2e's tests the path)
commits squashed
PTAL @adambkaplan

curious that unit test failure is @otaviof o.Expect(err).To(o.BeNil(), o.MatchError(metav1.StatusReasonNotFound)) which has passed multiple times since I added it
a flake?
we need to update the perms in this repo so PR author's can retest ... I cannot currently @adambkaplan
can you do it ?

curious that unit test failure is @otaviof o.Expect(err).To(o.BeNil(), o.MatchError(metav1.StatusReasonNotFound)) which has passed multiple times since I added it
a flake?
we need to update the perms in this repo so PR author's can retest ... I cannot currently @adambkaplan
can you do it ?

Might be a flake, indeed. And second the need to be able to trigger CI again.
/lgtm

Interesting test panic here:
   Test Panicked
    interface conversion: interface {} is *matchers.MatchErrorMatcher, not string
    /opt/hostedtoolcache/go/1.15.15/x64/src/runtime/iface.go:261

    Full Stack Trace
    github.com/onsi/gomega/internal/assertion.(*Assertion).buildDescription(0xc000601180, 0xc0008a5c10, 0x1, 0x1, 0x2f1, 0x0)
    	/home/runner/work/operator/operator/vendor/github.com/onsi/gomega/internal/assertion/assertion.go:60 +0x187
    github.com/onsi/gomega/internal/assertion.(*Assertion).match(0xc000601180, 0x1ba2b80, 0x27114e0, 0x1, 0xc0008a5c10, 0x1, 0x1, 0xc0008a5c10)
    	/home/runner/work/operator/operator/vendor/github.com/onsi/gomega/internal/assertion/assertion.go:78 +0x14f
    github.com/onsi/gomega/internal/assertion.(*Assertion).To(0xc000601180, 0x1ba2b80, 0x27114e0, 0xc0008a5c10, 0x1, 0x1, 0x1)
    	/home/runner/work/operator/operator/vendor/github.com/onsi/gomega/internal/assertion/assertion.go:38 +0xc7
    github.com/shipwright-io/operator/controllers.glob..func1.2()
    	/home/runner/work/operator/operator/controllers/default_test.go:157 +0x407
    github.com/shipwright-io/operator/controllers.TestAPIs(0xc00047c900)
    	/home/runner/work/operator/operator/controllers/suite_test.go:46 +0xed
    testing.tRunner(0xc00047c900, 0x1a56a00)
    	/opt/hostedtoolcache/go/1.15.15/x64/src/testing/testing.go:1123 +0xef
    created by testing.(*T).Run
    	/opt/hostedtoolcache/go/1.15.15/x64/src/testing/testing.go:1168 +0x2b3

Interesting test panic here:
   Test Panicked
    interface conversion: interface {} is *matchers.MatchErrorMatcher, not string
    /opt/hostedtoolcache/go/1.15.15/x64/src/runtime/iface.go:261

    Full Stack Trace
    github.com/onsi/gomega/internal/assertion.(*Assertion).buildDescription(0xc000601180, 0xc0008a5c10, 0x1, 0x1, 0x2f1, 0x0)
    	/home/runner/work/operator/operator/vendor/github.com/onsi/gomega/internal/assertion/assertion.go:60 +0x187
    github.com/onsi/gomega/internal/assertion.(*Assertion).match(0xc000601180, 0x1ba2b80, 0x27114e0, 0x1, 0xc0008a5c10, 0x1, 0x1, 0xc0008a5c10)
    	/home/runner/work/operator/operator/vendor/github.com/onsi/gomega/internal/assertion/assertion.go:78 +0x14f
    github.com/onsi/gomega/internal/assertion.(*Assertion).To(0xc000601180, 0x1ba2b80, 0x27114e0, 0xc0008a5c10, 0x1, 0x1, 0x1)
    	/home/runner/work/operator/operator/vendor/github.com/onsi/gomega/internal/assertion/assertion.go:38 +0xc7
    github.com/shipwright-io/operator/controllers.glob..func1.2()
    	/home/runner/work/operator/operator/controllers/default_test.go:157 +0x407
    github.com/shipwright-io/operator/controllers.TestAPIs(0xc00047c900)
    	/home/runner/work/operator/operator/controllers/suite_test.go:46 +0xed
    testing.tRunner(0xc00047c900, 0x1a56a00)
    	/opt/hostedtoolcache/go/1.15.15/x64/src/testing/testing.go:1123 +0xef
    created by testing.(*T).Run
    	/opt/hostedtoolcache/go/1.15.15/x64/src/testing/testing.go:1168 +0x2b3

yeah that is what I noted in https://github.com/shipwright-io/operator/pull/18#issuecomment-912711036 @adambkaplan
we'll see what happens when I push the semver change in a few minutes and trigger new tests

semver fix pushed @adambkaplan PTAL thanks

Interesting test panic here:
   Test Panicked
    interface conversion: interface {} is *matchers.MatchErrorMatcher, not string
    /opt/hostedtoolcache/go/1.15.15/x64/src/runtime/iface.go:261

    Full Stack Trace
    github.com/onsi/gomega/internal/assertion.(*Assertion).buildDescription(0xc000601180, 0xc0008a5c10, 0x1, 0x1, 0x2f1, 0x0)
    	/home/runner/work/operator/operator/vendor/github.com/onsi/gomega/internal/assertion/assertion.go:60 +0x187
    github.com/onsi/gomega/internal/assertion.(*Assertion).match(0xc000601180, 0x1ba2b80, 0x27114e0, 0x1, 0xc0008a5c10, 0x1, 0x1, 0xc0008a5c10)
    	/home/runner/work/operator/operator/vendor/github.com/onsi/gomega/internal/assertion/assertion.go:78 +0x14f
    github.com/onsi/gomega/internal/assertion.(*Assertion).To(0xc000601180, 0x1ba2b80, 0x27114e0, 0xc0008a5c10, 0x1, 0x1, 0x1)
    	/home/runner/work/operator/operator/vendor/github.com/onsi/gomega/internal/assertion/assertion.go:38 +0xc7
    github.com/shipwright-io/operator/controllers.glob..func1.2()
    	/home/runner/work/operator/operator/controllers/default_test.go:157 +0x407
    github.com/shipwright-io/operator/controllers.TestAPIs(0xc00047c900)
    	/home/runner/work/operator/operator/controllers/suite_test.go:46 +0xed
    testing.tRunner(0xc00047c900, 0x1a56a00)
    	/opt/hostedtoolcache/go/1.15.15/x64/src/testing/testing.go:1123 +0xef
    created by testing.(*T).Run
    	/opt/hostedtoolcache/go/1.15.15/x64/src/testing/testing.go:1168 +0x2b3

yeah that is what I noted in #18 (comment) @adambkaplan
we'll see what happens when I push the semver change in a few minutes and trigger new tests

yeah it ran clean this time @adambkaplan @otaviof
see https://github.com/shipwright-io/operator/pull/18/checks?check_run_id=3509444530


Bring back HockeyApp

There are so many things that are not working in AppCenter that are hindering my work. I list them again if needed.

@schriftgestalt listing them would definitely be helpful for us. Thank you.

AppCenter doesn’t provide a UI to collect user comments and no UI in the backend to properly display it when I build my own. I can’t see that report have comments.  I have to click each report several times to see my custom attachment. (#1418, #850)

I can’t filter by build numbers (had a long "conversation" with the chatbot that was not helpful). I was told I need to add the Analytics framework to my app but I still didn’t got it to work. And I don’t know why I need to spy on my uses so that the backend can read and collect the build numbers from the crash report. They are there already????

I have to constantly re-upload symbols if new crashes come in. I HockeyApp I could upload symbols before any crashes come in. And I could just drag the .zip onto the page. And I don’t get a progress bar (60 MB take a minute at my place).

The overall UI looks more pretty on first sight but I was much faster at finding the problems before. I have to click at least twice as much as before.


Failing to clone Definitely Typed wedges the publisher

Sometimes it appears that Definitely Typed fails to clone, but the clone never times out, and the publisher is stuck waiting forever.
Instead, the clone should wait no more than one or two thousand seconds before timing out and killing the process (or waiting until next time).

Later: It is not a clone, just a download using https.get.

From discussion with @orta, we believe that we should try going back to a shallow git clone and ditch the entire in-memory fs code in production. It's possible that Azure machines don't have the problem with slow disks that they did 3 years ago.


[Compiler] Sam graph generation doesn't work when all inputs are scalar OR when output is scalar

Examples include
x = a * b
x = a(i)*b(i)
x(i) = a * b
working
x(i) = a * b(i)

Working for
x = a * b
x = a(i)*b(i)
not working for x(i) = a*b since this requires universe broadcasting which is tracked by #24


[Bug]: [ERROR] Failed to instantiate script Main... Illegal call to 'Script.Wait()' outside main loop!

What modules are you seeing the problem on?
ScriptHookVDotNet.asi (runtime)
SHVDN Version
ScriptHookVDotNet-v3.6.0-nightly.119
Game Version
v1.0.3274.0
Bug Description
Hello, I have a problem with the game. Every time I enter, it loads and displays as if it is entering online and the game is interrupted. I found this problem and I do not know where to find the code and modify it.

Steps To Reproduce
[Bug]: [ERROR] Failed to instantiate script Main... Illegal call to 'Script.Wait()' outside main loop!
Link To Code Example
No response
The Current Behavior
I can't find the script Main... Illegal call to 'Script.Wait()'
The Expected Behavior
[Bug]: [ERROR] Failed to instantiate script Main... Illegal call to 'Script.Wait()' outside main loop!

Judging from the bug report, it doesn't look like you're not a script developer. Remove scripts one by one and contact the author(s) of faulty scripts if you're not a dev or you're not sure your script is causing the issue.

Don't use Model.Request or whatever can indirectly call Script.Wait in constructors of classes that inherit GTA.Script, because they are instantiated in a thread where Script.Wait is not allowed to call. If you have no idea what I'm talking about, find faulty scripts and contact the author(s).
It would be better if you could have clarified whether you code scripts.

It would've been appreciated if you hadn't posted an irrational topic but had posted a bug report with how to reproduce.


Fix list blob items request for empty list of 'include' items

Relates to #6945.
This PR aims to fix an issue in the creation of requests for listing blob items from Azure Storage if no
datasets-include options are provided.
The BlobContainerAsyncClient creates requests to retrieve the list of blob items by applying a provided list of dataset-include options as comma-separated query-parameter to the request. The created request corresponds to List Blobs (REST API).
Prior to this change the behavior BlobContainerAsyncClient was to add a not-filled 'include' query-parameter to requests without any provided include option:
GET /devstoreaccount1/mycontainer?include=&restype=container&comp=list

This behavior is unexpected and does not correspond to the REST API. (Besides of that, Azurite rejects such requests making local development against a "dockerized" solution cumbersome).
The introduced change will modify the behavior of the BlobContainerAsyncClient in such a way that empty lists of dataset-include options will be interpreted as null causing that no 'include' query-parameter will be attached to the created request.

@janjaali Thank you for contributing this fix! Can you please add an entry to the changelog that notes this bugfix?

Resolves #6945

It looks like there are a couple tests that still need their recordings updated, specifically the listing tests in the CPK-N test suite. Would you mind updating those to see if that'll help pass CI?

I added an entry to the change and also updated the records. The tests are succeeding now, but unfortunately the pom version verifier seems to complain about a not released azure core version and the "Test Windows From Source - Java 8" job is running now for 40 min :/


enforce JDK 17+ for building SGv2 APIs

Use maven enforcer plugin to ensure APIs are compiled against JDK 17 or later.
Checklist

[x] Changes manually tested
[ ] Automated Tests added/updated
[ ] Documentation added/updated
[x] CLA Signed: DataStax CLA

OK I am merging this..


Context refactor

Previous context system resulted in errors due to shared memory between requests; this has now been resolved by refactoring context to its own package, making it request-bound instead of route-bound, and updating the route param system to a "pool" of key-value pairs rather than a hash map. This results in a fairly significant dip in memory performance overall (about 3x previous usage), and a decrease in performance on small routers (see router_bench_test.go), but an increase in performance on a large router. The GitHub API benchmark is currently running about 100k ns/op faster, with all tests passing. I get the feeling memory performance can be further improved, but that's a problem to be solved in a non-urgent bug fix.
Additionally, I've introduced a test that previously demonstrated the issue in router_test.go. Requests would come in and params would be set to values that included the expected value from another, or a combination of others, which is bad. This no longer occurs! Setting the number too high may still cause errors due to OS limits on open connections, but this is expected behavior. A loop of 100 reliably passes through my machine's limit of 256. Will re-evaluate based on CI results.
Draft while test coverage is improved. Merging into main as this is a bug fix and not a feature update. Resolves #30.

Up to date with recent changes. Happy with the functionality as it is now, will work on tests in the next couple of days and get the fix in.


Estimated staking rewards grow but are never earned

Original report
pearl_logs_2024-08-04T19_57_20.275Z-0.1.0-rc97 (1).zip

From the logs seems the agent is not starting, failing to communicate with Tendermint.

pearl_logs_2024-08-13T13_03_15.356Z-0.1.0-rc105.zip
Seems like this is another related case.
Report


Enforce linting in test suite

Fixes https://github.com/mxstbr/react-boilerplate/issues/23. Looks like tab characters.

There's little reason not to lint code as early as possible, and rely on your build system to enforce style. By adding it to run after your test suite, hopefully this will catch bad code before it's merged into master.
Also, you can just extend: "airbnb" in eslintrc :smiley:

This looks great, thanks so much for finding a better fix than waiting for eslint 2.0!
I'll merge this if you add a seperate npm command called npm run lint that runs eslint ., and add that to the npm run test command. That would make it so people can lint without having to run the tests!

Closed in favor of #43, which does the same thing and has the changes above.
Thanks very much anyway for finding the solution for the issue and even submitting a PR, incredibly much appreciated!!

No problem!


User / Moderator / Administrator Roles

I assume we don't need any fancy role-based stuff like rolify yet, just basic mod, admin, user ranks?

Hooray for Rolify!


Fix path.yaml

Description
changed the return value of get-image endpoint from v1.ImageDetail to v1.Image to match the API behavior
What is it?

[x] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Documentation update
[ ] Tests update
[ ] Refactor

Codecov Report

Merging #551 (1b45c79) into main (985d2ed) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main     #551   +/-   ##
=======================================
  Coverage   31.24%   31.24%
=======================================
  Files          33       33
  Lines        3306     3306
=======================================
  Hits         1033     1033
  Misses       2166     2166
  Partials      107      107

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 985d2ed...1b45c79. Read the comment docs.


Change terminated statuses for administrator

Coverage remained the same at 100.0% when pulling 26df1e82c2d206fa659a79e2677e31e89f22e323 on andrii-shchudlo:a403464238804803_Test_administrator_change_terminated_statuses into 8f2b0bcb26ca858b959cb7273308a85e22618d45 on openprocurement:master.

Coverage remained the same at 100.0% when pulling ad51c87adf4fe8050ed4570baffc9b9bbc62ec7a on andrii-shchudlo:a403464238804803_Test_administrator_change_terminated_statuses into 8f2b0bcb26ca858b959cb7273308a85e22618d45 on openprocurement:master.


Vi keybindings

Question: (Just curious) is there anything that would preclude a plugin from providing a vi/vim keybindings?  I know this may not be popular with a lot of folks, but my finger memory after 30 years of using vi is hard to erase.   I really like how lightweight this is so far and I don’t want ask the question with the intent of making this a vi clone.

This would be a nice feature; I think using libvim might be the easiest way to do it.

Yeah I vote as well for vi/vim keybindings support

There's no technical reason one couldn't implement this using the plugin system if it is something someone wanted to do, although I imagine it would be quite a sizeable undertaking.

This would be a nice feature; I think using libvim might be the easiest way to do it.

I was not aware of this library, but agree.  While I can’t commit to it yet, but I will look into it.

Another option might be to use the lua client for neovim: https://github.com/neovim/lua-client
I'm not (at all) familiar with how clients for neovim work, so this suggestion might not make sense, but I wanted to throw it out there in case it might be useful.

I just found: https://github.com/a327ex/lite-modalediting
(nothing to do with me)

I just found: https://github.com/a327ex/lite-modalediting
(nothing to do with me)

This definitely looks like a solid base to work from!

Heh, already disappeared but moved to https://github.com/a327ex/lite-plugins


Pagination: Need better RtoL support for the pagination component

Summary
If you enable the RtoL support in the storybook story for Pagination you can see that there's lots of overlap and incorrect buttons when you flip to support internationalized languages that go right to left. Screenshot attached below
Justification
Need to support Arabic, Hebrew and other RtoL languages
Desired UX and success metrics
No overlap, button layout that makes sense in the reversed mode

@IBM/carbon-designers do we have RTL spec for this component (and others)?

Ref: https://github.com/carbon-design-system/carbon-components/blob/v10.2.0/docs/g11n.md - Not sure if RTL conversion of the CSS has been done when above screenshot is made.

Not sure about priority set on this one. Technically those components are broken for right to left users, but are we saying that the onus is on the devs implementing these components to handle right to left support in their apps @asudoh?
I can swap this to a higher priority if this is actually a bug

@dakahn Support for RTL requires an additional build step mentioned in https://github.com/carbon-design-system/carbon-components/blob/v10.2.0/docs/g11n.md. Not sure if the person who introduced RTL knob to our Storybook env was aware of such additional build step. Otherwise, we should remove the RTL knob for now because it causes a confusion (of broken RTL support).


Create docs on resource validation

There are a few ways resources can validate their attributes - probably worth documenting to make it easier for developers to find.  I don't believe this exists already.

Can this documentation include an anatomy, descriptsion, and examples of tests as well. I found it difficult to get started creating a tests/test_emr.py and ended up bouncing through a few different files and pulling pieces from each to build a foundation.


Add support for Public Clients and add PKCE

Addition of Proof Key for Exchange (PKCE) support for public clients.
These changes allow for the omission of the --os-client-secret parameter for public clients who do not have a full set of client credentials. This allows for the common use case of people accessing openstack from command line clients that act as "public clients" which should not have client secrets as per the OAuth Spec.
PKCE is thus added to counter auth code highjacking and replay attacks as recommended in the OAuth Best Practice Guide.

Thanks @alvarolopez for taking a look at it. I've made the requested changes.

Hi @alvarolopez - could this PR be merged into master?

@dannymeloy sure, sorry I overlooked this.

Many thanks for contributing it!


float number is not supported

float number is not supported
100.123

Added in https://github.com/divan/num2words/commit/7777fc09374b1bbedad8dbed627997849e69fd3e


Register

@JuliaRegistrator register branch=main

Registration pull request created: JuliaRegistries/General/49955
After the above pull request is merged, it is recommended that a tag is created on this repository for the registered package version.
This will be done automatically if the Julia TagBot GitHub Action is installed, or can be done manually through the github interface, or via:
git tag -a v1.3.0 -m "<description of version>" 2d7a3904835dab335f2facd52c06993db76e6e30
git push origin v1.3.0


Dev/rgroup decomp freefunction

Adds free function API and python interface.
This also fixes a subtle but serious bug in the RGroupDecomp.  The RGroupMatch data should have been stored as a shared pointer as early copies were not maintained properly between iterations.  The multicore results from the cpp tests were returning hydrogens that should have been stripped out.  This fixes that issue and assigns the rgroups indices properly (previously, the first four had incorrect assignments).
If this is acceptable, the docstrings are the last item necessary.

There are still two outstanding suggestions from my review.
Would you rather keep the argument ordering as is or did those just overlooked?

No, I missed those two, probably hyper focused when I found the bugs.


ecodepth module not found

When running test.py or infer.py or any py I get this error:
Traceback (most recent call last):
File "D:\AITools\EcoDepth\depth\test.py", line 9, in
from models.model import EcoDepth
File "D:\AITools\EcoDepth\depth\models\model.py", line 11, in
from ecodepth.models import UNetWrapper, EmbeddingAdapter
ModuleNotFoundError: No module named 'ecodepth'
Any way to fix this?
Windows 10, rtx 3090, python 3.10.11

It seems your PYTHONPATH is not configured properly. By any chance, have you removed the
PYTHONPATH="$(dirname $0)/..":"$(dirname $0)/../stable-diffusion":$PYTHONPATH
line from the shell files?
We tried locally with this change and got the same result as yours.
Additionally please ensure you are running from the EcoDepth/depth directory though I think that is not the problem here.

No, i haven't touched any shell file, just ran them as they came trough.  Should I modify the PYTHONPATH line in the shell file? or what you mean when you say my pythonpath is not configured properly.
I have my env variables path set :
PATH : C:\Users\PC\AppData\Local\Programs\Python\Python310\Scripts
PATH: C:\Users\PC\AppData\Local\Programs\Python\Python310
PYTHONPATH: C:\Users\PC\AppData\Local\Programs\Python\Python310\

Are you running the test.py file from bash scripts given by us?  Please follow these steps.
ecodepth and stable-diffusion/* directories which are present in the repo-root should be visible to python, so we have modified the  PYTHONPATH in the all bash files.
Alternative method is to first export the PYTHONPATH by using the below command in your terminal(run this after navigating inside depth directory where test.py is present):
export PYTHONPATH="..:../stable-diffusion":$PYTHONPATH
If you are using windows, you can't run bash files directly. So better install WSL and then you will have a bash terminal there.

Thanks guys! I finally managed to get it working. I just had to set PYTHONPATH root folder of this repo. Just tested with a single image and worked, now testing with video but it really takes a while even with a rtx 3090 24gb. I think you guys should put memory requirements for the estimation process.
For anyone facing the "No module named 'ecodepth" error, you can run this command on your terminal before running infer.py " set PYTHONPATH=C:/Users/xxx/Ecodepth " and it should work now.

Glad to know. Feel free to open another issue if you face a problem.


ReferenceError: window is not defined

Trying to use amplitude-js on node 8.8.1
I got this error when I run: const amplitude = require('amplitude-js');
ReferenceError: window is not defined
    at /root/app/node_modules/amplitude-js/amplitude.js:2427:8
    at commonjsGlobal (/root/app/node_modules/amplitude-js/amplitude.js:2:82)
    at Object.<anonymous> (/root/app/node_modules/amplitude-js/amplitude.js:5:2)
    at Module._compile (module.js:612:30)
    at Object.Module._extensions..js (module.js:623:10)
    at Module.load (module.js:531:32)
    at tryModuleLoad (module.js:494:12)
    at Function.Module._load (module.js:486:3)
    at Module.require (module.js:556:17)
    at require (internal/module.js:11:18)
    at Object.<anonymous> (/root/app/src/helpers/amplitude.js:3:19)
    at Module._compile (module.js:612:30)
    at Object.Module._extensions..js (module.js:623:10)
    at Module.load (module.js:531:32)
    at tryModuleLoad (module.js:494:12)
    at Function.Module._load (module.js:486:3)
    at Module.require (module.js:556:17)
    at require (internal/module.js:11:18)
...

Are you running server-side-rendering, i.e. are you running this in node?

I have server side rendering and I simply require only when not in node. In node I mock it.
isServer is my custom global variable
import config from "config";

const Amplitude = !global.isServer ? require("amplitude-js") : null;

const instance = Amplitude ? Amplitude.getInstance() : {
  init: () => {},
  logEvent: () => {},
  setUserId: () => {},
  setUserProperties: () => {}
};

instance.init(config.amplitude.apiKey);

export default instance;

is there any plan to fix that ?

I'd like to use this package server-side, and others are no doubt doing server-side rendering. Having a dependency on window and on document prevents this.
Can we subvert the local storage setup if window or document is undefined?

I am also facing the Same issue I am using Nodejs with express over ReactJs. And I am trying to use the recent react-amplitude package launched last month
-https://www.npmjs.com/package/react-amplitude
Is there any fix for this issue, in general, the server-side rendering is causing a lot of issues because window or document is undefined

@barathkb - in my project i'm using react and redux. i created a redux middleware for dealing with amplitude.
in order to not get this error, i only added this middleware on the client side and it worked.
could u only use (import) amplitude on the client side ?
if u need help, it would be cool to see how/where do u use it

@burrack Thanks for your suggestion but the things is that I want it both in my client side and the server side since I am using NextJs and Express every initial page load using URL will be pre-rendered on the server side.

I'm having this problem still with my node express server. Some events cannot be logged on the client. Any chance this will be fixed?

Would be awesome to fix!

Has anyone found a fix to this?

?

Currently we just don’t support running in a Node environment for the JS SDK. Will consider to add the support.
Thanks for providing feedbacks.

This is sever side SDK request basically.
Please refer to #164. Closing this now.

I have a case that I don't need amplitude to work, but I need to require it, can you make a way that it just doesn't do anything on the node case, instead of blowing up?

I need to bundle amplitude-js with an npm package and finding it impossible to setup the package in a safe way so that it doesn't throw errors when consumed by an app using SSR.

One way would be dynamic import.  Wait to load the package until code is running in a client env (window is defined)
let amplitude;
if (window !== undefined) {
   import('amplitude-js').then(ampPackage => {
     amplitude = ampPackage;
   });
}

The comment above has a similar solution that might be helpful as-well that only imports on the client and mocks critical API's on the server.
Without knowing more about your specific constraints it's hard to provide an exact recommendation.  This package is supported for client side environments only.

On this answer, you can use process.browser instead of !global.isServer

I have server side rendering and I simply require only when not in node. In node I mock it.
isServer is my custom global variable
import config from "config";

const Amplitude = !global.isServer ? require("amplitude-js") : null;

const instance = Amplitude ? Amplitude.getInstance() : {
  init: () => {},
  logEvent: () => {},
  setUserId: () => {},
  setUserProperties: () => {}
};

instance.init(config.amplitude.apiKey);

export default instance;

new amplitude ts support with nextjs https://github.com/amplitude/Amplitude-TypeScript/blob/main/examples/browser/next-app/pages/index.tsx


port: [#4062] Log BadRequest in adapter (#6135)

Fixes #4062
Description
This PR ports the changes in BotBuilder-DotNet's PR#6135 adding a warn logger in CloudAdapter's process method when the activity hasn't a type.
Specific Changes

Updated CloudAdapter class adding a console.warn when a BadRequest error is thrown for a missing activity type.

Testing
This image shows the tests passing after the change.

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

0 of 1 (0.0%)  changed or added relevant line in 1 file are covered.
2 unchanged lines in 2 files lost coverage.
Overall coverage decreased (-0.2%) to 84.547%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

libraries/botbuilder/src/cloudAdapter.ts
0
1
0.0%

Files with Coverage Reduction
New Missed Lines
%

libraries/botbuilder-lg/src/templateExtensions.ts
1
84.48%

libraries/botbuilder/src/cloudAdapter.ts
1
32.54%

Totals

Change from base Build<PHONE_NUMBER>:
-0.2%

Covered Lines:
19669

Relevant Lines:
22038

💛  - Coveralls


Add sys check for number of shards to warn about cluster.max_shards_per_node limit

Use case:
As a CrateDB user I want to be warned before I reach the cluster.max_shards_per_node limit so that I can take preventive actions.
Feature description:
Once the cluster.max_shards_per_node limit is reached no new partitions can be created and a SQLParseException is thrown. Especially for tables partitioned on timestamps new partitions are usually created in the middle of the night.
To increase visibility and enable easier monitoring of this potential production problem I suggest we add a cluster health check which turns the status to warning once a certain threshold is reached.
Probably something similar to NumberOfPartitionsSysCheck would be useful.

Not sure if checks are the right thing for monitoring or alerting. At least not alone.
But I guess this related a bit to https://github.com/crate/crate/issues/10371 - which is about exposing the number of shards per JMX

I agree, exposing the raw number of shards per JMX would be the better solution for monitoring&alerting.
Regarding discoverability of potential issues adding a cluster health check warning/error is potentially still helpful as CrateDB users maybe aren't aware of all things which should be monitored.

The raw number of stats are already exposed by jmx https://github.com/crate/crate/commit/e10337a630c19d6a6d235f4d4a15b15948083679 Do we need another syscheck here ?

What would be a good behavior for the check ? It should be probably have some sort of threshold. When a certain percentage of the maximum number of shards is reached the check should move to invalid. Should it be configurable or set to a fixed value e.g. 80 % ?

@mkleen IMO I think 85% - 90% for yellow status would be appropriate. I'm unsure if we need a red status for this check. Probably useful if it's configurable as well.
On a related note:  I believe we could remove NumberOfPartitionsSysCheck when we close this issue.
The NumberOfPartitionsSysCheck indirectly warns about too much shards as well but uses number of partitions to determine number of shards. Currently triggers when numbers of partitions hits 1000.

The total number of partitions of one or more partitioned tables should
not be greater than 1000. A large amount of shards can significantly reduce performance.

This will never trigger on smaller clusters because default setting of cluster.max_shards_per_node will prevent creating more than 1000 partitions. On bigger clusters having 1000+ partitions would be fine when shards per node stays below 1000.

@jayeff great, thanks a lot for this input.


Readme installation instruction only applicable on Linux

Following the instructions here https://github.com/pantheon-systems/sites-yml-validator#latest-version is not working for mac

@carl-alberto Is that because wget doesn't exist by default on Macs?

@jazzsequence
couple of things based on the original command:
wget https://github.com/pantheon-systems/sites-yml-validator/releases/latest/download/sites-yml-validator_linux_amd64 -O /usr/bin/sites-yml-validator &&\
    chmod +x /usr/bin/sites-yml-validator
```

1. `wget https://github.com/pantheon-systems/sites-yml-validator/releases/latest/download/sites-yml-validator_linux_amd64`

Do not download the latest binary file release so this should fix it on Mac Silicon chip

`wget https://github.com/pantheon-systems/sites-yml-validator/releases/latest/download/sites-yml-validator_Darwin_arm64.tar.gz`

2. Then extract after downloading `tar -xf sites-yml-validator_Darwin_arm64.tar.gz`

3. `/usr/bin/` is not user writable so it should be transferred in here instead `/usr/local/bin/`


Added description input in lambda function description

Hi, I added the description input to add an custom description in lambda function.

@andre991 Thanks for the contribution!


[Enhancement]: Disable build, buildconfig controllers

What would you like to be added:
As they are now, builds consistently fail for several reasons related to how MicroShift has embedded and configured the API's respective controllers and due to some missing openshift operators.
For the time being, it would be best to disable the APIs until their value-add can be assessed within the scope of the project and the controllers' dependencies can be properly enabled.
Why is this needed:
The build and buildConfig APIs are still advertised in the MicroShift API, which can and has lead users to assume they are supported.  As an accompanying #

related: #526

To be considered as part of a larger design discussion.


Other datasets suggested

I guess a few more challenging datasets will be popular in the next coming years. Such as meta-dataset, Imagenet-21k. Can you plz add them?

Once again apologies for the late reply. You are absolutely right, having these datasets would be great, and they are really missing at the moment (especially Meta-Dataset).
I have looked at how Meta-Dataset could be integrated, and that one is particularly difficult since the original dataset was released as TFRecords. We have been discussing with the team behind Meta-Dataset what would be the best strategy to include it in Torchmeta, and the conclusion was that it would most likely require some rewriting of the original version here. But still, it would probably be tricky, especially with the download option in Torchmeta/Torchvision (these datasets are very large, processing could be long, and there are some licensing issues).

Speaking of Meta-Dataset in particular, I have heard that the team at University of Freiburg might have a PyTorch version of Meta-Dataset, which could be a good starting point.

OK, let include Meta_Dataset first.

how is this going, is there anything people need help with to get this done? 💪


Use offscreen canvas if the global scope is worker

https://developers.google.com/web/updates/2018/08/offscreen-canvas
https://developer.mozilla.org/en-US/docs/Web/API/OffscreenCanvas
If Ebiten can work on a worker, multiple Ebiten instances can work in theory.

https://caniuse.com/offscreencanvas
Only Chrome (and Edge) support this.

OffscreenCanvas landed in Firefox 105, still only at 73% usage though. Although it's not the worst to expect users to use a fairly new browser for a feature like this.

https://caniuse.com/offscreencanvas Now most modern browsers support this

In workers, inputting would not work, but probably this is fine...


Closes #1139: Clustered cache manager configuration documentation

An image file is used in this PR. I'll try to replace that with an asciiart if possible.

Reverted the ascii art to image file as the rendering of the ascii art was not looking good. Additional gradle plugins may have to be configured to get that rendering right. Will switch back to ascii art once the build part gets resolved.

Addressed the review feedback on the usage of bold characters instead of back ticks.

Refactored the whole document to extract out the clustering concepts from configuration samples. I'd strongly recommend re-reading the whole thing as I've modified, added and deleted content from the previous iterations.

Made another batch of comments but really like where this is going.

Updated the PR by addressing the review comments: majorly to avoid using the term "clients" to refer to clustered cache managers and caches. The last two commits or even future commits will all be squashed to one once the content is deemed good to go.


Cannot "down-replicate" volume

Describe the bug
Trying to do volume.configure.replication on a volumeId 414 from replication 020 to 010 doesnt work. volume.fix.replication says error: no under replicated volumes and still holds 3 copies of the volumes afterwards.
weed shell:
> volume.configure.replication -volumeId 414 -replication 010
> volume.fix.replication
error: no under replicated volumes

Afterwards:
$ echo "volume.list" | weed shell | grep 'id:414 '
        volume id:414 size:27637905256 collection:"photo-large-prod-001" file_count:95298 delete_count:8 deleted_byte_count:2119223 replica_placement:10 version:2 compact_revision:2 modified_at_second:1591001133
        volume id:414 size:27637905256 collection:"photo-large-prod-001" file_count:95298 delete_count:8 deleted_byte_count:2119223 replica_placement:10 version:2 compact_revision:2 modified_at_second:1591001128
        volume id:414 size:27640210816 collection:"photo-large-prod-001" file_count:95308 delete_count:12 deleted_byte_count:3194336 replica_placement:10 version:2 compact_revision:2 modified_at_second:1591001128

System Setup
/usr/local/bin/weed -logtostderr -v=1 volume -compactionMBps=50 -port=8080 -mserver=<IP_ADDRESS>:9333,<IP_ADDRESS>:9333,<IP_ADDRESS>:9333 -dir=/mnt/data01/data -index leveldb -max 0 -ip <IP_ADDRESS> -rack photol-100
/usr/local/bin/weed -logtostderr master -mdir=/mnt/data01/meta -ip=<IP_ADDRESS> -defaultReplication=010 -volumeSizeLimitMB 30000 -garbageThreshold 0.05 -pulseSeconds 10 -peers=<IP_ADDRESS>:9333,<IP_ADDRESS>:9333,<IP_ADDRESS>:9333

OS version
Ubuntu 16.04
output of weed version

$ weed version
version 30GB 1.78 linux amd64

if using filer, show the content of filer.toml
N/A

Expected behavior
Remove one of the replicated volumes after trying to change replication for volume.

For now, you can use volume.delete
> help volume.delete
  volume.delete	# delete a live volume from one volume server

	volume.delete <volume server host:port> <volume id>

	This command deletes a volume from one volume server.

Thanks.
Can the volume be writable after downreplicating? It was writable before downreplicating but i cannot see it in /dir/status after downreplicating.

After deleting the extra copies, it will become writable.


BUG: Renamed CommentSpellCheck repo

Will the new tag work?

Dunno?

Looks good. Can we squash some of those extra commits before merge?


CI: don't forget adding more notebooks to treebeard.yaml

As we open PRs, these need to add their new notebooks to treebeard.yaml. This won't be needed once the existing notebooks in tree have been processed. This involves minor changes to the CI pipelines so we just ls the directory instead of cherry picking which notebooks have to undergo testing.

Closing this issue since we are not using treebeard anymore.


Failed to Run Solace on Kubernetes Cluster that Uses CEPH-RBD Provisioner

We've been using the Solace Helm Chart successfully using NFS storage. However this is not the storage we wish to use. I have successfully setup a CEPH cluster. I've successfully configured the RBD provisioner to automatically create the PV requested by the Solace Pods PVC, and the RBD Provisioner successfully creates the CEPH PV. However the Solace Pod fails to attach to the storage. It shows an error that suggests that the "rbd" executable is not available in the Solace Pod.
In the following we see the "kissable-panda pod" created using the Solace Helm Chart and the CEPH "fast-rbd" storage class. We also see the successfully bound PVC for this solace pod.

However the pod itself fails to attach as we see here:

I've googled the error

fail to check rbd image status with (executable file not found in $path)

and I've found several links such as the
following
This seems to suggest that the rbd binary is not found in the container image.
Thoughts on resolving this?
Thanks.
Dave

I think I may have found my problem. My use of CEPH RBD seems to be at the core of the problem.
According to this documentation:
https://docs.ceph.com/docs/master/rbd/rbd-kubernetes/
I may have an approach... I'll follow up

This would be great Dave, as we haven't had a use case to test the deployment using CEPH RBD yet. If you overcome the immediate issue but then get similar logs as with NFS indicating slow storage/latency then also try to set the storage.nfs flag in values.

I got past this issue. It was simply a package (ceph-common) missing from the K8S cluster that caused the volume to fail to attach.
The end result is I now have solace up and running with a proper CEPH RBD storage framework.

Thanks Dave, good to know CEPH RBD works. Assuming this issue can be closed.

Yes Sir. As usual  i always appreciate your response. Ty


Using a list of names per principal is limited to 1000 - but there will be more than that

As stated by Hank having a list to keep track of the names owned by a principal is a bad idea, since we could reach the limit.
In cases:

Owner is a contract

He suggested updating it to use a linked list approach here
We need to update accordingly

You may want to re-think updating the imported names' renewal times altogether, since there can be an effectively unbounded number of names in a namespace when it is launched.  You'll only be able to update a (small) finite number of them in the namespace-launch contract-call.
IIRC back in the Blockstack days, we just computed the name's "registration" time as the maximum of the following:

the name's import time (will be 0 if the name was never imported)
the namespace launch time (always defined)
the name's last-registered time (will be 0 for imported names, at first)

Ok looking into this


AllJoyn samples - remove AppInsight references

@zhuridartem,
Thanks for your contribution as a Microsoft full-time employee or intern. You do not need to sign a CLA.
Thanks,
Microsoft Pull Request Bot


add instructions for building CeranaOS on CeranaOS

Description:
Simple steps to set up a build container and run a build

This change is

Comments from Reviewable

Reviewed 1 of 1 files at r1.
Review status: all files reviewed at latest revision, all discussions resolved, some commit checks broke.

Comments from Reviewable


Get stuck at "Added broadcast_1_piece0 in memory" when runing Spark standalone cluster

My command:
${SPARK_HOME}/bin/spark-submit
--master ${MASTER}
--py-files ${TFoS_HOME}/examples/mnist/spark/mnist_dist.py
--conf spark.executorEnv.LD_LIBRARY_PATH=/usr/hdp/<IP_ADDRESS>-187/usr/lib
--conf spark.cores.max=2
--conf spark.task.cpus=1
--num-executors 2
--executor-cores 1
--executor-memory 3g
--conf spark.executorEnv.JAVA_HOME="$JAVA_HOME"
${TFoS_HOME}/examples/mnist/spark/mnist_spark.py
--cluster_size 2
--images examples/mnist/csv/train/images
--labels examples/mnist/csv/train/labels
--format csv
--mode train
--model mnist_model
It always stuck at
 My Output: INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on <IP_ADDRESS>:46490 (size: 30.0 KB, free: 1458.5 MB)
What should I do to fix it?
18/11/07 16:35:56 INFO SparkContext: Running Spark version <IP_ADDRESS>.0.1.0-187
18/11/07 16:35:56 INFO SparkContext: Submitted application: mnist_spark
18/11/07 16:35:56 INFO SecurityManager: Changing view acls to: root,hdfs
18/11/07 16:35:56 INFO SecurityManager: Changing modify acls to: root,hdfs
18/11/07 16:35:56 INFO SecurityManager: Changing view acls groups to:
18/11/07 16:35:56 INFO SecurityManager: Changing modify acls groups to:
18/11/07 16:35:56 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users  with view permissions: Set(root, hdfs); groups with view permissions: Set(); users  with modify permissions: Set(root, hdfs); groups with modify permissions: Set()
18/11/07 16:35:56 INFO Utils: Successfully started service 'sparkDriver' on port 46810.
18/11/07 16:35:57 INFO SparkEnv: Registering MapOutputTracker
18/11/07 16:35:57 INFO SparkEnv: Registering BlockManagerMaster
18/11/07 16:35:57 INFO BlockManagerMasterEndpoint: Using org.apache.spark.storage.DefaultTopologyMapper for getting topology information
18/11/07 16:35:57 INFO BlockManagerMasterEndpoint: BlockManagerMasterEndpoint up
18/11/07 16:35:57 INFO DiskBlockManager: Created local directory at /tmp/blockmgr-18463cd3-b3a2-4e27-b738-2d898a38cc49
18/11/07 16:35:57 INFO MemoryStore: MemoryStore started with capacity 366.3 MB
18/11/07 16:35:57 INFO SparkEnv: Registering OutputCommitCoordinator
18/11/07 16:35:57 INFO log: Logging initialized @3669ms
18/11/07 16:35:57 INFO Server: jetty-9.3.z-SNAPSHOT, build timestamp: 2018-06-06T01:11:56+08:00, git hash: 84205aa28f11a4f31f2a3b86d1bba2cc8ab69827
18/11/07 16:35:57 INFO Server: Started @3760ms
18/11/07 16:35:57 INFO AbstractConnector: Started ServerConnector@2cb8119{HTTP/1.1,[http/1.1]}{<IP_ADDRESS>:4040}
18/11/07 16:35:57 INFO Utils: Successfully started service 'SparkUI' on port 4040.
18/11/07 16:35:57 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@32a6bda2{/jobs,null,AVAILABLE,@Spark}
18/11/07 16:35:57 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@2ccc7183{/jobs/json,null,AVAILABLE,@Spark}
18/11/07 16:35:57 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@30ec65f3{/jobs/job,null,AVAILABLE,@Spark}
18/11/07 16:35:57 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@4effe6da{/jobs/job/json,null,AVAILABLE,@Spark}
18/11/07 16:35:57 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@1f0d6ef{/stages,null,AVAILABLE,@Spark}
18/11/07 16:35:57 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@5260f8df{/stages/json,null,AVAILABLE,@Spark}
18/11/07 16:35:57 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@5a8a4629{/stages/stage,null,AVAILABLE,@Spark}
18/11/07 16:35:57 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@3941fde2{/stages/stage/json,null,AVAILABLE,@Spark}
18/11/07 16:35:57 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@31f25fed{/stages/pool,null,AVAILABLE,@Spark}
18/11/07 16:35:57 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@4feabd55{/stages/pool/json,null,AVAILABLE,@Spark}
18/11/07 16:35:57 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@3193bd9d{/storage,null,AVAILABLE,@Spark}
18/11/07 16:35:57 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@78be8a0{/storage/json,null,AVAILABLE,@Spark}
18/11/07 16:35:57 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@24a5d28b{/storage/rdd,null,AVAILABLE,@Spark}
18/11/07 16:35:57 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@3ebfc35f{/storage/rdd/json,null,AVAILABLE,@Spark}
18/11/07 16:35:57 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@12ecee40{/environment,null,AVAILABLE,@Spark}
18/11/07 16:35:57 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@4a7aca55{/environment/json,null,AVAILABLE,@Spark}
18/11/07 16:35:57 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@4041781b{/executors,null,AVAILABLE,@Spark}
18/11/07 16:35:57 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@24ee77{/executors/json,null,AVAILABLE,@Spark}
18/11/07 16:35:57 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@75cf8edd{/executors/threadDump,null,AVAILABLE,@Spark}
18/11/07 16:35:57 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@697bda53{/executors/threadDump/json,null,AVAILABLE,@Spark}
18/11/07 16:35:57 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@22b1f6c7{/static,null,AVAILABLE,@Spark}
18/11/07 16:35:57 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@7b45d96c{/,null,AVAILABLE,@Spark}
18/11/07 16:35:57 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@1381af9e{/api,null,AVAILABLE,@Spark}
18/11/07 16:35:57 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@1121f1bd{/jobs/job/kill,null,AVAILABLE,@Spark}
18/11/07 16:35:57 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@6dee9150{/stages/stage/kill,null,AVAILABLE,@Spark}
18/11/07 16:35:57 INFO SparkUI: Bound SparkUI to <IP_ADDRESS>, and started at http://hadoop1.spark:4040
18/11/07 16:35:57 INFO SparkContext: Added file file:///root/TensorFlowOnSpark/examples/mnist/spark/mnist_dist.py at spark://hadoop1.spark:46810/files/mnist_dist.py with timestamp<PHONE_NUMBER>368
18/11/07 16:35:57 INFO Utils: Copying /root/TensorFlowOnSpark/examples/mnist/spark/mnist_dist.py to /tmp/spark-ee49773c-9911-47ad-8416-67f976dfeff6/userFiles-50726fd1-88d6-4c60-a4c1-144434128ffc/mnist_dist.py
18/11/07 16:35:57 INFO StandaloneAppClient$ClientEndpoint: Connecting to master spark://hadoop1:7077...
18/11/07 16:35:57 INFO TransportClientFactory: Successfully created connection to hadoop1/<IP_ADDRESS>:7077 after 61 ms (0 ms spent in bootstraps)
18/11/07 16:35:57 INFO StandaloneSchedulerBackend: Connected to Spark cluster with app ID app-20181107163557-0001
18/11/07 16:35:57 INFO StandaloneAppClient$ClientEndpoint: Executor added: app-20181107163557-0001/0 on worker-20181107163338-<IP_ADDRESS>-45331 (<IP_ADDRESS>:45331) with 1 core(s)
18/11/07 16:35:57 INFO StandaloneSchedulerBackend: Granted executor ID app-20181107163557-0001/0 on hostPort <IP_ADDRESS>:45331 with 1 core(s), 3.0 GB RAM
18/11/07 16:35:57 INFO StandaloneAppClient$ClientEndpoint: Executor added: app-20181107163557-0001/1 on worker-20181107163342-<IP_ADDRESS>-37592 (<IP_ADDRESS>:37592) with 1 core(s)
18/11/07 16:35:57 INFO StandaloneSchedulerBackend: Granted executor ID app-20181107163557-0001/1 on hostPort <IP_ADDRESS>:37592 with 1 core(s), 3.0 GB RAM
18/11/07 16:35:57 INFO StandaloneAppClient$ClientEndpoint: Executor updated: app-20181107163557-0001/0 is now RUNNING
18/11/07 16:35:57 INFO StandaloneAppClient$ClientEndpoint: Executor updated: app-20181107163557-0001/1 is now RUNNING
18/11/07 16:35:57 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 41180.
18/11/07 16:35:57 INFO NettyBlockTransferService: Server created on hadoop1.spark:41180
18/11/07 16:35:57 INFO BlockManager: Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy
18/11/07 16:35:58 INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, hadoop1.spark, 41180, None)
18/11/07 16:35:58 INFO BlockManagerMasterEndpoint: Registering block manager hadoop1.spark:41180 with 366.3 MB RAM, BlockManagerId(driver, hadoop1.spark, 41180, None)
18/11/07 16:35:58 INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, hadoop1.spark, 41180, None)
18/11/07 16:35:58 INFO BlockManager: Initialized BlockManager: BlockManagerId(driver, hadoop1.spark, 41180, None)
18/11/07 16:35:58 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@3919e4d3{/metrics/json,null,AVAILABLE,@Spark}
18/11/07 16:35:59 INFO EventLoggingListener: Logging events to hdfs:/spark2-history/app-20181107163557-0001
18/11/07 16:35:59 INFO StandaloneSchedulerBackend: SchedulerBackend is ready for scheduling beginning after reached minRegisteredResourcesRatio: 0.0
args: Namespace(batch_size=100, cluster_size=2, epochs=1, export_dir='mnist_export', format='csv', images='examples/mnist/csv/train/images', labels='examples/mnist/csv/train/labels', mode='train', model='mnist_model', output='predictions', rdma=False, readers=1, steps=1000, tensorboard=False)
2018-11-07T16:35:59.990840 ===== Start
zipping images and labels
18/11/07 16:36:00 INFO MemoryStore: Block broadcast_0 stored as values in memory (estimated size 353.1 KB, free 366.0 MB)
18/11/07 16:36:00 INFO MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 30.0 KB, free 365.9 MB)
18/11/07 16:36:00 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on hadoop1.spark:41180 (size: 30.0 KB, free: 366.3 MB)
18/11/07 16:36:00 INFO SparkContext: Created broadcast 0 from textFile at NativeMethodAccessorImpl.java:0
18/11/07 16:36:00 INFO MemoryStore: Block broadcast_1 stored as values in memory (estimated size 353.2 KB, free 365.6 MB)
18/11/07 16:36:00 INFO MemoryStore: Block broadcast_1_piece0 stored as bytes in memory (estimated size 30.0 KB, free 365.6 MB)
18/11/07 16:36:00 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on hadoop1.spark:41180 (size: 30.0 KB, free: 366.2 MB)
18/11/07 16:36:00 INFO SparkContext: Created broadcast 1 from textFile at NativeMethodAccessorImpl.java:0
18/11/07 16:36:00 INFO FileInputFormat: Total input files to process : 10
18/11/07 16:36:00 INFO FileInputFormat: Total input files to process : 10
2018-11-07 16:36:01,143 INFO (MainThread-18940) Reserving TFSparkNodes
2018-11-07 16:36:01,144 INFO (MainThread-18940) cluster_template: {'ps': [0], 'worker': [1]}
2018-11-07 16:36:01,152 INFO (MainThread-18940) listening for reservations at ('<IP_ADDRESS>', 41217)
2018-11-07 16:36:01,164 INFO (MainThread-18940) Starting TensorFlow on executors
2018-11-07 16:36:01,189 INFO (MainThread-18940) Waiting for TFSparkNodes to start
2018-11-07 16:36:01,189 INFO (MainThread-18940) waiting for 2 reservations
18/11/07 16:36:01 INFO SparkContext: Starting job: foreachPartition at /usr/local/lib/python2.7/dist-packages/tensorflowonspark/TFCluster.py:284
18/11/07 16:36:01 INFO DAGScheduler: Got job 0 (foreachPartition at /usr/local/lib/python2.7/dist-packages/tensorflowonspark/TFCluster.py:284) with 2 output partitions
18/11/07 16:36:01 INFO DAGScheduler: Final stage: ResultStage 0 (foreachPartition at /usr/local/lib/python2.7/dist-packages/tensorflowonspark/TFCluster.py:284)
18/11/07 16:36:01 INFO DAGScheduler: Parents of final stage: List()
18/11/07 16:36:01 INFO DAGScheduler: Missing parents: List()
18/11/07 16:36:01 INFO DAGScheduler: Submitting ResultStage 0 (PythonRDD[8] at foreachPartition at /usr/local/lib/python2.7/dist-packages/tensorflowonspark/TFCluster.py:284), which has no missing parents
18/11/07 16:36:01 INFO MemoryStore: Block broadcast_2 stored as values in memory (estimated size 13.6 KB, free 365.5 MB)
18/11/07 16:36:01 INFO MemoryStore: Block broadcast_2_piece0 stored as bytes in memory (estimated size 9.7 KB, free 365.5 MB)
18/11/07 16:36:01 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on hadoop1.spark:41180 (size: 9.7 KB, free: 366.2 MB)
18/11/07 16:36:01 INFO SparkContext: Created broadcast 2 from broadcast at DAGScheduler.scala:1039
18/11/07 16:36:01 INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 0 (PythonRDD[8] at foreachPartition at /usr/local/lib/python2.7/dist-packages/tensorflowonspark/TFCluster.py:284) (first 15 tasks are for partitions Vector(0, 1))
18/11/07 16:36:01 INFO TaskSchedulerImpl: Adding task set 0.0 with 2 tasks
18/11/07 16:36:02 INFO CoarseGrainedSchedulerBackend$DriverEndpoint: Registered executor NettyRpcEndpointRef(spark-client://Executor) (<IP_ADDRESS>:41602) with ID 1
18/11/07 16:36:02 INFO TaskSetManager: Starting task 0.0 in stage 0.0 (TID 0, <IP_ADDRESS>, executor 1, partition 0, PROCESS_LOCAL, 7862 bytes)
2018-11-07 16:36:02,190 INFO (MainThread-18940) waiting for 2 reservations
18/11/07 16:36:02 INFO CoarseGrainedSchedulerBackend$DriverEndpoint: Registered executor NettyRpcEndpointRef(spark-client://Executor) (<IP_ADDRESS>:41604) with ID 0
18/11/07 16:36:02 INFO TaskSetManager: Starting task 1.0 in stage 0.0 (TID 1, <IP_ADDRESS>, executor 0, partition 1, PROCESS_LOCAL, 7862 bytes)
18/11/07 16:36:02 INFO BlockManagerMasterEndpoint: Registering block manager <IP_ADDRESS>:40424 with 1458.6 MB RAM, BlockManagerId(1, <IP_ADDRESS>, 40424, None)
18/11/07 16:36:02 INFO BlockManagerMasterEndpoint: Registering block manager <IP_ADDRESS>:46490 with 1458.6 MB RAM, BlockManagerId(0, <IP_ADDRESS>, 46490, None)
18/11/07 16:36:02 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on <IP_ADDRESS>:40424 (size: 9.7 KB, free: 1458.6 MB)
18/11/07 16:36:03 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on <IP_ADDRESS>:46490 (size: 9.7 KB, free: 1458.6 MB)
2018-11-07 16:36:03,191 INFO (MainThread-18940) waiting for 2 reservations
2018-11-07 16:36:04,192 INFO (MainThread-18940) waiting for 2 reservations
2018-11-07 16:36:05,193 INFO (MainThread-18940) all reservations completed
2018-11-07 16:36:05,194 INFO (MainThread-18940) All TFSparkNodes started
2018-11-07 16:36:05,194 INFO (MainThread-18940) {'executor_id': 0, 'addr': ('<IP_ADDRESS>', 40912), 'task_index': 0, 'job_name': 'ps', 'authkey': '6?H\xe1h\xd7K\xf4\xbe\xafJ\xcd\xaa\xdb\xfa.', 'host': '<IP_ADDRESS>', 'port': 44865, 'tb_pid': 0, 'tb_port': 0}
2018-11-07 16:36:05,194 INFO (MainThread-18940) {'executor_id': 1, 'addr': '/tmp/pymp-pW1Xmz/listener-bgJPts', 'task_index': 0, 'job_name': 'worker', 'authkey': '9\xd6\x8fz,pL\xac\x95\x8b\r$\xe3\xdc\r\x8f', 'host': '<IP_ADDRESS>', 'port': 44525, 'tb_pid': 0, 'tb_port': 0}
2018-11-07 16:36:05,194 INFO (MainThread-18940) Feeding training data
18/11/07 16:36:05 INFO SparkContext: Starting job: collect at PythonRDD.scala:162
18/11/07 16:36:05 INFO DAGScheduler: Got job 1 (collect at PythonRDD.scala:162) with 10 output partitions
18/11/07 16:36:05 INFO DAGScheduler: Final stage: ResultStage 1 (collect at PythonRDD.scala:162)
18/11/07 16:36:05 INFO DAGScheduler: Parents of final stage: List()
18/11/07 16:36:05 INFO DAGScheduler: Missing parents: List()
18/11/07 16:36:05 INFO DAGScheduler: Submitting ResultStage 1 (PythonRDD[10] at RDD at PythonRDD.scala:49), which has no missing parents
18/11/07 16:36:05 INFO MemoryStore: Block broadcast_3 stored as values in memory (estimated size 14.4 KB, free 365.5 MB)
18/11/07 16:36:05 INFO MemoryStore: Block broadcast_3_piece0 stored as bytes in memory (estimated size 7.9 KB, free 365.5 MB)
18/11/07 16:36:05 INFO BlockManagerInfo: Added broadcast_3_piece0 in memory on hadoop1.spark:41180 (size: 7.9 KB, free: 366.2 MB)
18/11/07 16:36:05 INFO SparkContext: Created broadcast 3 from broadcast at DAGScheduler.scala:1039
18/11/07 16:36:05 INFO DAGScheduler: Submitting 10 missing tasks from ResultStage 1 (PythonRDD[10] at RDD at PythonRDD.scala:49) (first 15 tasks are for partitions Vector(0, 1, 2, 3, 4, 5, 6, 7, 8, 9))
18/11/07 16:36:05 INFO TaskSchedulerImpl: Adding task set 1.0 with 10 tasks
18/11/07 16:36:05 INFO TaskSetManager: Starting task 0.0 in stage 1.0 (TID 2, <IP_ADDRESS>, executor 0, partition 0, ANY, 8534 bytes)
18/11/07 16:36:05 INFO TaskSetManager: Finished task 1.0 in stage 0.0 (TID 1) in 3294 ms on <IP_ADDRESS> (executor 0) (1/2)
18/11/07 16:36:05 INFO PythonAccumulatorV2: Connected to AccumulatorServer at host: <IP_ADDRESS> port: 54716
18/11/07 16:36:05 INFO BlockManagerInfo: Added broadcast_3_piece0 in memory on <IP_ADDRESS>:46490 (size: 7.9 KB, free: 1458.6 MB)
18/11/07 16:36:05 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on <IP_ADDRESS>:46490 (size: 30.0 KB, free: 1458.6 MB)
18/11/07 16:36:06 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on <IP_ADDRESS>:46490 (size: 30.0 KB, free: 1458.5 MB)

It seems it caused by this line logdir = TFNode.hdfs_path(ctx, args.model).
How to bypass it?

@leewyang  Got your updated code.
Now I found it will hang in the same stage, and found something interested from my SPARK UI:
18/11/08 10:09:01 INFO Executor: Finished task 1.0 in stage 0.0 (TID 1). 1461 bytes result sent to driver
18/11/08 10:09:01 INFO CoarseGrainedExecutorBackend: Got assigned task 2
18/11/08 10:09:01 INFO Executor: Running task 0.0 in stage 1.0 (TID 2)
18/11/08 10:09:01 INFO TorrentBroadcast: Started reading broadcast variable 3
18/11/08 10:09:01 INFO MemoryStore: Block broadcast_3_piece0 stored as bytes in memory (estimated size 7.9 KB, free 366.3 MB)
18/11/08 10:09:01 INFO TorrentBroadcast: Reading broadcast variable 3 took 25 ms
18/11/08 10:09:01 INFO MemoryStore: Block broadcast_3 stored as values in memory (estimated size 14.5 KB, free 366.3 MB)
18/11/08 10:09:01 INFO HadoopRDD: Input split: hdfs://hadoop1.spark:8020/user/hdfs/examples/mnist/csv/train/images/part-00000:0+9338236
18/11/08 10:09:01 INFO TorrentBroadcast: Started reading broadcast variable 0
18/11/08 10:09:01 INFO MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 30.0 KB, free 366.2 MB)
18/11/08 10:09:01 INFO TorrentBroadcast: Reading broadcast variable 0 took 18 ms
18/11/08 10:09:01 INFO MemoryStore: Block broadcast_0 stored as values in memory (estimated size 492.4 KB, free 365.7 MB)
tensorflow model path: hdfs://hadoop1.spark:8020/user/hdfs/mnist_model
2018-11-08 10:09:01,667 INFO (MainThread-9803) Create CheckpointSaverHook.
18/11/08 10:09:02 INFO HadoopRDD: Input split: hdfs://hadoop1.spark:8020/user/hdfs/examples/mnist/csv/train/labels/part-00000:0+204800
18/11/08 10:09:02 INFO TorrentBroadcast: Started reading broadcast variable 1
18/11/08 10:09:02 INFO MemoryStore: Block broadcast_1_piece0 stored as bytes in memory (estimated size 30.0 KB, free 365.7 MB)
18/11/08 10:09:02 INFO TorrentBroadcast: Reading broadcast variable 1 took 42 ms
18/11/08 10:09:02 INFO MemoryStore: Block broadcast_1 stored as values in memory (estimated size 492.4 KB, free 365.2 MB)
2018-11-08 10:09:03,292 INFO (MainThread-9942) Connected to TFSparkNode.mgr on <IP_ADDRESS>, executor=1, state='running'
2018-11-08 10:09:03,346 INFO (MainThread-9942) mgr.state='running'
2018-11-08 10:09:03,346 INFO (MainThread-9942) Feeding partition <itertools.chain object at 0x7fe81ab76650> into input queue <multiprocessing.queues.JoinableQueue object at 0x7fe80dade950>
18/11/08 10:09:05 INFO PythonRunner: Times: total = 2623, boot = -1467, init = 1712, finish = 2378
18/11/08 10:09:05 INFO PythonRunner: Times: total = 360, boot = 17, init = 175, finish = 168

@leewyang   Finally, I know how to solved it lah.
https://stackoverflow.com/questions/43354494/distributed-tensorflow-1-0-supervisor-stuck-if-logdir-is-in-hdfs?answertab=votes#tab-top
I should located my libhdfs.so to the LD_LIBRARY_PATH.


Improving post languages

Is your feature request related to a problem? Please describe.

This is a follow up discussion from Bluesky
I think it would be nice if we can improve the post languages experience for multilingual users.
currently, it doesn't seem great that non-English users are unaware that they're currently posting in English, or as an example, both English and Persian.
perhaps a discoverability issue? I think you'd only be aware that it exists at all if,
a. you have been following Paul Frazee for a while, or,
b. you actively seek the update notes, either via app store or the bsky.app account
what might also be an issue is the way it's been presented, right now the post composer just has this mysterious button labeled en or some other language code, I don't think I'd know what to make of it until I press the button to see what it is about.
Describe the solution you'd like

We should probably reset the current post languages configuration so that we only default to whatever the no.1 system language is, rather than top 3 languages, this is important for the next point
We should show the full language name when one language is set, this ensures that users are clearly aware that the languages that have been specified for the post they're writing, which can look like the image below.

in the thread I've mentioned how it might not matter at all if it only shows one language, since it'll be too long if we display multiple languages, but I think so long as points above are taken then we could just defer back to language codes now that users understand that it's the post language button.
Describe alternatives you've considered
An alternative would be to add a notice that post languages are a thing at all, that the mysterious en button is for changing the post languages, but I feel like this is a band-aid at most, we're better off not displaying language codes I think.
Additional context

the langs array is an incredibly useful property for custom feeds/clients that would like to make sense of the posts without bringing in an NLP model, which can be problematic in some cases (e.g not suitable for custom clients primarily targetting low-end devices)

Additional thoughts:
It would be great to be able to quickly remove languages, it shouldn't take scrolling through a list to disable the language they're no longer using for a new post, especially important as not all multilingual users have multiple languages added to their device (or something is inhibiting it, like Brave browser that would only show primary language despite setting it up)

It would be interesting if the languages were ordered, this is a bit of an odd request, and even I have no idea how useful it can be, but in some cases, users still use primary language to be writing the posts in even if they specified multiple languages, and it would be interesting if we can reflect that within the languages array.

These are good suggestions. We'll talk through it and see what we can do to improve the outcomes

An update to this UI has been pushed. Not all of the suggestions were included but hopefully it's closer to what youre suggesting


Add type annotations to the GroupBy class

Class location: third_party/3/pandas/core/groupby/groupby.pyi

Closing this PR as pandas-stubs has moved to another repository and will now be managed alongside pandas itself: https://github.com/pandas-dev/pandas-stubs

Just want to let people know that before pandas version 1.5.0 (installed via conda-forge), the groupBy was not showing in the completion menu of data-frame:


No notification when app is closed on Android, not at all on iOS.

Expected Behaviour
Push Notification gets shown when the app is closed.
Actual Behaviour
Android: Shown when in foreground or minimized, nothing happens when closed.
iOS: Nothing happens.
Platform and Version (eg. Android 5.0 or iOS 9.2.1)
Android 6.0.1
iOS 9.x.x
(Android) What device vendor (e.g. Samsung, HTC, Sony...)
Asus Zenfone 2 Laser ZE550KL
iPhone 6 Plus
Cordova CLI version and cordova platform version
6.4.4
Plugin version
1.9.2
Sample Code that illustrates the problem
https://hastebin.com/ucecodepes.php
https://hastebin.com/epofanotew.js
The payload might look quite messy since I've been reading threads and trying things out for two hours now.
What I've noticed is that the registration id I receive on the iOS device is only 64 characters long and contains no other characters apart from lowercase letters and numbers.

@Hissvard you are not sending the correct payload. I document the heck out of it in:
https://github.com/phonegap/phonegap-plugin-push/blob/master/docs/PAYLOAD.md
For Android send:
registration_ids" => $token,
    "data" => [
        "title" => "prova",
        "message" => "prova",
        "notId" => "324234",
        "content-available" => 1,
        "priority" => "high",
        "force-start" => 1,
    ]

For iOS send:
    "registration_ids" => $token,
    "aps" => [
        "alert" => [
            "title" => "prova",
            "body" => "prova"
        ]
    ],

Thank you for the reply.
I'd originally tried that, then ended up mixing things together trying to get it to work.
I still can't receive notifications while the app is in background on Android, and get a "error":"InvalidRegistration" error on iOS which I'm guessing could be solved by taking a look at the Apple certification process, although I'm not exactly sure where I should be looking.

@Hissvard when you say can't receive notifications while the app is in background on Android do you mean it doesn't show up in the notification shade?
When sending to iOS are you using APNS or GCM?

It doesn't show up in the notification shade and the notification event is not fired, exactly.
How do I know which of the two I'm using?

@Hissvard well the event is not fired normally if the app is forced closed as there is no app to receive the event. If you've force closed the app you should still see the notification in the shade so possibly you are running into:
https://github.com/phonegap/phonegap-plugin-push/blob/master/docs/PAYLOAD.md#huawei-and-xiaomi-phones
How are you sending message to the iOS device?

Oh, it seems that the problem on Android lies indeed in the fact that the app was not enabled in the "autostart" list. It might be useful to add to the documentation that Asus devices suffer from the same issue.
Not sure I understand the question about the iOS device. I'm sending them the same way I do it with Android, with the one exception being the payload sent.
What I get back from that is
{
  "multicast_id": "<id_here>",
  "success":0,
  "failure":1,
  "canonical_ids":0,
  "results":
  [
    {
      "error":"InvalidRegistration"
    }
  ]
}

Like I said, I think the issue with iOS is that the Registration ID I get is not valid since it does not have the same format the one I get from Android devices does.
I remember it working up until some time ago and giving the correct token, but then it somehow stopped working for some reason. The app is not currently published to the App Store but using Test Flight.

I've been encountering the same issue again, up until a few days ago the notification was delivered even when the app was force closed, but I have no idea what changed that made it stop doing so.
This is the payload I'm sending (android):
{
   "registration_ids":[
      "<id here>"
   ],
   "data":{
      "title":"12345",
      "image":"<image>",
      "notId":"119",
      "style":"picture",
      "picture":"<picture>",
      "message":"12345",
      "content-available":1,
      "priority":"high",
      "force-start":1,
   }
}

Any idea what might be wrong?

@Hissvard do you have any logs captured during the send/arrive process? We need more details on it to be able to help.

Sorry for the late reply.
To be honest I've only ever used Phonegap for app development, so I'm sorry to say that I'm unsure about how to get logs while the app is force closed. How would I go about that?

Nevermind, it turned out to be some setting I'd changed about app autostart.