Determine if two queries execute identically

Summary
It would be nice if this library can provide a mechanism to determine queries that are identical regarding their execution. This is useful for performance optimizations, including but not limited to subscriptions and caching.
What problem does this solve?
This recently came up while looking for a possible optimization strategy for resolving subscriptions, see https://github.com/nuwave/lighthouse/pull/1425#issuecomment-642932378
The way we implement subscriptions - I imagine others might as well - is that we basically store the subscription queries for later execution. When the subscription is triggered, we run the stored query again and push the result to clients.
In some cases we call public subscriptions, every client subscribes to the same stream of events. In a non-GraphQL world, we would just push the same result to every client. However, the dynamic subscription queries might be unique in that they pass different arguments, request different fields, alias some fields, etc.
Our current unoptimized implementation simply runs each single query individually to ensure every client gets the exact result they asked for. For expensive queries, it might be beneficial to group clients that sent equivalent queries together, resolve their queries once and serve them the same result.
Considered Alternatives
A naive approach would be to simple compare the query string + argument, but that fails to normalize insignificant differences, such as whitespace.
The next best thing i came up with is to do a string comparison on the serialized version of the parsed query, but i feel this might still be suboptimal or not cover some edge cases.

Interesting stuff!
Did you try series of parse and print to "normalize" the query string (with regards to whitespaces)?
As for full-featured comparison... I think it is possible to write a "generic" tool that will inline all the fragments, deduplicate identical fields, and then compare each field in the selection set.
This is doable using visitor.

Did you try series of parse and print to "normalize" the query string (with regards to whitespaces)?

That would be a part of a proper tool for sure, but does not take variables into account. In order for a query to be considered identical, they would have to match, too.

inline all the fragments, deduplicate identical fields, and then compare each field in the selection set.

Good thinking. There are multiple levels of optimization possible, depending on where we want to draw the boundary.
For example, we might want to normalize field ordering. That enables us to group queries that have the same fields, resolve them once, then simply reorder the results individually.
I think we can start with something relatively simple: queries whose results are exactly the same (as in: the server can send back the exact same JSON response).

My instinct is to start out with fundamental building blocks, such as a function to serialize query strings into a normalized form.

I think maybe we don't need to bother finding ideal solution (query normalisation). Imagine typical scenario: you expose and API, that maybe 4 different client application uses (maybe developed by different companies). Each app can have i.e. 100 active subscribers for the very same subscription, so in total we have 4x 100 = 400 active subscriptions.
Lighthouse currently executes 400 queries. If we analyse these queries, yes, there are a little discrepancies between 4 clients app, even if they actually query identical data (but in a not normalised way). If we simply compare the queries (string == string) It would be a tremendous improvements, because we would end with 4 executes instead of 400.
If I understand you guys correctly, you are not satisfied with this solution, because you would like to put it down to one query. And surely, that would be better. But 4 -> 1 is relatively minor improvement compared to the 400 -> 4.
I know this is just an example, but current subscription implementation is hard to use in a real world scenarios (for the so called public subscriptions, the inefficiency is so big they are practically unusable.
My suggestion is to go for the proposed naive approach A naive approach would be to simple compare the query string + argument and leave the query normalisation for further optimisation in the future.

I think maybe we don't need to bother finding ideal solution (query normalisation). Imagine typical scenario: you expose and API, that maybe 4 different client application uses (maybe developed by different companies). Each app can have i.e. 100 active subscribers for the very same subscription, so in total we have 4x 100 = 400 active subscriptions.
Lighthouse currently executes 400 queries. If we analyse these queries, yes, there are a little discrepancies between 4 clients app, even if they actually query identical data (but in a not normalised way). If we simply compare the queries (string == string) It would be a tremendous improvements, because we would end with 4 executes instead of 400.
If I understand you guys correctly, you are not satisfied with this solution, because you would like to put it down to one query. And surely, that would be better. But 4 -> 1 is relatively minor improvement compared to the 400 -> 4.
I know this is just an example, but current subscription implementation is hard to use in a real world scenarios (for the so called public subscriptions, the inefficiency is so big they are practically unusable.
My suggestion is to go for the proposed naive approach A naive approach would be to simple compare the query string + argument and leave the query normalisation for further optimisation in the future.

I had a similar question in order to try caching query results. The approach I used was to look at $info->queryPlan() in the first query field resolver that was executed by graphql-php, and use a hash of the serialized plan as a kind of unique queryId.
That in combination with a hash of the serialized $args gives you a way to cache the result of the combination of query operation + args when you get back from executeQuery() in your main handler.
For the next query when you hit that resolver, you can check if you have a cache result and return null there - stopping further resolver executions, and then replace the result with your cached result in your main handler.
public function this_query_resolver(...) {
    $resolver = function ($rootValue, $args, $context, ResolveInfo $info) use (...) {
        $queryPlan = $info->lookAhead();
        $queryId = 'this_query-' . md5(dump_query_plan($queryPlan->queryPlan());
        $cacheKey = $queryId . '-' . md5(json_encode($args));
        if (is_cached($cacheKey)) {
             return null;
        }
        // resolve normally
       ...
    };
    return $resolver;
}

$result = GraphQL::executeQuery(...);
// --> start execution until you hit the query field resolver that is actually requested
if (!empty($cacheKey)) {
    if (is_cached($cacheKey)) {
        // --> replace the null with the cached result
        $serializedResult = get_cached($cacheKey);
    } else {
        // --> cache the actual result for next time
        $serializedResult = $result->toArray();
        set_cached($cacheKey, $serializedResult);
    }
}

It would be better if we didn't need to wait until the first resolver to know which query operation, fields etc. were actually requested, but I didn't find a better entry point - at least not without adapting the graphql-php library itself.
But perhaps there's a better place for it, preferably one that could be used to override normal query execution?


Walking Directions

It looks like walking directions do not allow routing on Train Platforms:
http://www.openstreetmap.org/directions?engine=graphhopper_foot&route=37.73234%2C-122.43382%3B37.73400%2C-122.43401#map=18/37.73334/-122.43381
vs
http://www.openstreetmap.org/directions?engine=graphhopper_foot&route=37.73242%2C-122.43372%3B37.73400%2C-122.43401#map=18/37.73318/-122.43224
This can be an issue when trying to route to Public Transit stops.

Strange, as we do accept them: See FootFlagEncoder: acceptedRailways.add("platform");
Will look into it.

Okay, this is fixed and tested in https://github.com/graphhopper/graphhopper/commit/cc4b114272dc37b860ced8bf78b9f558228ead6c will close when deployed and verified. Thanks for reporting!

Great! Thanks for the quick response.

Deployed.


chore: figure out correct goalPrefix when hilla-maven-plugin is packed as vaadin-maven-plugin

We could also play with the goalPrefix like we did before: https://github.com/vaadin/hilla/blob/9ed14940077118014ca8dc3bd15c396507b3c83b/packages/java/maven-plugin/pom.xml#L96
That way, two different plugins can be seen under the same name, provided that they are not used at the same time.
Although it's not clear to me what the final goal is, and why two names are needed.

We could also play with the goalPrefix like we did before:
https://github.com/vaadin/hilla/blob/9ed14940077118014ca8dc3bd15c396507b3c83b/packages/java/maven-plugin/pom.xml#L96
That way, two different plugins can be seen under the same name, provided that they are not used at the same time.
Although it's not clear to me what the final goal is, and why two names are needed.

I was kinda thinking the same, the only usage I can think of for a hilla-maven-plugin is when we want to build/test Hilla project itself and still the platform plugin called vaadin-maven-plugin is not released. But, we can keep having the hilla-maven-plugin and include that dependency in Hilla project's tests, but the goal prefix can change to vaadin so that we don't need to distinguish between hilla or vaadin.

Added a commit setting the goalPrefix as @taefi suggests


Feed Me only using end of some image filenames

When uploading assets, I'm seeing this behaviour with FM, especially where there's extra fullstops in filenames:
filename orig: 128GB_microSDXC_633x_w_3.0Reader.JPG
after import: 0Reader.JPG
filename orig: 10mmT2.1.jpg
after import: 1.jpg
Version numbers are problematic, and results in generic filenames like 1.jpg that are likely to result in false duplicates (e.g. something_1.0.jpg and somethingelse_1.0.jpg both = 0.jpg).
I noticed accents are a problem too:
filename orig: Anna-Vadász_Hungary_Shortlist_Youth_Environment_2014.JPG
after import: sz_Hungary_Shortlist_Youth_Environment_2014.JPG
I tried uploading a file Kite.ly.jpg as an asset directly in Craft and its filename remained intact, so I'm guessing (!) it's a FM issue with the way filenames are parsed. (FM imported it as ly.jpg.)

Can you give the latest master a go?

Did the trick, thanks :)


Timeline question Sync

I came across this project and believe it could save a lot of time. When is the Sync feature planned to be ready to try out? I did see on the main page it wasn't implemented as of yet.

I haven't published the code yet as the accuracy is far too bad. I'm working on improving this, but it will take me few more weeks.

I dont know if this will help. But ive been using a program https://github.com/JorenSix/SyncSink and have had very good luck with it. Its based on another program by the same guy https://github.com/JorenSix/Panako . In which it finds several points and spits out a delay based on multiple points. Now while the way ive been doing it was taking those values and doing all the other steps myself. Ive only had prolly 3 out of a few hundred that didn't sync correctly. Maybe you can take a look and it will help with what your working on.


Add IBM

@grant do we still need this?

Yup. We should add all of our current sponsors.

[ ] IBM
[ ] Concur
[ ] Algorithmia
[ ] Qumulo
[ ] .co
[ ] Zillow

We should probably do this soonish


429 and model missing

Hi,
from yesterday the error 429 is back (i think they changed again something) while the initial scraping of the list of subscriptions.
And when it pass I notice that there are several missing model in the list.
thanks for support

I'm also missing a handful of models. Didn't notice the issue until a new one wasn't showing up.

Can you create a log file and send it here
Only need the retrieval of username section

can you pass me an email to send to you all the debug log privately, plz

<EMAIL_ADDRESS>

@CannotTouch
Do you have a specific model that is missing
The numbers are not accurate on the onlyfans site
expired seems to include deactivated accounts. I've manually checked the count a few times and it always off at least by 100 for me, and I have less then a 1000 account.
You can see how much that would effect your numbers
Active should be more accurate, but I've notice the number displayed on the site might be off by a few compared to the actual number if you scroll donw

@n30liberal
Do you have a  specific model missing or just issue with numbering

sadly the browser find didn't work with the count (with all the active page loaded it just count 21 @. I have tryed other search but nothing). I have tryed to print to pdf, but nothing too. Tryed to load only text, and nothing. But using the OF search bar the models that i noticed that are missing in the scraper are all in the active section. No disabled for any of them.

i don't know where is the problem yet, but i have found a workaround... i have insert the models (that I noticed that aren't in the scraped list) in an OF list and than with 'ofscraper --sub-status active -ul LIST_NAME' the scraper saw them and so from there scraped it normally.
the strange is that it don't scrape it with the 'ofscraper --posts all --username model_user_name'

Yeah I did this 3 months ago
But from what I'm seeing I think they changed it to make the list load dynamically
I don't have any missing models so this is hard to diagnose
It would be helpful to know the offset on onlyfans and match that to what of-scraper is outputting for example

compare the results of that  to see if of-scraper gets the same name

Is there a way using the ofscraper --posts all --username model_name to avoid to retrive all the list of names before the scraping? @datawhores

Would appear that only models without DRM are showing up.
@CannotTouch , how do you get the -ul function to work?
I created a list within OF called Test but get the following error.
ofscraper --sub-status active -ul Test
usage: OF-Scraper [-v] [-cg CONFIG] [-r PROFILE] [-l {OFF,STATS,LOW,NORMAL,DEBUG,TRACE}]
[-dc {OFF,STATS,LOW,NORMAL,DEBUG,TRACE}] [-p {PROMPT,STATS,LOW,NORMAL,DEBUG,TRACE}] [-h]
[-u USERNAME] [-eu EXCLUDED_USERNAME] [-d DAEMON] [-g] [-c] [-a {like,unlike}] [-e] [-o POSTS] [-sk]
[-ft FILTER] [-sp] [-dt {protected,normal}] [-lb LABEL] [-at {paid,free}] [-rw {active,disabled}]
[-ss {active,expired}] [-be BEFORE] [-af AFTER] [-st {name,subscribed,expiring,price}] [-ds] [-uf]
[-nc] [-k {auto,manual}] [-dr {dc,deviint}] [-pc]
{post_check,msg_check,paid_check,story_check,manual} ...
OF-Scraper: error: argument command: invalid choice: 'Test' (choose from 'post_check', 'msg_check', 'paid_check', 'story_check', 'manual')

@264

I've noticed this with one specific model. I can only download when   I do manual URL pulls  but the model doesn't display  in the  list.


Error: Failed with error: No such Project : peote-layout

This happens when trying to install peote-ui, I've already installed it so it's not much of an issue, however it can be for others.

In case anyone comes across this issue it was caused by peote-layout not being available on haxelib but a dependency in the haxelib.json
semmi has fixed the haxelib.json and added extended the readme so hopefully it is a smoother process next time :)
Also worth mentioning is that you would not see the error with haxelib dev instead of haxelib git - but both should be fine to use!

In case anyone comes across this issue it was caused by peote-layout not being available on haxelib but a dependency in the haxelib.json
semmi has fixed the haxelib.json and extended the readme so hopefully it is a smoother process next time :)
Also worth mentioning is that you would not see the error with haxelib dev instead of haxelib git - but both should be fine to use!

alrighty then


JS bootcamp Thijs Spijker

My Introduction
I'm Thijs!!! I am always interested in everything. Like the things we are going to learn at blok Tech. I'am a fast learner especially when I'm interested in the subject! At home I do some gaming(but I'm not a hardcore gamer) and tinker a lot with computers and network stuff 🤓.
I am also very eager to help others! So if there is a question, maybe I'm able to help, just ask me!!!
Name
Thijs Spijker
Class
Tech 1
About me
Write something about yourself
Goals
What are your goals for this class?
Skill level
Beginner, but learning fast.
GitHub username
iSirThijs
GitHub repository
Github JS Bootcamp repository

Thanks! 🎉 Added to the admin sheet.
Feel free to help other students in Slack!


napari hub SEO improvements

Epic for tracking all tasks related to implementing the recommended SEO improvements from the Digital Technology Team.
Links

SEO intake notes
SEMRUSH Report
napari hub SEO recommendations
SEO kickoff notes
Hub Metadata Titles

Tasks
MVP

[x] #895
[x] #896
[x] #897
[x] #898
[x] #899
[x] #900
[x] #932

Nice to have

[ ] #907
[ ] #905
[ ] #678
[ ] #929
[ ] #930
[ ] #931

Closing this out, but let's keep "nice to have" items in mind for future work @codemonkey800!


Rename the ApiPlatform\Builder to ApiPlatform\Core

Q
A

Bug fix?
no

New feature?
no

BC breaks?
no

Deprecations?
no

Tests pass?
yes

Fixed tickets
n/a

License
MIT

Doc PR
n/a

Rename the bundle according to the results of the poll.

Perfect! This should be merge asap :).

@soyuka that's actually not used by Symfony, the key is basically the bundle's name which from ApiPlatformBundle is api_platform. This root key is used only when appending sub configuration trees to an existing one. Anyway, that makes sense. Anyway, I've updated it.

AppVeyor is failing for no reasons all the time, so we can skip it, LGTM :+1:

@sroze yeah but it's confusing in the error message:

Better this way :) thanks!


Parallelization of replica exchange simulations

The replica exchange simulations in the example (done with Yank 0.21.2) seem to be running only in serial. Only 1 process is running when I ran a 24 replica example from a slurm batch script on Research Computing requesting 24 tasks on 1 node. The Yank code can be run with mpi (http://getyank.org/latest/running.html#parallelization) - it would be nice to have many or all replicas running in parallel.

Yeah, we definitely want to get the replicas running in parallel.
Yank 0.21.2 is from 4/20/2018.  We should be using more up-to-date version.
Starting from Yank 0.25 (Nov 8, 2019), the replica exchange functionality was moved to opemmtools, so I would suggest switching to openmmtools 0.18.1 for this functionality https://openmmtools.readthedocs.io/en/0.18.1/).  This would also remove Yank requirements, I believe (simplifying dependencies).
Once the code is up to date, then we can ask on the forums what settings need to be adjusted to get parallel replicas running correctly.

Yeah I agree we should update to openmmtools 0.18.1 and then worry about the parallelization.

I tried the advice from Andrea about setting the context cache, on my udpdate_depencies branch with openmmtools 0.19.0 and all packages at the latest versions. The commands that worked were a little different:
from simtk import openmm from openmmtools.cache import global_context_cache global_context_cache.platform = openmm.openmm.Platform.getPlatformByName('CPU')
But when I ran the replica_exchange.py example using mpirun I get this error repeated for each processor related to not finding the topology:
Traceback (most recent call last):   File "replica_exchange.py", line 124, in <module>     positions=positions,   File "/projects/chwa2399/software/anaconda/envs/cg_openmm_5_29/lib/python3.6/site-packages/foldamers-1.12-py3.6.egg/foldamers/cg_model/cgmodel.py", line 388, in __init__     self.topology = build_topology(self, use_pdbfile=True)   File "/projects/chwa2399/software/anaconda/envs/cg_openmm_5_29/lib/python3.6/site-packages/cg_openmm-1.0-py3.6.egg/cg_openmm/build/cg_build.py", line 370, in build_topology FileNotFoundError: [Errno 2] No such file or directory: 'topology_source.pdb'
I get this whether or not I manually set the context cache - it's launching on the right number of processors, so I think the problem is with the cg_openmm code.

Each process was reading and writing a file ("topology_souorce.pdb") that had the same name, then deleting it.  I wrote to a temporary file instead (each process gets it's own), and that fixed it.  Maybe not the best solution, but works. I can successfully parallelize up to 12 processes on my laptop (which has 8 cores), and it runs to completion.
There were some other issues (simulation processing not parallelizable), so i need to clean up some other things before I file a PR, but I can run up to 12 processes in parallel now fine.

OK, PR #16 should fix this.  One should be able to mpriun -np [num processors] ./run_replica_exchage.py and parallelize all the replicas.  Would be interesting to see the scaling for a long run.

I tested out the new replica exchange code and was able to run 24 replicas with 24 tasks using mpirun (on CURC), and create the pdb files afterwards. The simulations finish but there is definitely something wrong with the bonds and replica exchange energies - some bonds are continuously increasing (going from 7.5 A to as high as ~70 A after 100ps simulation!) as if there is no restoring force. Could also be an issue with reporting the right coordinates for each replica.

Looks like the "some bonds are continuously increasing" problem fixed in #24


polish locale

@Quadric upstreamed, added defaults for HTTP Accept and User Agent in English in upstream and released as version 5.19.0.


[Feature] Add 'New Scheme' menu item

Reported by pgrigorenko on 2010-03-05 07:58 UTC
Sometimes it is really confusing for a user to start construction a new scheme if another scheme has been previously opened. One way is to reload a package, another way is to 'Clear All' objects and then use 'Save As'. Need to have a direct way to start building new schemes from scratch.

Commented by pgrigorenko on 2010-03-05 08:02 UTC
commit 13d0c7e440851145643059560e2aba5082ce1241

Updated by pgrigorenko on 2010-03-05 08:02 UTC

status: open --> closed


typerror in make_dics when using the csd as input

Describe the bug
typerror in make_dics when using the csd as input. The function make_dics give an error when the csd is given as input despite being computed with the mne csd_multitaper function
Steps to reproduce
csd_pooled=csd_multitaper(poolEpochs , fmin=21, fmax=22, bandwidth=10, n_jobs=1)
filters1 = make_dics(info=info, forward=fwd, csd=csd_pooled, reg=reg,reduce_rank=True,
                      pick_ori=None, real_filter=True,normalize_fwd=False,inversion='matrix', weight_norm=None)

Expected results
filters weights
Actual results
File "/data/home1/epinzuti/anaconda3/lib/python3.7/site-packages/mne/beamformer/_dics.py", line 174, in make_dics
    info, fwd, csd = equalize_channels([info, forward, csd])

  File "<decorator-gen-31>", line 24, in equalize_channels

  File "/data/home1/epinzuti/anaconda3/lib/python3.7/site-packages/mne/channels/channels.py", line 148, in equalize_channels
    allowed_types_str)

  File "/data/home1/epinzuti/anaconda3/lib/python3.7/site-packages/mne/utils/check.py", line 389, in _validate_type
    % (item_name, type_name, type(item),))

TypeError: Instances to be modified must be an instance of Raw, Epochs, Evoked, TFR, Forward, Covariance, CrossSpectralDensity or Info, got <class 'mne.time_frequency.csd.CrossSpectralDensity'> instead

@EPinzuti what is meant with steps to reproduce is something we can just copy paste. So if possible (which I am sure it is here) it should use the sample dataset.


[HMR] unexpected require(18) from disposed module 7

I am seeing this error come up when I edit my async components. I was wondering if you have seen this issue before and if it is something that came be resolved.
Thanks.

Hmmm, I am making some adjustments to the HMR configuration (#35).  I'll let you know when done.  It may help with this.

Could you try the following change:
https://github.com/ctrlplusb/react-universally/blob/master/src/client/index.js#L48

Here are the steps to reproduce with console open.

Start on home page - make a edit to your home text and notice HMR update
Click on about link notice HMR warning message in the console [HMR] unexpected require(397) from disposed module 60
Make an edit to your about text and notice that a hot update.js file is generated but it is not rendered. HMR is dead 😬

It appears that HMR async routes and not completing working with react hot reload 3?

@nathanvale thanks for the report and extra info.  I am gonna try this right now quick.

  I'll need to backtrack my updates.  This is a newly introduced issue.
Thanks for the report.

Ok, I have tracked down the issue.  It's definitely occuring when a Route is configured to resolve asynchronously.
I have found a workaround solution.  We still get the "required disposed module" warning, however HMR still kicks in.  I am going to do a bit further testing and try out a few other ideas before pushing this change.

@nathanvale pushed.
I've had to put a workaround in the routes/index.js file to support HMR on dynamic routes.  Please see the respective source for details.

Nice work!

On 29 Jul 2016, at 5:10 PM, Sean Matheson<EMAIL_ADDRESS>wrote:
@nathanvale pushed.
I've had to put a workaround in the routes/index.js file to support HMR on dynamic routes. Please see the respective source for details.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or mute the thread.

this issue is re-appearing? im getting this logs
[HMR] unexpected require(./configs/routes/home/index.js) from disposed module ./configs/routes/index.js
[HMR] unexpected require(./configs/routes/errors/404/index.js) from disposed module ./configs/routes/index.js

both are async modules, when HMR kicks in, these errors occur


Hyperbridge Support

Hello team, we'd like for the Mimir multi-sig wallet to add support for Hyperbridge(Nexus).
Hyperbridge uses Keccak256 hashing for its runtime.
Hyperbridge can be supported in polkadotjs by adding the following when creating the ApiPromise
typesBundle: {
      spec: {
        nexus: {
          hasher: keccakAsU8a,
        },
      },
    },

Hi,
Glad to hear from Hyperbridge^^
We will start the integration. We hope get further connection. My TG handle is @gravitinyliu

Appreciate it.


fix(app): solve nested folder structure in pages

Overview
solve nested folder structure in pages and add test.
remove OnDeviceDisplay folder
I noticed that we are missing a few page components' tests. I will follow up them in another PR.
Update a few tests that VSCode shows warnings with what Brian told us last week.
const [{ getByText }] = render()
getByText('something')

render()
screen.getByText('something')

// click() -> fireEvent.click(targetElement)

Test Plan

Changelog

move components under pages/OnDeviceDisplay to pages
update paths in tests
remove OnDeviceDisplay folder

Review requests
Do we want to keep ODDTempMenu?

Risk assessment
low

im not sure that we want to change local imports from within a module to import from the public (external) package name. and we certainly don't want to import from the public package AND reach into private directories.
i.e. from within the app, we shouldn't be doing something like this:
import { ConnectViaEthernet } from '@opentrons/app/src/pages/ConnectViaEthernet'
should either be import { ConnectViaEthernet } from '@opentrons/app' or a relative import. and i'd prefer a relative import because, well, we're importing from within the same package!
how come we're not going with relative imports anymore?

I think the paths were changed by VSCode, I will revert them.


[Enhancement] handle kubectl vars from Ansible connector.

This change allows the kubectl connector to support the same options as
Ansible's original connector.
The playbook sample comes with an example of a pod containing two containers
and checking that moving from one container to another, the version of Python
changes as expected.

@dw I tried to put everything specific to Ansible in the mitogen_ansible directory. I hope it will be OK :)


Library for Winver.h is not Mincore

Link to article:
https://docs.microsoft.com/en-us/windows/desktop/api/winver/nf-winver-getfileversioninfosizea
https://docs.microsoft.com/en-us/windows/desktop/api/winver/nf-winver-verqueryvaluea
and probably the rest of all winver pages
Problem:
The given library is wrong. It's not Mincore.lib but Version.lib
at least for VS2017 SDK8.1 nmake

Thank you @GunnarTE for your feedback -- we're looking into the issue.


Export wallet problem

I'm not exactly where the problem happens... exported walled is corrupted.
See exportWalletZip in wallet.js and exportWallet in WalletController.

Well, there is no import, so what do you expect to happen?
Also, files in ZIP are not encrypted :/

(closed wrong issue)

fixed by @BloodyRookie in 91a6341a99732bb6a5d8ed9e6426ab277ca86559

fixed in 8e3b23cb85a8886f469dddd205d1ee39b1a23f80, merged to testnet


[UI core library] Multiselect

https://zeroheight.com/11d0e6dac/p/746b74-multiselect

Create a library-agnostic component

API (extend https://formik.org/docs/api/useField#fieldinputpropsvalue)

name
value
onChange
onBlur
label
error
touched
options (as children)

Create a formik v2 wrapper

i volunteer to take this on. i dabbled in several different versions of this component in several different frameworks and there was not one of them i did not swear at. let me see if i can do better. nice challange.

@utkukaratas sure, why not. Feel free to pick it up after the Toggle

@utkukaratas please, with with @pawelklasa to get the design for the multiselect finalized.
As to the implementation, I suggest you start with copying what we have for Select and building on top of it.

@aigoncharov  my plan exactly. btw i see that everything is based on react-select so that makes the job much easier. (i thought we were doing core-ui from scratch)

@utkukaratas we are free to use any libraries we want as long as their usage is justified. Small list of dependencies is not a purpose, it is a tool to get smaller bundle size.


guide: add high-level plots guide content

Based on the comments in https://github.com/iterative/dvc.org/pull/3830, I added new high-level content to the plots guide here and compared to that PR to get feedback on whether it seems like a useful guide with that added info.

@shcheklein Should this be merged into guide-plots or into main?

@dberenbaum looks like Restyle is complaining, so this could not be merged into main. Besides that I don't have any strong preference to be honest.


LSC: Middle layer isn't getting called

There is internal bug 987737 in upstream VS that is preventing our middle layer from working.

They've fixed it.


Increase accuracy of polygon overlap - virtual resampling

Problem: you have a small polygon and geoblaze is not finding overlapping pixels with a raster with large pixels because the polygon doesn't happen to cross the pixel centerline.
Building on #156, implement a "virtual resampling" technique that breaks each raster pixel into 1 or more additional rows/columns at runtime in memory (upsample).
This could solve for #260 as well.  The tricky part is making sure that the geoblaze stats stay accurate/sane.
Geoblaze PR - https://github.com/GeoTIFF/geoblaze/pull/228

cc @DanielJDufour I created a formal issue to track this so we don't have to use the old closed performance issue.


Replace xbox360controller support with SDL_GameController

SDL2 can abstract away different axis and button indices for controllers that have the current "standard" layout (XBox, PlayStation etc). This way a lot of different game controllers on different OSs can be supported with the same config.

Nice change! This looks good.


Resource exhausted:  MemoryError: Unable to allocate

Hi, I'm getting a ResourceExhaustedError in the middle of a training and I'm assuming that shouldn't be possible. I.e., either it happens in the very first iteration, showing me my GPU doesn't have enough memory to train my model or it works until the end.
In my case, it ran fine for 46 epochs (batch size = 8, image size = (720, 1280)), then I got the error.
I'm running the code from a Jupyter notebook.
Any help is appreciated, thank you.
System information

Have I written custom code (as opposed to using a stock
example script provided in TensorFlow): Yes

OS Platform and Distribution (e.g.,
Linux Ubuntu 16.04): Windows 10

TensorFlow installed from (source or
binary): intalled from pip inside Anaconda environment

TensorFlow version (use command below): 2.2.0-dev20200401

Python version: 3.7.6

CUDA/cuDNN version:
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2019 NVIDIA Corporation
Built on Sun_Jul_28_19:12:52_Pacific_Daylight_Time_2019
Cuda compilation tools, release 10.1, V10.1.243

GPU model and memory: GeForce RTX 2080 Ti

Describe the current behavior
Getting a ResourceExhaustedError in the middle of the training (46 epochs in).
Describe the expected behavior
Expected to finish the training normally, or not work from the very first epoch.
Standalone code to reproduce the issue
Since it's not that small, I'm attaching a file.
Feel free to update my report with the code inline if more appropriate.
minimal_breaking_code.txt
Those are the entry variables:

Also, the images are 1080x1920.
Other info / logs Include any logs or source code that would be helpful to
diagnose the problem. If including tracebacks, please include the full
traceback. Large logs and files should be attached.

ResourceExhaustedError                    Traceback (most recent call last)
C:/Users/Gamer/Dropbox/Projetos/MLPython/Imports.py in
31             'balanced_training_data': False,
32             'data_augmentation': True,
---> 33             'training_data_samples': None
34         }
35     }
~\Dropbox\Projetos\Ecotrace\NewImages\Model.py in run_experiment(data_path, images_data_path, training_data, balanced_training_data, validation_data, parameters)
338             keras.callbacks.ModelCheckpoint(filepath = last_model_filepath, save_best_only = True),
339             keras.callbacks.ModelCheckpoint(filepath = best_model_filepath, save_best_only = True),
--> 340             keras.callbacks.CSVLogger(experiment_folder + '/history.csv')
341         ]
342     )
~\Anaconda3\envs\TensorFlow-nightly\lib\site-packages\tensorflow\python\keras\engine\training.py in _method_wrapper(self, *args, **kwargs)
69   def _method_wrapper(self, *args, **kwargs):
70     if not self._in_multi_worker_mode():  # pylint: disable=protected-access
---> 71       return method(self, *args, **kwargs)
72
73     # Running inside run_distribute_coordinator already.
~\Anaconda3\envs\TensorFlow-nightly\lib\site-packages\tensorflow\python\keras\engine\training.py in fit(self, x, y, batch_size, epochs, verbose, callbacks, validation_split, validation_data, shuffle, class_weight, sample_weight, initial_epoch, steps_per_epoch, validation_steps, validation_batch_size, validation_freq, max_queue_size, workers, use_multiprocessing, **kwargs)
940               workers=workers,
941               use_multiprocessing=use_multiprocessing,
--> 942               return_dict=True)
943           val_logs = {'val_' + name: val for name, val in val_logs.items()}
944           epoch_logs.update(val_logs)
~\Anaconda3\envs\TensorFlow-nightly\lib\site-packages\tensorflow\python\keras\engine\training.py in _method_wrapper(self, *args, **kwargs)
69   def _method_wrapper(self, *args, **kwargs):
70     if not self._in_multi_worker_mode():  # pylint: disable=protected-access
---> 71       return method(self, *args, **kwargs)
72
73     # Running inside run_distribute_coordinator already.
~\Anaconda3\envs\TensorFlow-nightly\lib\site-packages\tensorflow\python\keras\engine\training.py in evaluate(self, x, y, batch_size, verbose, sample_weight, steps, callbacks, max_queue_size, workers, use_multiprocessing, return_dict)
1171             with trace.Trace('TraceContext', graph_type='test', step_num=step):
1172               callbacks.on_test_batch_begin(step)
-> 1173               tmp_logs = test_function(iterator)
1174               if data_handler.should_sync:
1175                 context.async_wait()
~\Anaconda3\envs\TensorFlow-nightly\lib\site-packages\tensorflow\python\eager\def_function.py in call(self, *args, **kwds)
606         xla_context.Exit()
607     else:
--> 608       result = self._call(*args, **kwds)
609
610     if tracing_count == self._get_tracing_count():
~\Anaconda3\envs\TensorFlow-nightly\lib\site-packages\tensorflow\python\eager\def_function.py in _call(self, *args, **kwds)
644       # In this case we have not created variables on the first call. So we can
645       # run the first trace but we should fail if variables are created.
--> 646       results = self._stateful_fn(*args, **kwds)
647       if self._created_variables:
648         raise ValueError("Creating variables on a non-first call to a function"
~\Anaconda3\envs\TensorFlow-nightly\lib\site-packages\tensorflow\python\eager\function.py in call(self, *args, **kwargs)
2418     with self._lock:
2419       graph_function, args, kwargs = self._maybe_define_function(args, kwargs)
-> 2420     return graph_function._filtered_call(args, kwargs)  # pylint: disable=protected-access
2421
2422   @property
~\Anaconda3\envs\TensorFlow-nightly\lib\site-packages\tensorflow\python\eager\function.py in _filtered_call(self, args, kwargs)
1663          if isinstance(t, (ops.Tensor,
1664                            resource_variable_ops.BaseResourceVariable))),
-> 1665         self.captured_inputs)
1666
1667   def _call_flat(self, args, captured_inputs, cancellation_manager=None):
~\Anaconda3\envs\TensorFlow-nightly\lib\site-packages\tensorflow\python\eager\function.py in _call_flat(self, args, captured_inputs, cancellation_manager)
1744       # No tape is watching; skip to running the function.
1745       return self._build_call_outputs(self._inference_function.call(
-> 1746           ctx, args, cancellation_manager=cancellation_manager))
1747     forward_backward = self._select_forward_and_backward_functions(
1748         args,
~\Anaconda3\envs\TensorFlow-nightly\lib\site-packages\tensorflow\python\eager\function.py in call(self, ctx, args, cancellation_manager)
596               inputs=args,
597               attrs=attrs,
--> 598               ctx=ctx)
599         else:
600           outputs = execute.execute_with_cancellation(
~\Anaconda3\envs\TensorFlow-nightly\lib\site-packages\tensorflow\python\eager\execute.py in quick_execute(op_name, num_outputs, inputs, attrs, ctx, name)
58     ctx.ensure_initialized()
59     tensors = pywrap_tfe.TFE_Py_Execute(ctx._handle, device_name, op_name,
---> 60                                         inputs, attrs, num_outputs)
61   except core._NotOkStatusException as e:
62     if name is not None:
ResourceExhaustedError: 2 root error(s) found.
(0) Resource exhausted:  MemoryError: Unable to allocate 10.5 MiB for an array with shape (720, 1280, 3) and data type float32
Traceback (most recent call last):
File "C:\Users\Gamer\Anaconda3\envs\TensorFlow-nightly\lib\site-packages\tensorflow\python\ops\script_ops.py", line 243, in call
ret = func(*args)
File "C:\Users\Gamer\Anaconda3\envs\TensorFlow-nightly\lib\site-packages\tensorflow\python\autograph\impl\api.py", line 309, in wrapper
return func(*args, **kwargs)
File "C:\Users\Gamer\Anaconda3\envs\TensorFlow-nightly\lib\site-packages\tensorflow\python\data\ops\dataset_ops.py", line 784, in generator_py_func
values = next(generator_state.get_iterator(iterator_id))
File "C:\Users\Gamer\Anaconda3\envs\TensorFlow-nightly\lib\site-packages\tensorflow\python\keras\engine\data_adapter.py", line 816, in wrapped_generator
for data in generator_fn():
File "C:\Users\Gamer\Anaconda3\envs\TensorFlow-nightly\lib\site-packages\tensorflow\python\keras\utils\data_utils.py", line 1022, in get
six.reraise(*sys.exc_info())
File "C:\Users\Gamer\AppData\Roaming\Python\Python37\site-packages\six.py", line 693, in reraise
raise value
File "C:\Users\Gamer\Anaconda3\envs\TensorFlow-nightly\lib\site-packages\tensorflow\python\keras\utils\data_utils.py", line 998, in get
inputs = self.queue.get(block=True).get()
File "C:\Users\Gamer\Anaconda3\envs\TensorFlow-nightly\lib\multiprocessing\pool.py", line 657, in get
raise self._value
File "C:\Users\Gamer\Anaconda3\envs\TensorFlow-nightly\lib\multiprocessing\pool.py", line 121, in worker
result = (True, func(*args, **kwds))
File "C:\Users\Gamer\Anaconda3\envs\TensorFlow-nightly\lib\site-packages\tensorflow\python\keras\utils\data_utils.py", line 932, in next_sample
return six.next(_SHARED_SEQUENCES[uid])
File "C:\Users\Gamer\Anaconda3\envs\TensorFlow-nightly\lib\site-packages\keras_preprocessing\image\iterator.py", line 104, in next
return self.next(*args, **kwargs)
File "C:\Users\Gamer\Anaconda3\envs\TensorFlow-nightly\lib\site-packages\keras_preprocessing\image\iterator.py", line 116, in next
return self._get_batches_of_transformed_samples(index_array)
File "C:\Users\Gamer\Anaconda3\envs\TensorFlow-nightly\lib\site-packages\keras_preprocessing\image\iterator.py", line 231, in _get_batches_of_transformed_samples
x = img_to_array(img, data_format=self.data_format)
File "C:\Users\Gamer\Anaconda3\envs\TensorFlow-nightly\lib\site-packages\keras_preprocessing\image\utils.py", line 299, in img_to_array
x = np.asarray(img, dtype=dtype)
File "C:\Users\Gamer\Anaconda3\envs\TensorFlow-nightly\lib\site-packages\numpy\core_asarray.py", line 85, in asarray
return array(a, dtype, copy=False, order=order)
MemoryError: Unable to allocate 10.5 MiB for an array with shape (720, 1280, 3) and data type float32
 [[{{node PyFunc}}]]

Hint: If you want to see a list of allocated tensors when OOM happens, add report_tensor_allocations_upon_oom to RunOptions for current allocation info.
 [[IteratorGetNext]]

Hint: If you want to see a list of allocated tensors when OOM happens, add report_tensor_allocations_upon_oom to RunOptions for current allocation info.
(1) Resource exhausted:  MemoryError: Unable to allocate 10.5 MiB for an array with shape (720, 1280, 3) and data type float32
Traceback (most recent call last):
File "C:\Users\Gamer\Anaconda3\envs\TensorFlow-nightly\lib\site-packages\tensorflow\python\ops\script_ops.py", line 243, in call
ret = func(*args)
File "C:\Users\Gamer\Anaconda3\envs\TensorFlow-nightly\lib\site-packages\tensorflow\python\autograph\impl\api.py", line 309, in wrapper
return func(*args, **kwargs)
File "C:\Users\Gamer\Anaconda3\envs\TensorFlow-nightly\lib\site-packages\tensorflow\python\data\ops\dataset_ops.py", line 784, in generator_py_func
values = next(generator_state.get_iterator(iterator_id))
File "C:\Users\Gamer\Anaconda3\envs\TensorFlow-nightly\lib\site-packages\tensorflow\python\keras\engine\data_adapter.py", line 816, in wrapped_generator
for data in generator_fn():
File "C:\Users\Gamer\Anaconda3\envs\TensorFlow-nightly\lib\site-packages\tensorflow\python\keras\utils\data_utils.py", line 1022, in get
six.reraise(*sys.exc_info())
File "C:\Users\Gamer\AppData\Roaming\Python\Python37\site-packages\six.py", line 693, in reraise
raise value
File "C:\Users\Gamer\Anaconda3\envs\TensorFlow-nightly\lib\site-packages\tensorflow\python\keras\utils\data_utils.py", line 998, in get
inputs = self.queue.get(block=True).get()
File "C:\Users\Gamer\Anaconda3\envs\TensorFlow-nightly\lib\multiprocessing\pool.py", line 657, in get
raise self._value
File "C:\Users\Gamer\Anaconda3\envs\TensorFlow-nightly\lib\multiprocessing\pool.py", line 121, in worker
result = (True, func(*args, **kwds))
File "C:\Users\Gamer\Anaconda3\envs\TensorFlow-nightly\lib\site-packages\tensorflow\python\keras\utils\data_utils.py", line 932, in next_sample
return six.next(_SHARED_SEQUENCES[uid])
File "C:\Users\Gamer\Anaconda3\envs\TensorFlow-nightly\lib\site-packages\keras_preprocessing\image\iterator.py", line 104, in next
return self.next(*args, **kwargs)
File "C:\Users\Gamer\Anaconda3\envs\TensorFlow-nightly\lib\site-packages\keras_preprocessing\image\iterator.py", line 116, in next
return self._get_batches_of_transformed_samples(index_array)
File "C:\Users\Gamer\Anaconda3\envs\TensorFlow-nightly\lib\site-packages\keras_preprocessing\image\iterator.py", line 231, in _get_batches_of_transformed_samples
x = img_to_array(img, data_format=self.data_format)
File "C:\Users\Gamer\Anaconda3\envs\TensorFlow-nightly\lib\site-packages\keras_preprocessing\image\utils.py", line 299, in img_to_array
x = np.asarray(img, dtype=dtype)
File "C:\Users\Gamer\Anaconda3\envs\TensorFlow-nightly\lib\site-packages\numpy\core_asarray.py", line 85, in asarray
return array(a, dtype, copy=False, order=order)
MemoryError: Unable to allocate 10.5 MiB for an array with shape (720, 1280, 3) and data type float32
 [[{{node PyFunc}}]]

Hint: If you want to see a list of allocated tensors when OOM happens, add report_tensor_allocations_upon_oom to RunOptions for current allocation info.
 [[IteratorGetNext]]

Hint: If you want to see a list of allocated tensors when OOM happens, add report_tensor_allocations_upon_oom to RunOptions for current allocation info.
 [[IteratorGetNext/_4]]

Hint: If you want to see a list of allocated tensors when OOM happens, add report_tensor_allocations_upon_oom to RunOptions for current allocation info.
0 successful operations.
0 derived errors ignored. [Op:__inference_test_function_16419]
Function call stack:
test_function -> test_function

@rodrigoruiz In order to expedite the trouble-shooting process, please provide a code snippet to reproduce the issue reported here. Thanks!

@saikumarchalla I edited the initial report adding the code.
Not sure how to remove the stat:awaiting response label.

@rodrigoruiz Could you please share the data as it helps us to reproduce the issue.

@saikumarchalla unfortunately I can’t since it’s  another company’s data, but I imagine the same problem will occur with any set of imagens of the same size.

@saikumarchalla Also, I don't think it's a performance issue, since it works for a few epochs, I think it's more like a memory leak.

@saikumarchalla any update on this?

@rodrigoruiz  Apologies for the delay in response. Memory error indicates that the process has consumed all of the ram memory. You may want to reduce the batch size/image size and try again.

@ymodak To elaborate, there are two things that makes me think that is not the issue:

this same network used to work in Keras with TensorFlow 1.
the memory runs or after about 45 epoch. If the batch or network size was the problem, it should fail at the very beginning of training.

We need a minimum repro example to validate this behavior and troubleshoot further. Perhaps if you can build a toy example to reproduce this behavior will be much appreciated. Thanks for the issue.

@ymodak the minimum repro example is attached as a txt file in the issue (minus the images, because I'm not allowed to provide those, but as I said before, any image of the same size should do).

@rodrigoruiz Could you help to format the repro code into colab with some synthetic input data? This will help a lot to debug the issue. Thanks!

I am having the same problem

I'm having the same problem with TF 2.2.
The training process happened after about 120 epoches.
My input size is 6406403.
When training, the used RAM by the python process increases slowly from about 4G to 7.3G, and finally end up with the MemoryError.
It's definitely not a memory leak. I think its a bug in TF.

@rodrigoruiz If the issue still persists, can you please provide with some synthetic input data as requested in issuecomment-642836301 or else can you please close the issue?

Since there is no activity, closing the issue. Please reopen it if you the issue persists..

I'm having the same problem with TF 2.4.0rc3
I can reproduce this problem on my PC for sure.
Anaconda python 3.7
Windows 10
GPU RTX 3090 24GB
Total memory 96GB
Tensorflow 2.4.0rc3 and CUDA11 and cuDNN 8.0.2
When the problem occurred, I had 70GB of RAM and 5GB of video memory left on my system. But "Unable to allocate 735. MiB".
I exported a subset of the code and data used to reproduce the problem.
For code and data, please see: https://github.com/liasece/tf-38414
To hide this problem, simply reduce frozen_batch_size from 64 to 32, i.e., reduce the batch size.
@ymodak @geetachavan1


Add docs for DataParameter for default=today()

This is one thing I've needed to look up a gazillion times, but I've always looked at other code and never consulted the docs. By documenting this, newcomers will hopefully will find this easier.

Merging already, as this is best reviewed as a rendered page on readthedocs.


Please consider fixing issues detected by repository checker

Notification from ioBroker Check and Service Bot
Dear adapter developer,
I'm the ioBroker Check and Service Bot. I'm an automated tool processing routine tasks for the ioBroker infrastructure. I have recently checked the repository for your adapter opi for common errors and appropiate suggestions to keep this adapter up to date.
This check is based the current head revisions (master / main  branch) of the adapter repository
Please see the result of the check below.
ioBroker.opi
   -
ERRORS:

[ ] :heavy_exclamation_mark: [E019] Invalid repository URL in package.json: https://github.com/ioBroker/ioBroker.opi. Expected: git@github.com:iobroker-community-adapters/ioBroker.opi.git or https://github.com/iobroker-community-adapters/ioBroker.opi.git
[ ] :heavy_exclamation_mark: [E032] No dependency declared for @iobroker/adapter-core. Please add "@iobroker/adapter-core":"3.1.6" to dependencies at package.json
[ ] :heavy_exclamation_mark: [E036] @iobroker/testing 4.1.1 specified. 4.1.3 is required as minimum,  4.1.3 is recommended. Please update devDependencies at package.json
[ ] :heavy_exclamation_mark: [E150] No "common.connectionType" found in io-package.json
[ ] :heavy_exclamation_mark: [E152] No "common.dataSource" found in io-package.json
[ ] :heavy_exclamation_mark: [E204] Version "0.0.1" listed at common.news at io-package.json does not exist at NPM. Please remove from news section.
[ ] :heavy_exclamation_mark: [E606] Current adapter version 0.1.2 not found in README.md
[ ] :heavy_exclamation_mark: [E802] No topics found in the repository. Please go to "https://github.com/iobroker-community-adapters/ioBroker.opi", press the settings button beside the about title and add some topics.
[ ] :heavy_exclamation_mark: [E852] .npmignore not found

WARNINGS:

[ ] :eyes: [W105] Missing suggested translation into uk of "common.titleLang" in io-package.json.
[ ] :eyes: [W109] Missing suggested translation into uk of "common.desc" in io-package.json.
[ ] :eyes: [W113] Adapter should support compact mode
[ ] :eyes: [W145] Missing suggested translation into uk of some "common.news" in io-package.json.
[ ] :eyes: [W170] "common.keywords" should not contain "iobroker, adapter, smart home" io-package.json
[ ] :eyes: [W184] "common.main" is deprecated and ignored. Please remove from io-package.json. Use "main" at package.json instead.
[ ] :eyes: [W184] "common.materialize" is deprecated for admin >= 5 at io-package.json. Please use property "adminUI".
[ ] :eyes: [W504] setInterval found in "main.js", but no clearInterval detected

SUGGESTIONS:

[ ] :pushpin: [S522] Please consider migrating to admin 5 UI (jsonConfig).

Please review issues reported and consider fixing them as soon as appropiate.
Errors reported by repository checker should be fixed as soon as possible. Some of them require a new release to be considered as fixed. Please note that errors reported by checker might be considered as blocking point for future updates at stable repository.
Warnings reported by repository checker should be reviewed. While some warnings can be ignored due to good reasons or a dedicated decision of the developer, most warnings should be fixed as soon as appropiate.
Suggestions reported by repository checker should be reviewed. Suggestions can be ignored due to a decision of the developer but they are reported as a hint to use a configuration which might get required in future or at least is used be most adapters. Suggestions are always optional to follow.
You may start a new check at any time by adding the following comment to this issue:
@iobroker-bot recheck
Please note that I (and the server at GitHub) have always plenty of work to do. So it may last up to 30 minutes until you see a reaction. I will drop a comment here as soon as I start processing.
Feel free to contact me (@iobroker-bot) if you have any questions or feel that an issue is incorrectly flagged.
And THANKS A LOT for maintaining this adapter from me and all users.
Let's work together for the best user experience.
your
ioBroker Check and Service Bot
@mcm1957 for evidence
Last update at Fri, 06 Sep 2024 09:42:10 GMT

Issue outdated due to RECREATE request. Follow up issue #133 has been created.
This issue will be closed.
your
ioBroker Check and Service Bot


Add Not Equal clause?

Could a not equal clause be added to the Clause predicate? - https://ent-docs.onrender.com/docs/advanced-topics/clause.
It doesn't appear to be currently and it's supported (by Postgres at least, and I assume sqlite as well).

https://github.com/lolopinto/ent/pull/429


AnimationPlayer bezier editor crash when using undo

Tested versions
4.3 f8a2a9193662b2e8c1d04d65e647399dee94f31e
System information
Windows 10.0.19045 - Vulkan (Forward+) - dedicated NVIDIA GeForce GTX 1060 (NVIDIA; <IP_ADDRESS>3) - Intel(R) Core(TM) i7-7700HQ CPU @ 2.80GHz (8 Threads)
Issue description
CrashHandlerException: Program crashed
Engine version: Godot Engine v4.3.dev.custom_build (f8a2a9193662b2e8c1d04d65e647399dee94f31e)
Dumping the backtrace. Please include this when reporting the bug to the project developer.
[0] CowData<Animation::Track *>::_get_size (C:\godot_source\core\templates\cowdata.h:81)
[1] CowData<Animation::Track *>::size (C:\godot_source\core\templates\cowdata.h:134)
[2] Vector<Animation::Track *>::size (C:\godot_source\core\templates\vector.h:93)
[3] Animation::get_track_count (C:\godot_source\scene\resources\animation.cpp:972)
[4] AnimationTrackEditor::_key_selected (C:\godot_source\editor\animation_track_editor.cpp:5083)
[5] call_with_variant_args_helper<AnimationTrackEditor,int,bool,int,0,1,2> (C:\godot_source\core\variant\binder_common.h:308)
[6] call_with_variant_args<AnimationTrackEditor,int,bool,int> (C:\godot_source\core\variant\binder_common.h:418)
[7] CallableCustomMethodPointer<AnimationTrackEditor,int,bool,int>::call (C:\godot_source\core\object\callable_method_pointer.h:99)
[8] Callable::callp (C:\godot_source\core\variant\callable.cpp:58)
[9] CallQueue::_call_function (C:\godot_source\core\object\message_queue.cpp:222)
[10] CallQueue::flush (C:\godot_source\core\object\message_queue.cpp:328)
[11] SceneTree::physics_process (C:\godot_source\scene\main\scene_tree.cpp:473)
[12] Main::iteration (C:\godot_source\main\main.cpp:3750)
[13] OS_Windows::run (C:\godot_source\platform\windows\os_windows.cpp:1474)
[14] widechar_main (C:\godot_source\platform\windows\godot_windows.cpp:182)
[15] _main (C:\godot_source\platform\windows\godot_windows.cpp:204)
[16] main (C:\godot_source\platform\windows\godot_windows.cpp:218)
[17] WinMain (C:\godot_source\platform\windows\godot_windows.cpp:232)
[18] __scrt_common_main_seh (D:\a\_work\1\s\src\vctools\crt\vcstartup\src\startup\exe_common.inl:288)
[19] <couldn't map PC to fn name>
-- END OF BACKTRACE --

Steps to reproduce

Add AnimationPlayer
Add a bezier track and insert some key
Switch to bezier
Do something with the key (change it idk)
Delete AnimationPlayer
Undo

Exact steps are not obvious determine, but it's something like that.
Minimal reproduction project (MRP)
N/A

I was not able to reproduce this in 4.3-beta2

I can still reproduce. Here's a video, in case instructions were unclear:
https://github.com/godotengine/godot/assets/2223172/73544601-40fc-42ba-b7a9-8d3170e08ed4

Thank you, now I have been able to reproduce it. Digging a little into it, I found that it stems from the step // 7-reselect in gui_input() in the animation bezier editor. Commenting out the lines to do undo and redo of the selection in the loop, the crash does not happen anymore.


Add CI

@gcochard, would you mind cherry-picking your commits for this? I can't pull directly from https://github.com/sindresorhus/github-notifier-chrome/compare/master...gcochard:master, because of the squashed merge of #18.
I'd like to work on #12 soon, and it would be much easier if the CI had my back.

Will do this today or tonight :smile:

How would you test code using Chrome Extensions APIs with a CI?

I have most of the chrome extension APIs mocked out. I will then simply call the handler function and ensure the correct method calls occurred. I plan to mock out the gh api responses as well, so that we can ensure the badge API is called with the proper values for 0, 1, many, etc.

Ah, sounds good :)

Closed via #24


Why do we differentiate preview open files with italic font?

VSCode Version:1.3.0-insiders
OS Version:Windows 7

I'm not sure there is benefit differentiating preview open file (with italic font) from fully opened files. What information does this give the user and how would they act on it?
Italics in the heading doesn't look good on some lower resolution monitors.

@gregvanl see https://github.com/Microsoft/vscode-docs/blob/vnext/release-notes/June_2016.md#preview-editors

We do this so that users aren't surprised when the content of a file they are looking at is replaced with the content of a new file that they single click on. We think that we need to distinguish these files. Doing so is a common pattern - Sublime Text italicizes these files and Visual Studio positions them to the far right of the document well. Knowing that a file is open in a preview tab would then let the user know that if they want to keep it open they have to take another action (the keep open action).
One question is whether or not italics is the best way to communicate this to users. A challenge we have though is that we don't want this to require significant UI management or overhead. We do not want to distract the user from focusing on their content.

One last update: Greg and I verified that the bad italic screenshot above was due to ClearType not being enabled by default on Windows Server 2008 (the OS he was using).  On this particular OS, you must enable it manually, probably because it's not typical desktop machine but is meant to be tuned to be a server.
I don't think this will be a common scenario.  We should be fine with continuing with italic usage, and since it's a pattern used elsewhere, I think it's appropriate.

@stevencl are there a way to never open "italic" file window (I open file by cmd+p shortcut, so no way to double click)? I find the "italic" file window annoying because in most of the time I would like the window I opened be there. And I close what I want to close manually. Thanks!

"workbench.editor.enablePreview": false

@bpasero THANKKK YOUUUUU. I loathe this feature in Visual Studio, and equally as much as VSCode. If I had to choose a single setting to put in my user settings, this would be it. Nothing more infuriating than code files closing when I click somewhere else. I don't mind inline preview windows (the idea of previewing is definitely powerful), but having "preview" tabs that disappear is one of the worst/most unintuitive UI decisions ever made by the VS team (or whatever other application they borrowed the idea from).
That said, making every setting easily overridable via one big, searchable text file is easily one of the best decisions ever made because it totally negates all of my hostility toward settings I don't like. 👍

Note to others seeing this: the keybind workbench.action.keepEditor allows you to convert a preview editor to a main editor. If your workflow requires you to dig deep into codebases (e.g. following chains of definitions) and you want to save your current point as a tab before moving into the next file WITHOUT having a tab for every file you touch in the chain, keeping previews on but committing that keybind to memory is an excellent sanity saver.


Role bindings

Historically there have been 4 "scopes" (roles) in Pachyderm: reader, writer, owner and admin. These roles mapped into a number of permissions: owners can modify ACLs and delete a repo, while writers can add files and edit pipeline specs, and readers can list, view and inspect files. Roles were enforced in a somewhat ad-hoc way - for instance, the spec repo was special-cased to be world-readable, or the PPS user was special-cased to be a cluster admin. We had the notion of an FS admin, which was Owner but on the entire cluster.
This PR has two goals:

Role bindings are standardized across all nouns. "Cluster roles" and "repo roles" are represented and evaluated the same way. Cluster role bindings are cached because they're commonly used, and there's a hierarchical relationship (cluster bindings apply to all repos). When we add "projects" as a new noun, it will be simple to extend this system to a three-tiered hierarchy and add new permissions that apply to projects.
More granular, customizable roles are possible. The FS Admin role was a one-off solution to give all users access to edit ACLs but not to modify cluster configuration. Custom roles open the door to more user stories like "an operator can view logs for all pipelines and start and stop jobs, but not view the files or modify the job specifications". Or allowing users to view pachd logs but not to change OIDC configuration, etc.

Conceptually, the way role bindings work is:

There's a set of operations users can perform on different nouns (listing files, deleting a repo, stopping a pipeline). Each of these operations has a corresponding Permission.
Permissions are grouped together into Roles, which are identified by a string.
Every noun in the system, called a Resource, (right now this means repos and the cluster itself) has a set of RoleBindings which are a map of <principal, list of roles>.
To evaluate whether a principal can perform an operation on a Resource, we check the set of Permissions required for that operation against all of the Roles that principal has bound on the Resource, as well as Roles that the principal's groups have bound, and also the Roles the principal and groups have bound to any parent Resources (the cluster is a parent to all repos, eventually Projects will be parents to repos and clusters will be parents to Projects). If the set of Permissions is satisfied by some combination of the RoleBindings, then the operation is allowed.

Yeah I don't love it either. Maybe this isn't what you meant, but the problem I could never figure out is, if pipelines are resources in and of themselves, how should pachd decide whether it's OK to create a pipeline, since the pipeline inputs aren't stored anywhere except in the CreatePipelineRequest? Mapping a PipelineInfo to a bunch of auth requests on its inputs was kind of a workaround, but it does put a fair amount of auth logic in PPS. I mean I kind of wondered if we should just allow people to create a pipeline that consumes repos they can't read, and then let their pipeline fail, but that seems like bad UX?

So my thinking on this is - right now the Reader role on a repo implicitly includes a permission that means "you can add a pipeline as a reader on this repo". If we pulled that out as a separate permission and RPC, then you could get the auth check for free on the input repos when you called AddPipelineAsReaderToRoleBindings(<pipeline>, <repo>).

Just checking: this just affects Authenticate()? FWIW, the main reason we only disable login (on license expiration) in 1.x is so that pipelines keep running. In other words, if a production user of Pachyderm forgets to renew their license, we didn't want to break production for them, but we did want to put them in a state where the only way to keep using Pachyderm is to give everyone admin creds, thus effectively undermining auth.

The behaviour here is intended to be that when the enterprise token expires, only the root user and pipelines can perform any RPCs against the cluster - pipelines keep running and the root user can disable auth or renew the license, but that's it.

Also, would you need to be the root user to re-activate your license? TBH, I think the odds are decent that someone locks themselves out of their cluster by losing their root token and letting their license expire. If they can get a two-week trial license from us (which I think just requires an email) and reactivate enterprise long enough to deactivate auth (which I think would clear the root token?) then that seems like an OK enough escape hatch.

This is interesting - we could include a carve-out to allow any user to activate with a new enterprise license, even if the license is expired. I think in general with concerns about "what if the user loses the root token" my response is two-fold: (a) a lot of stuff can go wrong and this is the escape hatch, so we need to emphasize the importance of the root token in the docs and CLI (b) users can always do postgres surgery to make a new root token if they really lose it. The root token isn't used to encrypt any data or anything, there's always a manual process where someone can recover their cluster.

Also I think ideally the error message should tell them they can keep using Pachyderm by using the root token.

Agree, I'll change this.

So my thinking on this is - right now the Reader role on a repo implicitly includes a permission that means "you can add a pipeline as a reader on this repo". If we pulled that out as a separate permission and RPC, then you could get the auth check for free on the input repos when you called AddPipelineAsReaderToRoleBindings(<pipeline>, <repo>).

Oh, interesting. I mean this makes sense to me. Getting rid of the superuser token would definitely be cool. We might still need some version of authorizePipelineOp, just because we'd presumably want to check all input repos before changing any of them, but maybe we could do some kind of batch-ModifyRoleBindings request that could do all of the auth checks before making any changes? Just an idea. Basically this sounds great

The behaviour here is intended to be that when the enterprise token expires, only the root user and pipelines can perform any RPCs against the cluster - pipelines keep running and the root user can disable auth or renew the license, but that's it. We might need to engage with the customer team to understand what "enterprise license is expired" should look like.

Makes sense. That proposed behavior does fit my product intuition—I guess I was just worried about the pipelines part, and just didn't totally understand how it worked previously

This is interesting - we could include a carve-out to allow any user to activate with a new enterprise license, even if the license is expired. I think in general with concerns about "what if the user loses the root token" my response is two-fold: (a) a lot of stuff can go wrong and this is the escape hatch, so we need to emphasize the importance of the root token in the docs and CLI (b) users can always do postgres surgery to make a new root token if they really lose it. The root token isn't used to encrypt any data or anything, there's always a manual process where someone can recover their cluster.

Yeah, this makes total sense to me. I have done the equivalent etcd surgery to unlock a cluster for at least one user, so your point that that's always an option is well-taken. I guess one thought I've had in the past: if we come back around to encrypting all internal communication with mTLS, does that remove the ability to do postgres surgery? Maybe emergency surgey is just the backup plan to stick with, though, and we should just make sure to support emergency surgery as a use-case when we get around to internal mTLS? Like preserve the ability to mint new TLS certs if the cluster administrator is OK with it or something? Maybe certmanager has some kind of feature for that.

For some reason I can't reply to some of the comments (maybe they're on individual commits versus the PR itself?)

This makes sense. Just checking my understanding of one piece of all this: this PR gets rid of the FS cluster role—is that replaced with binding a user to the repoOwner role, but at the cluster level?

Correct, one of the goals of moving to all role-bindings is to make the roles composable like this, so we don't need to special-case "user who can read every repo in the cluster/project". Assigning repoReader at the project or cluster level applies to all repos in that project/cluster.

@msteffen Following up on our discussion this morning, I made a couple small changes:

The enterprise license check now only happens in Authenticate, so basically any existing user/pipeline can continue to work but new users can't log in. I'll follow up with the customer team about how we want this to behave in 2.0 GA.
I removed the DeleteRoleBinding RPC and made it just an in-process method call from PFS. I'd like to adopt this pattern more generally in transactionenv, so we have clearly "internal only" methods.


Remove 'all-in-one' in last remaining IO and tests

Fixes #1197.
In draft because I need to see which tests fail so I can fix the tests for the removal of this mode.

the more I look at this the more it seems like this has just become a feature of the ascii IO. I think we close this PR and close the associated issue and just say that ascii io has the two options.

Let's reassess this at another time. Let me close this one.


author: Lynn Fisher | url: lynnandtonic.com

data: dev-rakeshshaw
Portfolio Author

Lynn Fisher
Portfolio Link?

https://lynnandtonic.com
GitHub Link:

https://github.com/lynnandtonic
Tech Stack

HTML5, CSS, JavaScript, SVG, Netlify

Hello @dev-rakeshshaw, thanks for raising another PR. In case of next time, kindy link to the portfolio repo if its available, rather than their profile.
I've already made the change. Here's the actual portfolio repo: https://github.com/lynnandtonic/lynnandtonic.com

Thanks Brother. I will keep that in mind.

Also, can you check the portfolio repo again, and add the other technologies used? Thanks!

Ya Sure let me check using wappalyzer

Also, can you check the portfolio repo again, and add the other technologies used? Thanks!

Done Brother. I have added the other technologies used to build the Portfolio "lynnandtonic.com".
Sorry I was not aware of Wappalyzer so some technologies were left out. It will not happen again.

Also, can you check the portfolio repo again, and add the other technologies used? Thanks!

Done Brother. I have added the other technologies used to build the Portfolio "lynnandtonic.com". Sorry I was not aware of Wappalyzer so some technologies were left out. It will not happen again.

Great! It's not a problem at all 👍

Good job @dev-rakeshshaw

Thanks, Brother.
It`s great to learn in public.


Check Windows installation

Discussed in https://github.com/ClimateMind/climatemind-backend/discussions/446

Originally posted by Nehemiah60 November  7, 2022
I am not sure but I think there should be updates on the installation guide. On my windows machine, all the containers were running but the api-1 would exit almost instantly. The log files showed the error: /usr/bin/env bash\r: No such file or directory. I had to research and the solution was to use a windows Ubuntu Subsystem to clone the repo.

@Nehemiah60 looks like you were right, we just need some documentation update. There's a note for Windows users about autocrlf
The thing is you need to set this git config --global first, and only then git clone repository.
I recommend you do the following:

rm -Recurse -Force .\climatemind-backend\
git config --global core.autocrlf false
git clone https://github.com/ClimateMind/climatemind-backend.git
cd climatemind-backend
docker-compose -p climatemind-backend --profile webapp -f docker/docker-compose.yml up -d --build

@Nehemiah60 the docs updated
Thank you for reporting this! I really appreciate this 👍

That is great. I will embark on working on the assigned issue.


Tell users what to do with "AccessDenied" exceptions

As per - http://stackoverflow.com/questions/1987749/why-do-i-get-accessdenied-when-trying-to-use-httplistener

Hi @avanderhoorn, I'm your friendly neighborhood .NET Foundation Pull Request Bot (You can call me DNFBOT). Thanks for your contribution!

In order for us to evaluate and accept your PR, we ask that you sign a contribution license agreement. It's all electronic and will take just minutes. I promise there's no faxing. https://cla2.dotnetfoundation.org.

TTYL, DNFBOT;

Not sure this build error has to do with me... seems to be a psake problem?

@avanderhoorn, Thanks for signing the contribution license agreement so quickly! Actual humans will now validate the agreement and then evaluate the PR.
Thanks, DNFBOT;

Or just change it to http://localhost:12345/, that doesn't require an acl.

I'm happy with either approach, what would you prefer?

localhost


added Rant class

This makes functions like getRants() return an array of Rant objects rather than the server's raw JSON in array form. Also, the function postNewRant() has been changed to rant() which now accepts one parameter, a Rant object, whose constructor takes two parameters: your rant text (string) and the tags that go with it (array of strings).

I'm done for now. I'll let the other interested devs take their shot at it.

Added a description above - hopefully it's helpful.

Will merge this in when I get to a PC. :smile: Currently away from pretty much any device.


Check Java versions also for non-Oracle Java: Fix #1056

This PR tries to fix #1056. Can you have a look, @sakama @kamatama41 @hiroyuki-sato ?
I assume that the names (java or openjdk) are lower-case alphabets. When we see other cases, we'll have another fix.

OS: macOS 10.13.6
Embulk version: 555dabeab
Java: openjdk full version "11.0.1+13"

Version check works correctly, But I got the following error.
%./embulk-0.9.9-SNAPSHOT.jar
[WARN] Embulk does not guarantee running with Java 11.
[WARN] Executing Java with: "--add-modules java.xml.bind --add-modules=java.se.ee"

OpenJDK 64-Bit Server VM warning: Option AggressiveOpts was deprecated in version 11.0 and will likely be removed in a future release.
Error occurred during initialization of boot layer
java.lang.module.FindException: Module java.se.ee not found

% java -fullversion
openjdk full version "11.0.1+13"

@hiroyuki-sato Ah, got it. It looks because java.se.ee is removed from pre-install since Java 11.
http://openjdk.java.net/jeps/320
It would need changing packaging of the Embulk core, and that is not in our scope for the time being. I now think about removing Java 11 support from the script for the time being.

Thanks! Merging it.


add functionalities to automatically discard completed points

The purpose of this pull request is to add functionalities to interactive map, so that when loading completed points from user cfg, points with resources already regenerated will be ignored. This improves the user's experience so that there is no need to reset all completed points every time.
The source of regeneration time is wikipedia, therefore the current data may not be accurate. Investigation points may have different regenerate time based on their yields, so it may be better to just ignore them.
This pull request is based on older version of the code, but there should be no conflict.
An alternative approach other than modifying all the map files is to add another file specifying global labels and categories, as categories and label ids are shared across all scenes.
i would like to hear feedback from you, as I am not familiar with C++ and my code could be problematic. Thank you for your hard work!

I was sent e-mail to Akebi-GC contributor memetrollsXD.
Waiting for reply.
Don't worry.


Please publish compiled typescript types instead of pointing to the uncompiled src - should fix many issues.

Jodit Version:  3.7.2
TypeScript:  4.4.2
Code
import type { IJodit } from "jodit";

Expected behavior
No TypeScript errors when importing types of Jodit.
Actual behavior
tsc:
node_modules/jodit/src/core/selection/style/apply-style.ts:365:9 - error TS2339: Property 'nodeName' does not exist on type 'never'.

365     elm.nodeName.toLowerCase() !== this.style.defaultTag);
            ~~~~~~~~

node_modules/jodit/src/core/selection/select.ts:91:31 - error TS2339: Property 'getSelection' does not exist on type 'ShadowRoot'.

91    return this.j.o.shadowRoot.getSelection();
                                 ~~~~~~~~~~~~

node_modules/jodit/src/core/selection/select.ts:174:18 - error TS2339: Property 'caretPositionFromPoint' does not exist on type 'Document'.

174     if (this.doc.caretPositionFromPoint) {
                     ~~~~~~~~~~~~~~~~~~~~~~

node_modules/jodit/src/core/selection/select.ts:175:29 - error TS2339: Property 'caretPositionFromPoint' does not exist on type 'Document'.

175      const caret = this.doc.caretPositionFromPoint(x, y);
                                ~~~~~~~~~~~~~~~~~~~~~~

node_modules/jodit/src/core/selection/select.ts:185:19 - error TS2531: Object is possibly 'null'.

185      rng.setStart(caret.startContainer, caret.startOffset);
                      ~~~~~

node_modules/jodit/src/core/selection/select.ts:185:41 - error TS2531: Object is possibly 'null'.

185      rng.setStart(caret.startContainer, caret.startOffset);

To Reproduce
Full reproduction here: https://stackblitz.com/edit/node-36qyyf?file=index.ts
Run tsc in the terminal there to see the errors.
Just importing the IJodit interface is enough to cause it.
What about "skipLibCheck": true?
That is set in this example. skipLibCheck can only skip pre-compiled type definitions (d.ts), for Jodit, it must compile the src/**/*.ts files, which result in the errors above.
How can we fix this?

Never point to the ./src in any .d.ts, such as https://github.com/xdan/jodit/blob/master/index.d.ts#L8
Use tsc to compile the code instead of, or in addition to babel.
Include the generated .d.ts from tsc.
Point to those types in the package.json.
Use files in package.json as an array of what files you want to include in the published package. Do not include src, test, or other directories unnecessary for developers using jodit, such as docker and examples. As a bonus, this will make the package smaller and faster to install.

Yeah also really struggling with this, have to keep downgrading my Typescript to 4.3.5 to get it to work again

@dylang Try you playground with 3.8.2. Should be fixed

@xdan Thank you for looking into this problem and working towards addressing it!
It first glance it seems like those errors are no longer happening with the latest TypeScript or beta for the next version!
However, I'm not having luck getting the API to work as documented.
// ERROR: Property 'make' does not exist on type 'IJodit'
const editor = Jodit.make('#editor');
editor.value = '
start
';

https://stackblitz.com/edit/node-36qyyf?file=index.ts
"name": "jodit",
"version": "3.8.2",

It seems like the types in the published code still points to the source instead of compiled d.ts files.

@dylang  Please try again. Added type generation, but I couldn't do it with tsc. For some reason it does not compile the ./src/types folder
tsc --project . --declaration --declarationDir types --outDir types --emitDeclarationOnly --removeComments false

It does not work correct.
So I did like this
cp -r ./src/types ./types/types && tsc --project . --declaration --declarationDir types --outDir types --emitDeclarationOnly --removeComments false

There are also problems with the types/styles/icons/index.d.ts file, there should be svg files, but they are not.
There seem to be no errors in your playground

Still lots of problems, maybe from this code in types/index.d.ts:
import './styles';
import { Jodit as DefaultJodit } from './jodit';
export declare const Jodit: typeof DefaultJodit;

Because of that const there's no type called Jodit.
Why are we importing styles?

This should probably be something more like
export { Jodit } from './jodit';

For some reason it does not compile the ./src/types folder

--declarationDir types --outDir types

These are the same directory?
Also check your tsconfig.json includes and excludes paths. Seems like you are also using files, I've never seen a project need to use files.


Add a semigroup instance for CollSt

This allows this library to be built using later version of GHC like 8.4.3 and onwards owing to the Semigroup-Monoid proposal

Thank you for proposing this change. However this would break backward compatibility with still pretty recent versions of GHC. Could you please make the inclusion of the semigroup conditional using the cabal __GLASGOW_HASKELL__ CPP macro?


Drop "Latest releases" section from the Status page

Contributes to #905
Preview: https://deploy-preview-929--opentelemetry.netlify.app/status

Merging based on @austinlparker's SGTM in https://github.com/open-telemetry/opentelemetry.io/issues/905#issuecomment-967243239


Docs for ItemTappedEventArgsConverter

New PR for the ItemTappedEventArgsConverter as Cliff messed up the Merge of the last attempt at a PR...

Hey Team, I went with a new PR so that it was all cleaned up and resolved...
Sorry to cause the problems and thanks for the support.

Docs Build status updates of commit 58a1e90:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docs/maui/TOC.yml
:white_check_mark:Succeeded
View

docs/maui/converters/index.md
:white_check_mark:Succeeded
View

docs/maui/converters/item-tapped-eventargs-converter.md
:white_check_mark:Succeeded
View

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching the docs.microsoft.com contributor guidesPost your question in the Docs support channel

PRMerger Results

Issue
Description

Added File(s)
This PR contains added files. New files require human review.

Yaml File(s)
This PR includes changes to .yml file(s) owned by another author.

File Change Percent
This PR contains file(s) with more than 20% file change.

Index File
This PR contains a change to the index file.

Docs Build status updates of commit c170e00:
:warning: Validation status: warnings

File
Status
Preview URL
Details

docs/maui/converters/index.md
:warning:Warning
View
Details

docs/maui/converters/item-tapped-eventargs-converter.md
:warning:Warning
View
Details

docs/maui/TOC.yml
:white_check_mark:Succeeded
View

docs/maui/converters/index.md

Line 39, Column 254: [Warning: file-not-found - See documentation] Invalid file link: '../behaviors/event-to-command-behavior.md'.

docs/maui/converters/item-tapped-eventargs-converter.md

Line 12, Column 181: [Warning: file-not-found - See documentation] Invalid file link: '../behaviors/event-to-command-behavior.md'.

For more details, please refer to the build report.
If you see build warnings/errors with permission issues, it might be due to single sign-on (SSO) enabled on Microsoft's GitHub organizations. Please follow instructions here to re-authorize your GitHub account to Docs Build.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
Note: Your PR may contain errors or warnings unrelated to the files you changed. This happens when external dependencies like GitHub alias, Microsoft alias, cross repo links are updated. Please use these instructions to resolve them.
For any questions, please:Try searching the docs.microsoft.com contributor guidesPost your question in the Docs support channel

Docs Build status updates of commit f50d270:
:warning: Validation status: warnings

File
Status
Preview URL
Details

docs/maui/converters/index.md
:warning:Warning
View
Details

docs/maui/converters/item-tapped-eventargs-converter.md
:warning:Warning
View
Details

docs/maui/TOC.yml
:white_check_mark:Succeeded
View

docs/maui/converters/index.md

Line 61, Column 254: [Warning: file-not-found - See documentation] Invalid file link: '../behaviors/event-to-command-behavior.md'.

docs/maui/converters/item-tapped-eventargs-converter.md

Line 12, Column 181: [Warning: file-not-found - See documentation] Invalid file link: '../behaviors/event-to-command-behavior.md'.

For more details, please refer to the build report.
If you see build warnings/errors with permission issues, it might be due to single sign-on (SSO) enabled on Microsoft's GitHub organizations. Please follow instructions here to re-authorize your GitHub account to Docs Build.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
Note: Your PR may contain errors or warnings unrelated to the files you changed. This happens when external dependencies like GitHub alias, Microsoft alias, cross repo links are updated. Please use these instructions to resolve them.
For any questions, please:Try searching the docs.microsoft.com contributor guidesPost your question in the Docs support channel

OK let's wait for this one until we have the event to command behavior so we don't have broken links :)

Included #79


Exception when toggling rnvimr in neovim

I can't use rnvimr on my MacOS with neovim, here's the stacktrace I'm getting in the window ranger is suppose to be displayed
Error while loading plugin 'host'
Error while loading plugin 'service'
ranger version: ranger 1.9.3
Python version: 2.7.16 (default, Feb 29 2020, 01:55:37) [GCC 4.2.1 Compatible Apple LLVM 11.0.3 (clang-1103
.0.29.20) (-macos10.15-objc-
Locale: None.None

Traceback (most recent call last):
  File "/usr/local/Cellar/ranger/1.9.3/libexec/ranger/core/main.py", line 172, in main
    ranger.api.hook_init(fm)
  File "/Users/maciek/.config/nvim/autoload/plugged/rnvimr/ranger/plugins/hacks.py", line 377, in <lambda>
    ranger.api.hook_init = lambda fm: Hacks(fm, OLD_HOOK_INIT).hook_init()
  File "/Users/maciek/.config/nvim/autoload/plugged/rnvimr/ranger/plugins/hacks.py", line 44, in hook_init
    self.draw_border()
  File "/Users/maciek/.config/nvim/autoload/plugged/rnvimr/ranger/plugins/hacks.py", line 354, in draw_bord
er
    attr_dict = client.nvim.vars['rnvimr_border_attr']
  File "/Users/maciek/Library/Python/2.7/lib/python/site-packages/pynvim/api/common.py", line 88, in __geti
tem__
    return self._get(key)
  File "/Users/maciek/Library/Python/2.7/lib/python/site-packages/pynvim/api/nvim.py", line 182, in request
    res = self._session.request(name, *args, **kwargs)
  File "/Users/maciek/Library/Python/2.7/lib/python/site-packages/pynvim/msgpack_rpc/session.py", line 102,
 in request
    raise self.error_wrapper(err)
NvimError: Key not found: rnvimr_border_attr

ranger crashed. Please report this traceback at:
https://github.com/ranger/ranger/issues

[Process exited 1]

Healthcheck info:
health#rnvimr#check
  - ERROR: Failed to run healthcheck for "rnvimr" plugin. Exception:
    function health#check[21]..health#rnvimr#check[5]..<SNR>137_check_rpc, line 34
    Vim(call):E900: Invalid channel id

Requirements
Ranger (v1.9.3 at least)
Pynvim
Neovim
Python3.6
Ueberzug (optional, if you don't use Tmux, Ueberzug is required at least d86eeb)

Q: I'm Using Mac, this plugin doesn't work for me.

A: Install Requirements first, you should install Ranger by pip3 install ranger-fm instead of brew install ranger because the Ranger installed by brew still using Python2.

Thanks! Ranger from pip is not working for me but I guess that's another problem 😅
Traceback (most recent call last):
  File "/usr/local/bin/ranger", line 36, in <module>
    import ranger  # NOQA pylint: disable=import-self,wrong-import-position
ModuleNotFoundError: No module named 'ranger'

Uninstall Ranger installed by brew first. My Mac env works fine with rnvimr. Good luck!


File Path errors - when launching from different working directories.

Description
When launching the game from different directories (i.e. Gradle vs desktop launcher), paths are different between different instances of the game. This is particularly noticeable when saving / loading and the save directory may be created at the wrong path.
How To Reproduce
Steps to reproduce the behaviour:

Launch game from desktop launcher
Enter then exit the area. When the save file is created it should be saved.

Temporary Fix
Never boot game from desktop launcher.

Fixed in #525


文件比较多时，要运行几十个小时，一旦出错或者意外终止，数据库就损害了要重新生成。这里每处理100个重新保存一下

文件比较多时，要运行几十个小时，一旦出错或者意外终止，数据库就损害了要重新生成。在哪里修改代码，能够每处理100个重新保存一下或者多线程添加到向量数据库。

python init_database.py -help
usage: init_database.py [-h] [-r] [--create-tables] [--clear-tables] [--import-db IMPORT_DB] [-u] [-i] [--prune-db] [--prune-folder] [-n KB_NAME [KB_NAME ...]]
[-e EMBED_MODEL]
please specify only one operate method once time.
options:
-h, --help            show this help message and exit
-r, --recreate-vs     recreate vector store. use this option if you have copied document files to the content folder, but vector store has not been populated
or DEFAUL_VS_TYPE/EMBEDDING_MODEL changed.
--create-tables       create empty tables if not existed
--clear-tables        create empty tables, or drop the database tables before recreate vector stores
--import-db IMPORT_DB
import tables from specified sqlite database
-u, --update-in-db    update vector store for files exist in database. use this option if you want to recreate vectors for files exist in db and skip files
exist in local folder only.
-i, --increment       update vector store for files exist in local folder and not exist in database. use this option if you want to create vectors
incrementally.
--prune-db            delete docs in database that not existed in local folder. it is used to delete database docs after user deleted some doc files in file
browser
--prune-folder        delete doc files in local folder that not existed in database. is is used to free local disk space by delete unused doc files.
-n KB_NAME [KB_NAME ...], --kb-name KB_NAME [KB_NAME ...]
specify knowledge base names to operate on. default is all folders exist in KB_ROOT_PATH.
-e EMBED_MODEL, --embed-model EMBED_MODEL
specify embeddings model.


MetaChainContainer start () isn't fluent-like

What would you like to be added:
https://github.com/DeFiCh/metachain/blob/8c7da99dd55b34a6ae0e087003071971025413be/packages/testcontainers/src/MetaChainContainer.ts#L39-L48

The network configuration should be injected in with withNetworkMode; we shouldn't internalize this; it would limit the usability of testcontainer Fluent API and make it impossible to connect with other docker containers using the same docker network.
Move with... to the constructor; given this start () design, it is not Fluent-like. When the consumer uses the with... commands, they expect whatever they injecting in to be replaced. This design will override the replacement when they start the container.

/triage accepted
/area packages
/priority important-soon
Also mentioned here:

https://github.com/JellyfishSDK/jellyfish/pull/1790#discussion_r986066894
https://github.com/JellyfishSDK/jellyfish/pull/1790#discussion_r986069192

/assign @DieHard073055


azure storage blob download: ConnectionResetError(104, 'Connection reset by peer')

Hi
I installed the azure-storage-blob python sdk(12.8.1) from pip.
And setup a cron job to read all the blob files from the container, however, i find many error message from the log:
Unable to stream download: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer'))
Why the connection will be reset by azure?
Any feedback will be appreciated.
Thanks
Wei

文档详细信息
⚠ 请勿编辑此部分。 docs.microsoft.com ➟ GitHub 问题链接必须具有此部分。

ID: f60c47f1-e4d8-f68e-5f9c-460c4fdc6da8
Version Independent ID: 172e9f9b-25fb-2121-cb72-d383cc21763a
Content: Azure Storage Blobs client library for Python
Content Source: docs-ref-services/latest/storage-blob-readme.md
Service: storagestorage
Product: azure
Technology: azure
GitHub Login: @maggiepint
Microsoft Alias: magpint

Thanks for the feedback, we’ll investigate asap.

Hi @fengzhuye
Thanks for reporting this. Is there any extra info in the stacktrace? Can you paste them here?
Also, did you check if the blob was downloaded successfully finally, ideally we will auto retry it if the error is caught properly. Can you tell if the requests are retired based on the stacktrace?
Thanks for helping on our investigation!

Hi @fengzhuye
Can you check which version of azure-storage-blob sdk you are using?
if it's not >=12.8.1 can you upgrade to that and see if that can help?

Hi @xiafu-msft
Thanks for the reply. I am currently using version 12.8.1
Only the log message shows up, there is no stacktrace or other info.
It seems the exception is already handled by the sdk. I am not aware of this error in my program.
But not sure if the blob is downloaed in this situation.

Hi @fengzhuye
Sounds like this is not a bug, storage retry for 3 times on this error, the sdk is working as expected if your blob is downloaded successfully.
Let me know if you have any concern!

Hi @xiafu-msft
It's that possible "ConnectionResetError(104, 'Connection reset by peer'))" will happens 3 times?
I want to know why this error happens, or what can I do to avoid this kind of error?
Sorry about the bothering.

I also get this error frequently, ~2 times per day, while running code on a 15min interval on an azure functions app. The error never occurs while testing locally though. Is there a way to increase the retries?

@tasherif-msft we should have a sample about how to setup retry policy and modify it

Is there any update on that? Any workaround? I'm having this errors intermittently.

@jalauzon-msft Jacob was working on this. Jacob can you please post an update here?

To update everyone on the thread. @fengzhuye @jaymegordo @gmotasilva
Connection Reset errors come from the service and there is not much that can be done to eliminate them from the client-side. The best that can be done from the client is to have retries when this error occurs. The SDK will automatically retry these errors 3 times with an exponential backoff policy.
If you are seeing these errors, but retries are succeeding, then there is not much more that can be done from the client side.
If, however, your operations are failing with this error after the default 3 retries there are a couple of options.

You can open a support ticket with your Storage account to have the service team investigate the connection reset errors.
You can try increasing the number of retries by providing your own custom retry policy. This can be achieved with by providing a retry policy when creating any client (blob, datalake, file share, queue).

from azure.storage.blob import ExponentialRetry, BlobServiceClient

retry_policy = ExponentialRetry(
    retry_total=5
)

service_client = BlobServiceClient(
    'https://myaccount.blob.core.windows.net',
    retry_policy=retry_policy
)

The default value for retry_total is 3 so you could try 5, for example. There are also other parameters such as initial_backoff and increment_base that can be tweaked to change the time in between retries.
We are also currently investigating why this issue seems to be happening more often in our Python SDK, when compared to our other languages. From this investigation, we may end up tweaking the default retry values or something similar. We also plan to start an internal discussion with the service team on this issue.

Hi all, while investigating #22784 it seems there was, at one point, an issue where blob download was not properly retrying connection reset errors. I think this was addressed in a later release of azure-storage-blob or (more like) azure-core so updating to latest may help with error in blob download specifically.

/unresolved
I am seeing this error as well:
2022-05-27T21:51:42+0000 next():186 Unable to stream download: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer'))
2022-05-27T21:51:42+0000 wrapped():79 Download stream interrupted.
pip3 freeze | grep azure
azure-common==1.1.28
azure-core==1.24.0
azure-storage-blob==12.12.0
azure-storage-common==2.1.0
azure-storage-file==2.1.0
azure-storage-file-share==12.8.0
I will try the suggested tweaks above and see how it goes. I just started see this error this week

/unresolve


Fix bug where stub=true is sometimes incorrectly sent

See https://groups.google.com/forum/#!topic/cloudant-sync/xAgWtuSsrk8
for details.
We now use possible_ancestors to correctly determine the minRevPos
value and correctly stub out attachments.
reviewer: @mikerhodes
reviewer: @rhyshort

looks good to me +1

It looks like this addresses the bug and uses the possible_ancestors correctly. +1, but feel free to do suggested refactorings if you want.


[Enhancement] Setting environment

Description
It would be nice if a DOTNET_ENVIRONMENT could be set to remote debug with different profiles.
Only thing needed in launch.json to support this is in the configuration where this could be added:
"env": {
  "DOTNET_ENVIRONMENT": "Development"
}

Interesting suggestion. This may be a good candidate for the new connection settings profiles feature. Sprinkle on a little user-customized settings versus the default ones


fix(prow/config): fix tide merge templates

org: tikv
repos: pingcap/tidb, pingcap/tidb-tools, pingcap/tiflow, pingcap/tidb-binlog, pingcap/ng-monitoring

tested in dev env: https://github.com/ti-community-infra/test-dev/pull/541

tested in prod env: https://github.com/ti-community-infra/test-prod/pull/45

/merge


label allows element

Current dependencies on/for this PR:

main

PR #45   👈

This stack of pull requests is managed by Graphite.


Fix br warning

When adding html that has a
 tag in it, react logs the following warning:

Warning: br is a void element tag and must not have children or use props.dangerouslySetInnerHTML. Check the render method of...

I've made a change to the code that cycles through all the children and removes any
 tags. I'm not sure if this is performant but it does solve the issue. I'd be grateful for any comments :)

Hi @lithin, thanks for your contribution. I've opened PR #17 that is a more generic approach. There are many other void element tags in HTML besides br. Could you please have a look at #17 and let me know if that makes sense to you?
Thanks