Autocompletion support is lacking documentation

[kind/Documentation]

What did you find missing in the documentation?
When using --complete:
github.com/openshift/odo  add-completion-command ✗                                                                                1h31m ⚑ ◒  ⍉
▶ ./odo --complete
Install completion for odo? y
Installing...
Done!

I literally have no idea where it's installed, how it's installed and whether it supports bash or zsh. (hint: it doesn't..)
What is the relevance of it?
Need to add more documentation to indicate to the user what's happening.

A few TODO's for this issue before we start work on it:

[ ] --complete and --uncomplete needs to be removed into it's own standalone command (odo utils complete) or something similar
[ ] Make sure that autocompletion works correctly
[ ] Add documentation on how to correctly install / uninstall
[ ] Add clear difference between "terminal" and "autocompletion" install. We currently have both (PS1 as well as autocompletion install)...

Needs docs


Update reference tests to Cancun

Update reference tests to cancun tests.

PR description
Fixed Issue(s)

Taking off of draft as this is now referencing a committed change.


chore: try musl build of ffi engine

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 88.38%. Comparing base (6190dd3) to head (7ac4cc8).

Additional details and impacted files
@@           Coverage Diff           @@
##             main     #332   +/-   ##
=======================================
  Coverage   88.38%   88.38%
=======================================
  Files          10       10
  Lines        3686     3686
=======================================
  Hits         3258     3258
  Misses        428      428

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


Updated dependencies for RainLab.User

Updated composer.json to change version
Updated version.yaml to change message in changelogs.

Thanks!


Settings values not working at all for DCS

I'm trying to play with settings. According to log file it does see the settings but ignores them. I've even tried to overwrite that settings file in application folder (program files) to no avail. I wanted to test different settings but it always choosing some defaults it seems. Log file:
`2023-09-12 02:22:09 +0200: XR_APILAYER_MBUCCHIA_quad_views_foveated layer (v1.1.1) is active
2023-09-12 02:22:09 +0200: Using layer: XR_APILAYER_MBUCCHIA_quad_views_foveated
2023-09-12 02:22:09 +0200: Using layer: XR_APILAYER_MBUCCHIA_toolkit
2023-09-12 02:22:09 +0200: Cannot satisfy implicit extension request: XR_FB_eye_tracking_social
2023-09-12 02:22:09 +0200: Requested extension: XR_KHR_D3D11_enable
2023-09-12 02:22:09 +0200: Requested extension: XR_KHR_visibility_mask
2023-09-12 02:22:09 +0200: Blocking extension: XR_VARJO_quad_views
2023-09-12 02:22:09 +0200: Requesting extension: XR_EXT_eye_gaze_interaction
2023-09-12 02:22:09 +0200: Application: DCS World (DCS.exe)
2023-09-12 02:22:09 +0200: Using OpenXR runtime: PimaxXR (Unofficial) 0.4.2
2023-09-12 02:22:09 +0200: Using OpenXR system: Pimax Crystal
2023-09-12 02:22:09 +0200: Trying to locate configuration file at 'C:\Program Files\OpenXR-Quad-Views-Foveated\settings.cfg'...
2023-09-12 02:22:09 +0200:   Found option 'smoothen_focus_view_edges=0,45'
2023-09-12 02:22:09 +0200:   Found option 'sharpen_focus_view=0,75'
2023-09-12 02:22:09 +0200:   Found option 'turbo_mode=1'
2023-09-12 02:22:09 +0200:   Found option 'horizontal_fixed_section=0.5'
2023-09-12 02:22:09 +0200:   Found option 'vertical_fixed_section=0.45'
2023-09-12 02:22:09 +0200:   Found option 'horizontal_focus_section=0,65'
2023-09-12 02:22:09 +0200:   Found option 'vertical_focus_section=0,65'
2023-09-12 02:22:09 +0200:   Found option 'peripheral_multiplier=0,87'
2023-09-12 02:22:09 +0200:   Found option 'focus_multiplier=1,41'
2023-09-12 02:22:09 +0200:   Found option 'debug_eye_gaze=0'
2023-09-12 02:22:09 +0200:   Found option 'debug_focus_view=0'
2023-09-12 02:22:09 +0200:   Found option 'vertical_focus_offset=-0,1'
2023-09-12 02:22:09 +0200: Trying to locate configuration file at 'C:\Users\artsc\AppData\Local\Quad-Views-Foveated\settings.cfg'...
2023-09-12 02:22:09 +0200:   Found option 'smoothen_focus_view_edges=0,45'
2023-09-12 02:22:09 +0200:   Found option 'sharpen_focus_view=0,75'
2023-09-12 02:22:09 +0200:   Found option 'turbo_mode=1'
2023-09-12 02:22:09 +0200:   Found option 'horizontal_fixed_section=0.5'
2023-09-12 02:22:09 +0200:   Found option 'vertical_fixed_section=0.45'
2023-09-12 02:22:09 +0200:   Found option 'horizontal_focus_section=0,65'
2023-09-12 02:22:09 +0200:   Found option 'vertical_focus_section=0,65'
2023-09-12 02:22:09 +0200:   Found option 'peripheral_multiplier=0,87'
2023-09-12 02:22:09 +0200:   Found option 'focus_multiplier=1,41'
2023-09-12 02:22:09 +0200:   Found option 'debug_eye_gaze=0'
2023-09-12 02:22:09 +0200:   Found option 'debug_focus_view=0'
2023-09-12 02:22:09 +0200:   Found option 'vertical_focus_offset=-0,1'
2023-09-12 02:22:09 +0200: Eye tracking is supported
2023-09-12 02:22:09 +0200: Recommended peripheral resolution: 432x510 (0.100x density)
2023-09-12 02:22:09 +0200: Recommended focus resolution: 432x510 (1.000x density)
2023-09-12 02:22:09 +0200:   Stereo pixel count was: 43999648 (4312x5102)
2023-09-12 02:22:09 +0200:   Quad views pixel count is: 881280
2023-09-12 02:22:09 +0200:   Savings: -98.0%
2023-09-12 02:22:13 +0200: Session is using quad views
2023-09-12 02:22:13 +0200: Edge smoothing: Disabled
2023-09-12 02:22:13 +0200: Sharpening: Disabled
2023-09-12 02:22:13 +0200: Turbo: Enabled
`
Did everything according to instructions, install OpenXR Toolkit first, quad views second, enabled save mode for toolkit, reset all settings to default. Still my settings don't work at all, am I doing something wrong here?

Oh I guess I found what's the issue - it puts , isntead of . into values and that's why they don't work. It's a regional thing

Issue in 3rd party app.


fix: helm dependency update

Description
Upgrading MongoDB and Redis Helm dependency to the newest versions.
Fixes # (issue)
Type of change
Please delete options that are not relevant.

[x] Refactor/improvement

How Has This Been Tested?
Integration tests.
Checklist

[x] My commit message is conventional
[x] I have run pre-commit on all files before creating the PR
[x] I have commented my code, particularly in hard-to-understand areas
[x] I have made corresponding changes to the documentation
[x] I have added tests that prove my fix is effective or that my feature works
[x] New and existing unit tests pass locally with my changes
[x] I have checked my code and corrected any misspellings

Codecov Report

Merging #667 (14fe981) into develop (685d093) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff            @@
##           develop     #667   +/-   ##
========================================
  Coverage    86.83%   86.83%
========================================
  Files           25       25
  Lines         1603     1603
========================================
  Hits          1392     1392
  Misses         211      211

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:tada: This PR is included in version 1.8.5-beta.5 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


Create Actions workflow for uploading container image to Harbor

Description:
An Actions workflow needs to be created that will push the Docker container image to Harbor. The workflow from DataGateway can be used as a guide https://github.com/ral-facilities/datagateway/blob/feature/k8s-deployment/.github/workflows/docker-build.yml
Acceptance criteria:

[ ] Successful Harbor upload

Closed in https://github.com/ral-facilities/datagateway-api/pull/368


Support for emitting stats push-based monitoring backends

...with initial support for InfluxDB (v0.88).
@alainjobart I seem to have InfluxDB v0.88 (that latest stable release) working with some caveats. I think this is reasonable to check in now as a proof-of-concept, although I wouldn't expect it to hold up in a production like environment.
Once we have this in shape that it can be checked in, I'll start writing a Monitoring docs page that talks about the current state, caveats, and future direction.
I also tried to mess around with Godeps (since we need the non-master version of the InfluxDB client), I think I got it working, but not totally convinced...

It's a good idea to show how vitess could work with other open source project together. However, I feel these things are deserved to have its own repo as the first step. We might need to start thinking about what is the best place for developers to contribute their changes like this. I would prefer to put them into a separate repo or at least in a "contrib" dir.

@yaoshengzhe: let's talk in person tomorrow,  I don't think I fully understand the ramifications of your suggestion.

LGTM
(on google3 import time, you're gonna have to rm the extra files)
I agree with Shengzhe that is we add too many of these, the plugin_... files are gonna start to accumulate. Does anyone have a suggestion on how to make that more flexible?


⚠ Bofrost.be has degraded performance

In f335511, Bofrost.be (https://www.bofrost.be) experienced degraded performance:

HTTP code: 200
Response time: 1466 ms

Resolved: Bofrost.be performance has improved in e58e741.


Recursively resolve Utoipa references

 Python-Library verwendet OpenAPI-generierten Code

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

66 of 75 (88.0%)  changed or added relevant lines in 5 files are covered.
9 unchanged lines in 3 files lost coverage.
Overall coverage decreased (-0.01%) to 89.274%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

services/src/api/model/datatypes.rs
8
9
88.89%

services/src/api/mod.rs
53
61
86.89%

Files with Coverage Reduction
New Missed Lines
%

services/src/pro/datasets/postgres.rs
2
69.29%

services/src/pro/users/postgres_userdb.rs
3
95.28%

services/src/pro/contexts/postgres.rs
4
96.67%

Totals

Change from base Build<PHONE_NUMBER>:
-0.01%

Covered Lines:
95404

Relevant Lines:
106867

💛  - Coveralls

continues in 882


feat: do not append workspaces field when no workspaces present

Description

Issues Resolved

Screenshot

Testing the changes

Check List

[ ] All tests pass

[ ] yarn test:jest
[ ] yarn test:jest_integration
[ ] yarn test:ftr

[ ] New functionality includes testing.
[ ] New functionality has been documented.
[ ] Update CHANGELOG.md
[ ] Commits are signed per the DCO using --signoff

Welcome to Codecov :tada:
Once you merge this PR into your default branch, you're all set! Codecov will compare coverage reports and display results in all future pull requests.
Thanks for integrating Codecov - We've got you covered :open_umbrella:


API keys creation rake

Closes #13173

Acceptance 🍏
I'll let the tests run again after the merge, but otherwise, 🚀


Zarr can not handle 0 dimension like numpy does

In certain cases, numpy can return a dimension that is 0.  This is different from reducing the dimension so the dimension is missing.  Therefore, in numpy you can have shape like (1000, 0, 0), which is actually empty data-wise but it is internally consistent.  In such case zarr seems to fail:
In [68]: import zarr
In [69]: arr = zarr.empty((1000, 0, 0), dtype='float64')
/.../site-packages/zarr/util.py:48: RuntimeWarning: divide by zero encountered in log10
  target_size = CHUNK_BASE * (2**np.log10(dset_size/(1024.*1024)))

where it would work in numpy:
In [70]: import numpy
In [71]: arr = numpy.empty((1000, 0, 0), dtype='float64')
In [72]: print arr
[]
In [73]: print arr.shape
(1000, 0, 0)

Thanks for raising. Out of interest, could you tell me anything about use
cases for zero length dimension?
On Tue, 25 Jul 2017 at 17:21, Will Lee<EMAIL_ADDRESS>wrote:

In certain cases, numpy can return a dimension that is 0. This is
different from reducing the dimension so the dimension is missing.
Therefore, in numpy you can have shape like (1000, 0, 0), which is actually
empty data-wise but it is internally consistent. In such case zarr seems to
fail:
In [68]: import zarr
In [69]: arr = zarr.empty((1000, 0, 0), dtype='float64')
/.../site-packages/zarr/util.py:48: RuntimeWarning: divide by zero encountered in log10
target_size = CHUNK_BASE * (2**np.log10(dset_size/(1024.*1024)))
where it would work in numpy:
In [70]: import numpy
In [71]: arr = numpy.empty((1000, 0, 0), dtype='float64')
In [72]: print arr
[]
In [73]: print arr.shape
(1000, 0, 0)
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/alimanfoo/zarr/issues/150, or mute the thread
https://github.com/notifications/unsubscribe-auth/AAq8QhwPhpl66ulNuhi-16mkB025O85Nks5sRhXtgaJpZM4Oiynu
.

--
Alistair Miles
Head of Epidemiological Informatics
Centre for Genomics and Global Health http://cggh.org
Big Data Institute Building
Old Road Campus
Roosevelt Drive
Oxford
OX3 7LF
United Kingdom
Phone: +44 (0)1865 743596
Email<EMAIL_ADDRESS>Web: http://a http://purl.org/net/alimanlimanfoo.github.io/
Twitter: https://twitter.com/alimanfoo

There are cases where you would like to preserve the metadata of the dimension without removing the dimension.  For example, if you have an array with 3 dimensions (m, n, p) and you have an index/coordinates for dimension n with values say [1, 3, 9, 10].  When a user  slice for index value of 5 on dimension n, instead of an error you can logically end up with an array with shape (m, 0, p).  You can think in terms of a flat sql query on a conventional database.  In such case it would return an empty table.  It's the same when you flatten an n-d array.  The difference is that you may still want to keep around the length of the other dimensions.
Thinking in terms of zarr, you can have somebody that produces an empty array through the above slicing operation and the user would like to persist the array on disk with the associated metadata on that dimension.  If you reduce that array to nothing, you'll lose all the index info, dimension name, etc.

BTW, the reason I was looking at this case is that I had to wrestle with hdf5 to store something like this.  Both pytables and h5py does not support this and I believe the underlying hdf5 doesn't support this either.  So when we had to persist something like this from numpy we had to jump through some hoops to do so (like writing an 1-d array with size 1 but with metadata saying that the shape is actually (m, 0, p)).

Thanks Will. It may be possible to support this, the error message you
posted is actually coming from the code that automatically guesses chunk
shape if not specified, it would be interesting to see where Zarr breaks if
chunks are explicitly specified. I don't have time to follow up at the
moment but happy to discuss further and/or review PR.
On Tue, Jul 25, 2017 at 7:41 PM, Will Lee<EMAIL_ADDRESS>wrote:

BTW, the reason I was looking at this case is that I had to wrestle with
hdf5 to store something like this. Both pytables and h5py does not support
this and I believe the underlying hdf5 doesn't support this either. So when
we had to persist something like this from numpy we had to jump through
some hoops to do so (like writing an 1-d array with size 1 but with
metadata saying that the shape is actually (m, 0, p)).
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/alimanfoo/zarr/issues/150#issuecomment-317831025, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AAq8QgfNE3xfJUhKwFhyIoFcIfBIpUTAks5sRjbQgaJpZM4Oiynu
.

--
Alistair Miles
Head of Epidemiological Informatics
Centre for Genomics and Global Health http://cggh.org
Big Data Institute Building
Old Road Campus
Roosevelt Drive
Oxford
OX3 7LF
United Kingdom
Phone: +44 (0)1865 743596
Email<EMAIL_ADDRESS>Web: http://a http://purl.org/net/alimanlimanfoo.github.io/
Twitter: https://twitter.com/alimanfoo

I'm affected by this as well. There are a number of cases where it is convenient to create a zero-length array and store it just to preserve the metadata (later processes can fill it in).
I'll try to take a look at this if I get a chance.

Also running into this issue. Wanting this functionality for similar reasons already outlined. Though would add that I try to collect a group of objects and may find any number of objects (including 0), but still want to be able to store and handle the result the same for the 0 case.
Tried specifying the chunks when creating the Zarr Dataset, which seemed to work. However it doesn't appear to be possible to retrieve the data. This includes trying to simply access the Zarr Dataset without loading the data into an array. So it seems there are other issues that would need to be addressed beyond fixing normalization of chunks.

Hi @jakirkham, could you say a bit more about how you would expect a zarr
array with one or more zero length dimensions to behave why you try to
access data?
On Thu, Aug 31, 2017 at 4:16 PM, jakirkham<EMAIL_ADDRESS>wrote:

Also running into this issue. Wanting this functionality for similar
reasons already outlined. Though would add that I try to collect a group of
objects and may find any number of objects (including 0), but still want to
be able to store and handle the result the same for the 0 case.
Tried specifying the chunks when creating the Zarr Dataset, which seemed
to work. However it doesn't appear to be possible to retrieve the data.
This includes trying to simply access the Zarr Dataset without loading the
data into an array. So it seems there are other issues that would need to
be addressed beyond fixing normalization of chunks.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/alimanfoo/zarr/issues/150#issuecomment-326328140, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AAq8Qj5lQ7HRdapMT3qPw-tBnDY556Jwks5sds5YgaJpZM4Oiynu
.

--
Alistair Miles
Head of Epidemiological Informatics
Centre for Genomics and Global Health http://cggh.org
Big Data Institute Building
Old Road Campus
Roosevelt Drive
Oxford
OX3 7LF
United Kingdom
Phone: +44 (0)1865 743596
Email<EMAIL_ADDRESS>Web: http://a http://purl.org/net/alimanlimanfoo.github.io/
Twitter: https://twitter.com/alimanfoo

So I can provide an example of how h5py behaves in a similar case. Would expect Zarr to behave the same.

In [1]: import numpy as np

In [2]: import h5py as h5

In [3]: a = np.zeros((1, 2, 3), dtype=np.uint8)

In [4]: b = np.zeros((0, 2, 3), dtype=np.uint8)

In [5]: with h5.File("test.h5", "w") as fh:
   ...:     fh["a"] = a
   ...:     fh["b"] = b
   ...:

In [6]: with h5.File("test.h5", "r") as fh:
   ...:     for dn in ["a", "b"]:
   ...:         print(fh[dn])
   ...:         print(fh[dn][...])
   ...:         print(type(fh[dn][...]))
   ...:         print("")
   ...:
<HDF5 dataset "a": shape (1, 2, 3), type "|u1">
[[[0 0 0]
  [0 0 0]]]
<class 'numpy.ndarray'>

<HDF5 dataset "b": shape (0, 2, 3), type "|u1">
[]
<class 'numpy.ndarray'>

Regarding why one would want to access or store data with 0 dimensions, it is basically about avoiding special casing. If I don't know whether or not a dimension will be length 0, then I shouldn't need to check before storing or loading such data. It makes it much more difficult to reason about and test code that requires this sort of special casing.

Thank you, very helpful.
On Thu, Aug 31, 2017 at 6:56 PM, jakirkham<EMAIL_ADDRESS>wrote:

So I can provide an example of how h5py behaves in a similar case. Would
expect Zarr to behave the same.
In [1]: import numpy as np
In [2]: import h5py as h5
In [3]: a = np.zeros((1, 2, 3), dtype=np.uint8)
In [4]: b = np.zeros((0, 2, 3), dtype=np.uint8)
In [5]: with h5.File("test.h5", "w") as fh:
...:     fh["a"] = a
...:     fh["b"] = b
...:
In [6]: with h5.File("test.h5", "r") as fh:
...:     for dn in ["a", "b"]:
...:         print(fh[dn])
...:         print(fh[dn][...])
...:         print(type(fh[dn][...]))
...:         print("")
...:         <HDF5 dataset "a": shape (1, 2, 3), type "|u1">
[[[0 0 0]
[0 0 0]]]<class 'numpy.ndarray'>
<HDF5 dataset "b": shape (0, 2, 3), type "|u1">
[]<class 'numpy.ndarray'>
Regarding why one would want to access or store data with 0 dimensions, it
is basically about avoiding special casing. If I don't know whether or not
a dimension will be length 0, then I shouldn't need to check before storing
or loading such data. It makes it much more difficult to reason about and
test code that requires this sort of special casing.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/alimanfoo/zarr/issues/150#issuecomment-326374202, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AAq8QpETcchsd40xP-aOVeo-HtRO3dGxks5sdvO-gaJpZM4Oiynu
.

--
Alistair Miles
Head of Epidemiological Informatics
Centre for Genomics and Global Health http://cggh.org
Big Data Institute Building
Old Road Campus
Roosevelt Drive
Oxford
OX3 7LF
United Kingdom
Phone: +44 (0)1865 743596
Email<EMAIL_ADDRESS>Web: http://a http://purl.org/net/alimanlimanfoo.github.io/
Twitter: https://twitter.com/alimanfoo

FYI: I submitted a pull request to try to fix this. I thought you might find it to be useful...
-- PG.

Thank you, apologies I've been tied up on other projects, I'll take a look
asap.
On Monday, September 18, 2017, Prakhar Goel<EMAIL_ADDRESS>wrote:

FYI: I submitted a pull request to try to fix this. I thought you might
find it to be useful...
-- PG.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/alimanfoo/zarr/issues/150#issuecomment-330188736, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AAq8Qr0aZHo0RTjQDBsUn02ewaa2fZXqks5sjk7kgaJpZM4Oiynu
.

--
Alistair Miles
Head of Epidemiological Informatics
Centre for Genomics and Global Health http://cggh.org
Big Data Institute Building
Old Road Campus
Roosevelt Drive
Oxford
OX3 7LF
United Kingdom
Phone: +44 (0)1865 743596
Email<EMAIL_ADDRESS>Web: http://a http://purl.org/net/alimanlimanfoo.github.io/
Twitter: https://twitter.com/alimanfoo

Just a heads up that we hit this in the zarr backend for xarray (pydata/xarray#1528). Zero-dimensional arrays (i.e. just single values) are supported in netCDF, so we would ideally like to be able to do
za = zarr.create(shape=(), store='tmp_file')
za[:] = 0

Currently this raises a permission error.

I'm currently on leave but happy to work on this when I'm back in a couple
of weeks and/or review PR.
FWIW there may be different code paths needed to handle an array with 1 or
more dimensions of zero length versus an array with no dimensions (single
value).
On Sun, 8 Oct 2017 at 05:27, Ryan Abernathey<EMAIL_ADDRESS>wrote:

Just a heads up that we hit this in the zarr backend for xarray (
pydata/xarray#1528 https://github.com/pydata/xarray/pull/1528).
Zero-dimensional arrays (i.e. just single values) are supported in netCDF,
so we would ideally like to be able to do
za = zarr.create(shape=(), store='tmp_file')
za[:] = 0
Currently this raises a permission error.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/alimanfoo/zarr/issues/150#issuecomment-334982273, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AAq8QrAEltGfGBlUa6HrTp3JEGQQag2Aks5sqE8dgaJpZM4Oiynu
.

--
Alistair Miles
Head of Epidemiological Informatics
Centre for Genomics and Global Health http://cggh.org
Big Data Institute Building
Old Road Campus
Roosevelt Drive
Oxford
OX3 7LF
United Kingdom
Phone: +44 (0)1865 743596
Email<EMAIL_ADDRESS>Web: http://a http://purl.org/net/alimanlimanfoo.github.io/
Twitter: https://twitter.com/alimanfoo

@rabernat I doubt this changes the fundamental issue here, but note that using x[:] for assignment is an error in numpy, too. You need to use an empty tuple x[()] or an ellipsis x[...] for 0d arrays.


Fix:Store filters state in localStorage

This pr fixes issue #545 .

Closing as completed in #547

Closing as completed in #547

@rithviknishad sir,considering i raised the pr first,may i know where i went wrong with the pr?asking just to improve myself.

Hey @PAVAN507-STAR
Although your PR does achieve the functionallity almost right without using Jotai, using Jotai (as hinted in issue) was a much more cleaner approach as you wouldn't have to manually write useEffects to handle initial state and call localStorage methods to read or write to it. With useAtom you could simply use it like a useState and the state be synced with local storage by Jotai.

Okay cool,will improve in further contributions.I asked for assign in couple of issues .can u check and tell if it's possible for u to assign me those issues?


hoodie.reset: clean up code and add proper tests and documentation

the definition of the reset method currently looks like this:
function reset (dbName, CustomPouchDB, state, api, clear, emitter, remoteBaseUrl, remote, ajaxOptions, PouchDB, options) {
// ...
}

it should look more like this
reset (state, options) {
// ...
}

Where state is different from the internal state of the store instance, but having to bind 10 arguments in the right order is not very good to understand / manage.
Maybe there even is a more elegant way to implement the reset in the first place?
Update
also add documentation to README.md

code gets cleaned up via #153


DoS attacks

This  is more of a question about the API.  I was reviewing the API last night, and it seems a good place to intercept the growing incoming message size is:
WebSocketImpl
public void decode( ByteBuffer socketBuffer )
Please let me know if there's a better place to test for the incremental message size, or if this is already implemented somewhere.  I'd like to prevent users, and or attackers from posting large amounts of data through the server by closing the connection once a certain size limit is reached.
thanks
-Mark

This issue is implemented with #598.
Best regards,
marci4


MINOR: Add CeresDB to list of products using DataFusion

Add CeresDB to list of products using DataFusion

Codecov Report

Merging #3060 (7928456) into master (815f1bc) will increase coverage by 0.00%.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master    #3060   +/-   ##
=======================================
  Coverage   85.85%   85.85%
=======================================
  Files         289      289
  Lines       51890    51890
=======================================
+ Hits        44548    44550    +2
+ Misses       7342     7340    -2

Impacted Files
Coverage Δ

datafusion/expr/src/logical_plan/plan.rs
77.60% <0.00%> (+0.17%)
:arrow_up:

datafusion/core/src/physical_plan/metrics/value.rs
87.43% <0.00%> (+0.50%)
:arrow_up:

:mega: Codecov can now indicate which changes are the most critical in Pull Requests. Learn more


Reuse of existing pieces

Umbrella issue to discuss what off-the-shelf parts can be used to implement the RFC.
Paging @bigs

queue/broker: kafka
local kv store: rocksdb

I don't think we need what kafka provides. We just need p2p rpcs over sockets with a standard serialization format. Protobufs or thrift seems like better candidates. kafka is also geared for clusters, p2p systems have different behavioral characteristics.

you're probably right, kafka is a bit too heavyweight

Pretty clear where this is at now


Docs: update links to Callouts help page

The previously used link (https://help.obsidian.md/How+to/Use+callouts) leads to a 404 page. This PR updates all instances of that link within README.md to the new link (https://help.obsidian.md/Editing+and+formatting/Callouts).

Closes #288


webadmin user unauthorized problem

hello everyone, i'm getting a error like that:
2023/11/22 10:21:22.653	ERROR	http.handlers.authentication	auth provider returned error	{"provider": "authorizer", "error": "user authorization failed: src_ip=<IP_ADDRESS>, src_conn_ip=<IP_ADDRESS>, reason: no token found"}

my caddyfile here:
{
	order authenticate before respond
	order authorize before basicauth

	security {
		local identity store localdb {
		realm local
		path {$HOME}/.local/caddy/users.json
		}

		authentication portal myportal {
			crypto default token lifetime 3600
			crypto key sign-verify {env.JWT_SHARED_KEY}
			enable identity store localdb
			cookie domain "http://<IP_ADDRESS>"
			ui {
				links {
					"My Website" "http://<IP_ADDRESS>/app" icon "las la-star"
					"Guests" "https://<IP_ADDRESS>/guests" icon "las la-star"
					"Users" "https://<IP_ADDRESS>/users" icon "las la-star"
					"Admins" "https://<IP_ADDRESS>/admins" icon "las la-star"
					"My Identity" "/whoami" icon "las la-user"
				}
				# password_recovery_enabled yes
			}
			transform user {
				match origin local
				action add role authp/user
				ui link "Portal Settings" /settings icon "las la-cog"
			}
		}

		authorization policy guests_policy {
			# disable auth redirect
			set auth url "http://<IP_ADDRESS>"
			allow roles authp/admin authp/user
			crypto key verify {env.JWT_SHARED_KEY}
			acl rule {
				comment allow guests only
				match role guest authp/guest
				allow stop log info
			}
			acl rule {
				comment default deny
				match any
				deny log warn
			}
		}

		authorization policy users_policy {
			set auth url "http://<IP_ADDRESS>"
			allow roles authp/admin authp/user
			crypto key verify {env.JWT_SHARED_KEY}
			acl rule {
				comment allow users
				match role authp/user
				allow stop log info
			}
			acl rule {
				comment default deny
				match any
				deny log warn
			}
		}

		authorization policy admins_policy {
			set auth url "http://<IP_ADDRESS>"
			allow roles authp/admin authp/user
			crypto key verify {env.JWT_SHARED_KEY}
			acl rule {
				comment allow users
				match role authp/user
				allow stop log info
			}
			acl rule {
				comment default deny
				match any
				deny log warn
			}
		}
	}
}

"http://<IP_ADDRESS>" {
	route /auth* {
		authenticate with myportal
	}

	route /guests* {
		authorize with guests_policy
		respond * "assetq - guests only" 200
	}

	route /users* {
		authorize with users_policy
		respond * "assetq - users" 200
	}

	route /admins* {
		authorize with admins_policy
		respond * "assetq - admins" 200
	}

	route /app* {
		authorize with users_policy
		reverse_proxy <IP_ADDRESS>:3000
	}

	route {
        redir / /app/ 308
	}
}

i really need your help rightnow, thankyou

@mahq195 , you are using HTTP. Therefore you need the cookie insecure on.
See: https://authp.github.io/docs/authenticate/auth-cookie

hi @greenpau, following you, now i can see password page in stead of unauthorized. But i still get the above error, also i dont see any password for webadmin user in the logs

following you, now i can see password page in stead of unauthorized. But i still get the above error, also i dont see any password for webadmin user in the logs

@mahq195 , please look in here on how to set your own user: https://github.com/authp/authp.github.io/issues/20#issue-1230086997

Thank a lot, now i can login, but still get some problems:

after logging in, when i reload the page, i want to re-log in again, then get the error

when route to my /app, i get Cannot GET /app. i dont know why
Sorry this is the first time i work with this server and this plugin

Also i provide you my current caddyfile:
{
	order authenticate before respond
	order authorize before basicauth

	security {
		local identity store localdb {
		realm local
		path {$HOME}/.local/caddy/users.json
		user webadmin {
                name webadmin
                email<EMAIL_ADDRESS>                password "Admin@123" overwrite
                roles authp/admin authp/user
			}
		}

		authentication portal myportal {
			# crypto default token lifetime 3600
			crypto key sign-verify {env.JWT_SHARED_KEY}
			enable identity store localdb
			cookie domain "http://<IP_ADDRESS>"
			cookie insecure on
			ui {
				links {
					"My Website" "http://<IP_ADDRESS>/app" icon "las la-star"
					"Guests" "http://<IP_ADDRESS>/guests" icon "las la-star"
					"Users" "http://<IP_ADDRESS>/users" icon "las la-star"
					"Admins" "http://<IP_ADDRESS>/admins" icon "las la-star"
					"My Identity" "/auth/whoami" icon "las la-user"
				}
				# password_recovery_enabled yes
			}
			transform user {
				match origin local
				action add role authp/user
				ui link "Portal Settings" /settings icon "las la-cog"
			}
		}

		authorization policy guests_policy {
			set token sources cookie
			validate bearer header
			# disable auth redirect
			set auth url "http://<IP_ADDRESS>/auth"
			allow roles authp/admin authp/user
			crypto key verify {env.JWT_SHARED_KEY}
			acl rule {
				comment allow guests only
				match role guest authp/guest
				allow stop log info
			}
			acl rule {
				comment default deny
				match any
				deny log warn
			}
		}

		authorization policy users_policy {
			set token sources cookie
			validate bearer header
			set auth url "http://<IP_ADDRESS>/auth"
			allow roles authp/admin authp/user
			crypto key verify {env.JWT_SHARED_KEY}
			acl rule {
				comment allow users
				match role authp/user
				allow stop log info
			}
			acl rule {
				comment default deny
				match any
				deny log warn
			}
		}

		authorization policy admins_policy {
			set token sources cookie
			validate bearer header
			set auth url "http://<IP_ADDRESS>/auth"
			allow roles authp/admin authp/user
			crypto key verify {env.JWT_SHARED_KEY}
			acl rule {
				comment allow users
				match role authp/user
				allow stop log info
			}
			acl rule {
				comment default deny
				match any
				deny log warn
			}
		}
	}
}

"http://<IP_ADDRESS>" {
	route /auth* {
		authenticate with myportal
	}

	route /app* {
		authorize with users_policy
		reverse_proxy <IP_ADDRESS>:3000
	}

	route {
        redir http://{hostport}/auth 302
	}
}

rightnow i fixed those problems above, the only one i'm facing to is that when i click to "My website", i get like this

I think the problem lying at
route /app/* {
		authorize with users_policy
		reverse_proxy <IP_ADDRESS>:3000
	}

but i dont know to fix it yet :). If you want to see full my caddyfile, check the previous comment.
I am looking forward to get your opion, Mr.@greenpau

but i dont know to fix it yet :). If you want to see full my caddyfile, check the previous comment.

@mahq195 , my guess is that your request reached your reverse proxy (<IP_ADDRESS>:3000), but you node.js router is not able to match it.
I would suggest
	route /app* {
		authorize with users_policy
		uri strip_prefix /app
		reverse_proxy <IP_ADDRESS>:3000
	}

hi sir, i already  run the plugin, thankyou very much

@mahq195 , resolved?


Update Tutorials

Documentation
The tutorials are outdated. In the meantime we updated file names (DKTatlas and mapped, see #121 and  #129 ), and maybe also command line flags. Also we have docker images at dockerhub so there is no need to build your own.
These things should be updated in the tutorial slides:
https://docs.google.com/presentation/d/1xuMFBo-AQMwdH8MplUWgEvn9z0bJk6p1mzi2vm-mKvs/edit#slide=id.gd6816a7d85_0_166
and also double check the colab tutorials.
It probably makes sense to do all this for the next major release with the FastSurferVinn.

I have added an INSTALL.md (which may need some further updates and checks) in 9451196 .
Further, I re-formatted and updated the --help texts of run_fastsurfer.sh and recon-surf.sh  (see 6f02277 ). Other scripts may need similar treatment (also in python, output formatting could probably be improved).
newly added python scripts in recon_surf need coherent docstring formting for the new functions.

This should probably be moved up on the priority list now.

Documentation and tutorials have been updated to v 2.0


[ci] Updated hard-coded core version in another file

Issue and/or context: Found on drive-by while debugging https://github.com/TileDB-Inc/tiledbsoma-feedstock/pull/95
Changes: Now that we have one more hard-coded path (#1937), have the updater not fail to update it
Notes for Reviewer:

I'll manually backport to release-1.7


Strange! Each request consumes an additional 2 seconds when I used /api/embed

What is the issue?

OS: win11
device: intel i5 1335U with only iGPU
embedding model: shaw/dmeta-embedding-zh-q4
I test with very simple input: ["你好"]
OS
Windows
GPU
Intel
CPU
Intel
Ollama version
0.3.4

What's making the API call?  Making a direct API call in linux doesn't show any delays:
$ curl -s localhost:11434/api/version
{"version":"0.3.4"}

$ for i in {1..5} ; do curl -s localhost:11434/api/embed -d '{"model":"shaw/dmeta-embedding-zh-q4","input":"你好"}' | jq -c 'del(.embeddings[0][])' ; done
{"model":"shaw/dmeta-embedding-zh-q4","embeddings":[[]],"total_duration":138950724,"load_duration":1587447,"prompt_eval_count":4}
{"model":"shaw/dmeta-embedding-zh-q4","embeddings":[[]],"total_duration":142275262,"load_duration":1525043,"prompt_eval_count":4}
{"model":"shaw/dmeta-embedding-zh-q4","embeddings":[[]],"total_duration":145625093,"load_duration":1402358,"prompt_eval_count":4}
{"model":"shaw/dmeta-embedding-zh-q4","embeddings":[[]],"total_duration":148817738,"load_duration":1032026,"prompt_eval_count":4}
{"model":"shaw/dmeta-embedding-zh-q4","embeddings":[[]],"total_duration":145985135,"load_duration":1396395,"prompt_eval_count":4}

$ docker compose logs ollama | grep /api/embed
ollama  | [GIN] 2024/08/07 - 17:34:32 | 200 |  139.237667ms |   <IP_ADDRESS> | POST     "/api/embed"
ollama  | [GIN] 2024/08/07 - 17:34:32 | 200 |  142.622972ms |   <IP_ADDRESS> | POST     "/api/embed"
ollama  | [GIN] 2024/08/07 - 17:34:32 | 200 |  145.953288ms |   <IP_ADDRESS> | POST     "/api/embed"
ollama  | [GIN] 2024/08/07 - 17:34:32 | 200 |  149.176403ms |   <IP_ADDRESS> | POST     "/api/embed"
ollama  | [GIN] 2024/08/07 - 17:34:32 | 200 |  146.312404ms |   <IP_ADDRESS> | POST     "/api/embed"

What's making the API call? Making a direct API call in linux doesn't show any delays:
$ curl -s localhost:11434/api/version
{"version":"0.3.4"}

$ for i in {1..5} ; do curl -s localhost:11434/api/embed -d '{"model":"shaw/dmeta-embedding-zh-q4","input":"你好"}' | jq -c 'del(.embeddings[0][])' ; done
{"model":"shaw/dmeta-embedding-zh-q4","embeddings":[[]],"total_duration":138950724,"load_duration":1587447,"prompt_eval_count":4}
{"model":"shaw/dmeta-embedding-zh-q4","embeddings":[[]],"total_duration":142275262,"load_duration":1525043,"prompt_eval_count":4}
{"model":"shaw/dmeta-embedding-zh-q4","embeddings":[[]],"total_duration":145625093,"load_duration":1402358,"prompt_eval_count":4}
{"model":"shaw/dmeta-embedding-zh-q4","embeddings":[[]],"total_duration":148817738,"load_duration":1032026,"prompt_eval_count":4}
{"model":"shaw/dmeta-embedding-zh-q4","embeddings":[[]],"total_duration":145985135,"load_duration":1396395,"prompt_eval_count":4}

$ docker compose logs ollama | grep /api/embed
ollama  | [GIN] 2024/08/07 - 17:34:32 | 200 |  139.237667ms |   <IP_ADDRESS> | POST     "/api/embed"
ollama  | [GIN] 2024/08/07 - 17:34:32 | 200 |  142.622972ms |   <IP_ADDRESS> | POST     "/api/embed"
ollama  | [GIN] 2024/08/07 - 17:34:32 | 200 |  145.953288ms |   <IP_ADDRESS> | POST     "/api/embed"
ollama  | [GIN] 2024/08/07 - 17:34:32 | 200 |  149.176403ms |   <IP_ADDRESS> | POST     "/api/embed"
ollama  | [GIN] 2024/08/07 - 17:34:32 | 200 |  146.312404ms |   <IP_ADDRESS> | POST     "/api/embed"

I used python requests in windows
Here is the code:
    def request_ollama(query, host="localhost:11434", ollama_model_name="shaw/dmeta-embedding-zh"):
        """
        使用ollama的embedding策略
        """
        url = f"http://{host}/api/embeddings"

        payload = json.dumps(
                {
                    "model": ollama_model_name,
                    "prompt": query,
                }
            )
        headers = {"Content-Type": "application/json"}

        response = requests.request(
                "POST", url, headers=headers, data=payload, stream=False
            )
        embeddings = json.loads(response.text)
        return [embeddings["embedding"]]
    for i in range(10):
        print(i)
        print(request_ollama("你好"))

If you change localhost to <IP_ADDRESS> does it run faster?

If you change localhost to <IP_ADDRESS> does it run faster?

Amazing! It works! Thanks!

@AlbertXu233 does the issue persist when using localhost?

By switching to the IP you're likely bypassing hostname resolution and/or proxy configurations which are likely what is adding the latency.


Message editing, use Telecom for calls, video messages

Please test for bugs. Thanks!

Message editing & "Reply to" features aren't working: selecting a message and clicking on the corresponding buttons does nothing.
"Edit" button should be presented only for user's own messages (and not for other users' messages).
device-2023-01-03-203808.webm

Message editing & "Reply to" features aren't working: selecting a message and clicking on the corresponding buttons does nothing.

Fixed. The actual fix is replacing new PromisedReply<>(null) with new PromisedReply<>((Void[]) null).

"Edit" button should be presented only for user's own messages (and not for other users' messages).

Fixed.

Here are some issues:

Post a reply to an edited message. Then click on the quote. It should highlight the quoted message but doesn't.

Post a video file as an attachment. The displayed size is zero:

Hitting the save button on the file attachment containing a video file plays it instead of saving.

Posting video messages fails with W/SqlStore: Failed to insert message: topic is null

App won't play inline video messages

Hitting the save button on the file attachment containing a video file plays it instead of saving.

Scratch that. It does save the file. The video player that showed up confused me.

Post a reply to an edited message. Then click on the quote. It should highlight the quoted message but doesn't.

I cannot reproduce. There must be something more to it.

Post a video file as an attachment. The displayed size is zero:

I could not reproduce but had some issues which could have been related. Please let me know if it's still happenning.

Posting video messages fails with W/SqlStore: Failed to insert message: topic is null

Fixed

App won't play inline video messages

Fixed

Post a reply to an edited message. Then click on the quote. It should highlight the quoted message but doesn't.

I cannot reproduce. There must be something more to it.

It appears to be working if you post a reply an edited message from Tindroid.
Here are steps to reproduce:
0. Log in as alice (Web), as bob (Tindroid).

Edit a message as bob in Tindroid.
Reply to the edited message as alice in Web
Tap on the quote in Tindroid. Nothing happens while it should highlight the edited message.

Btw, it appears to be a problem in the Web as well (just reverse the alice and bob)

Post a video file as an attachment. The displayed size is zero:

I could not reproduce but had some issues which could have been related. Please let me know if it's still happenning.

Still getting it. I posted  https://user-images.githubusercontent.com/45520561/210872931-f29886ab-ef97-440c-8963-7714bce7126b.mp4 as a file attachment from Web (as alice) and opened Tindroid (as bob).

Posting video messages fails with W/SqlStore: Failed to insert message: topic is null

Fixed

App won't play inline video messages

Fixed

Interestingly enough, when I tried posting small-vid.mp4 as a video message from Tindroid (I increased max_message_size in the server config to make sure the file would be posted inline), I got
E/AndroidRuntime: FATAL EXCEPTION: videoFrameCapture
    Process: co.tinode.tindroidx, PID: 20755
    java.lang.IllegalStateException: Data cannot occupy more than 10240 bytes when serialized
        at androidx.work.Data.toByteArrayInternal(Data.java:407)
        at androidx.work.Data$Builder.build(Data.java:957)
        at co.tinode.tindroid.AttachmentHandler.enqueueMsgAttachmentUploadRequest(AttachmentHandler.java:248)
        at co.tinode.tindroid.VideoViewFragment.lambda$sendVideo$5$co-tinode-tindroid-VideoViewFragment(VideoViewFragment.java:334)
        at co.tinode.tindroid.VideoViewFragment$$ExternalSyntheticLambda6.done(Unknown Source:6)
        at co.tinode.tindroid.VideoViewFragment.lambda$videoFrameCapture$6(VideoViewFragment.java:351)
        at co.tinode.tindroid.VideoViewFragment$$ExternalSyntheticLambda0.onPixelCopyFinished(Unknown Source:6)
        at android.view.PixelCopy$1.run(PixelCopy.java:191)
        at android.os.Handler.handleCallback(Handler.java:790)
        at android.os.Handler.dispatchMessage(Handler.java:99)
        at android.os.Looper.loop(Looper.java:164)
        at android.os.HandlerThread.run(HandlerThread.java:65)

It seems like it's some kind of a built-in limitation in Android...

It seems like it's some kind of a built-in limitation in Android...

I've seen this before. It's not too hard to fix. I'll look into it.

Still getting it. I posted

Is it posted inline?

Posting a large file (out of band) as a video message is failing with
E/SpannableStringBuilder: SPAN_EXCLUSIVE_EXCLUSIVE spans cannot have a zero length
E/SpannableStringBuilder: SPAN_EXCLUSIVE_EXCLUSIVE spans cannot have a zero length
W/AttachmentHandler: File size is zero; uri=content://com.android.providers.downloads.documents/document/59; file=/document/59

Posting a large file (out of band) as a video message is failing with

What's your Android API version?

Still getting it. I posted https://user-images.githubusercontent.com/45520561/210872931-f29886ab-ef97-440c-8963-7714bce7126b.mp4 as a file attachment from Web (as alice) and opened Tindroid (as bob).

Fixed it in webapp. I also added handling of missing file size in entity data in Tindroid.

Posting a large file (out of band) as a video message is failing with

What's your Android API version?

Good point. Upgraded to 32. The error went away.

Good point. Upgraded to 32. The error went away.

It still needs to be fixed on older Androids. What was your API version when it was failing?

All fixed except:

Posting a large file (out of band) as a video message is failing with
W/AttachmentHandler: File size is zero; uri=content://com.android.providers.downloads.documents/document/59; file=/document/59

I still cannot reproduce. I suspect it's dependent on the location of the file. Which folder is it in?

Post a reply to an edited message. Then click on the quote. It should highlight the quoted message but doesn't.

This is a bug in webapp.
Unfortunately, there is a problem with VideoView on older Androids (~26 and below). It's buggy to the point of being unusable. It fails randomly while trying to play remote URLs because it sometimes decides that a URI starting with http:// is a local content:// URI. The only recommended fix is to replace VideoView with ExoPlayer. I guess I have to do it.

All fixed except:

Posting a large file (out of band) as a video message is failing with
W/AttachmentHandler: File size is zero; uri=content://com.android.providers.downloads.documents/document/59; file=/document/59

I still cannot reproduce. I suspect it's dependent on the location of the file. Which folder is it in?

Files/Downloads folder. I can no longer reproduce it either (tested on a brand new Pixel 3/API 27 emulator).
Let's proceed as is.

Post a reply to an edited message. Then click on the quote. It should highlight the quoted message but doesn't.

This is a bug in webapp.
Unfortunately, there is a problem with VideoView on older Androids (~26 and below). It's buggy to the point of being unusable. It fails randomly while trying to play remote URLs because it sometimes decides that a URI starting with http:// is a local content:// URI. The only recommended fix is to replace VideoView with ExoPlayer. I guess I have to do it.


Added support for gskip/gcount in /delete endpoint

No gcount gskip into FETCH or FIND documentation... must add it too.


feat: fetch Dune Safe numbers

What it solves
Resolves #223
How this PR fixes it

The Safe stats are pulled from Dune during build time.
Fallback numbers replace an unsuccessful fetch.

On clicking the numbers in the Homepage, user is taken to the the respective Dune queries.

Fetches: totalTransactions, totalAssets and totalSafesDeployed.

General note: don't think it's a good idea to make 3 API requests on each page load. I would suggest moving this to getStaticProps and updating the Dune numbers only during a build. With a steady release cadence they won't get outdated and it's obviously more convenient than editing them by hand.

I've run the build locally to test it and it fetches 17M for totalTransactions (different from the fallback) so I think it is working well. We'll see now on staging after merging the branch into main


NotImplementedError: The detect_pii_entities action has not been implemented

I am using moto==4.1.8, and start as the server via the command:
moto_server -p3000

I also set my boto3 endpoint_url=http://<IP_ADDRESS>:3000
then when I trigger my code which includes AWS Comprehend function Detect PII Entities. turns out this error from the moto_server side:
NotImplementedError: The detect_pii_entities action has not been implemented

thanks.

Thanks for raising this @goodspb, and welcome to Moto! Marking this as an enhancement to add this feature.

@goodspb the detect_pii_entities will return a canned response. Do you have any preference as what should that be? If not then how about something like:
{'Entities': [
  {'Score': 0.9999890923500061, 'Type': 'NAME', 'BeginOffset': 50, 'EndOffset': 58},
  {'Score': 0.9999966621398926, 'Type': 'EMAIL', 'BeginOffset': 230, 'EndOffset': 259},
  {'Score': 0.9999954700469971, 'Type': 'BANK_ACCOUNT_NUMBER', 'BeginOffset': 334, 'EndOffset': 349}
]}

@rafcio19 that would be great. thanks for the help.


refactor: linux pipeline to use containers only for yarn step

Currently in Linux prod pipeline agents from https://github.com/microsoft/vscode-linux-build-agent are used to run both build as well as tests, with Node v18 not being able to run on Ubuntu bionic some of our pipeline dependencies will get locked to EOL versions. To avoid this issue, the PR restricts the usage of container to only the yarn step and rest of the steps will now run on the 1ES agent that can move forward independently.
Needed for https://github.com/microsoft/vscode/pull/188268

Sanity build: https://dev.azure.com/monacotools/Monaco/_build/results?buildId=224489&view=results


using Filter Inside a controller

Hi,
How can we use this filters inside a angularjs controller. It works fine when I use it inside  html with ng repeat
"data-ng-repeat="orders in orderList | unique: 'submission_Date'"
but when I try to use it inside my controller then it is not working properly
console.log($filter('unique')($scope.orderList ,$scope.orderList .submission_Date));

You will need to run a loop inside the controller too Eg:
angular.forEach($scope.orderList, function(order) {
    // Your filter
})

@amer4 think this will work:
$filter('unique')($scope.orderList, 'submission_Date');


Use AES encryption when not on windows

When not on windows, instead of using Data Protection API, use AES encryption.

Fixes issue #3768

Is this backwards compatible? I assume it is, but are windows users forced to reenter their passwords?

Its backwards compatible. If its on windows we will use DPApi. Else, use AES. That means if it worked before on windows, you will not have to re-enter

do you think this should go to paket 5.x as well? then pleae feel free to send a similar PR that targets  bugfix branch.
Thanks!

OK will do


Auth failure doesn't close websocket?

If the authEndpoint (/broadcasting/auth) fails with a 403, the websocket doesn't receive any messages, but it also doesn't close - it stays open.
Could you explain to me why this is not the case? It would seem to me that it would be good to use less server resources.
Is there a benefit that I'm not aware of?
Is this a feature that just hasn't been implemented?
I don't think this is specific to my installation, but let me know if I'm missing something.
Thanks for this library.

The auth happens on the channel level, not at the connection level.
So you can still have the connection established and do your thing on joining/subscribing to other channels without having to re-establish the connection.


Automatic failover for master server nodes.

If the property coderadar.master is set, the job triggers are activated on that node, meaning that it triggers jobs that are then processed by the slave server nodes.
If the master node shuts down, no jobs will be triggered anymore, meaning no analyses take place anymore.
Devise a communication mechanism that automatically lets another server node take over the master role.

Should be added at a later date, since high availability is not a concern for now. The worst that will happen if the master node dies is that no new incoming commits are being scanned and analyzed. A restart of the Master node will fix this.
Scalability is more important than high availability for now.

The job framework is dropped (see #204), so this is no longer needed. If a job framework is added again, the issue can be opened again.


Parameters in camera.pixformat(x)

Dear Mr. Sharil,
Thanks for the firms and your great works!
I've installed your firm v1.20.0-162-gd080d427e-kaki5 on 2023-06-07; ESP32-CAM OV2640 w/SSL (KAKI5) with ESP32 for my ESP32-CAM, and these steps are:
import camera, machine
*# init camera
cam = camera.init()
if cam:
print("Camera ready?: ", cam)
else:
camera.deinit()
machine.reset()
*# set preffered camera setting
camera.framesize(1)     # 1:96x96
camera.pixformat(0)     # 0:JPEG
img=camera.capture()
print(len(img))
camera.deinit()
Thonny shows the right result if camera.pixformat(0) or without it.

Camera ready?:  True
1784

Once I try to do these:
camera.pixformat(1)  #  1:Grayscale (2bytes/pixel)
or
camera.pixformat(2)  #  2:RGB565
I have got the error:  TypeError: object of type 'bool' has no len()
Read from help.py, it shall be ok since pixformat has three parameters(0:JPEG, 1:Grayscale (2bytes/pixel), 2:RGB565)
What shall I do? Thanks！
Good day!
George

Thanks for reporting this. It appears that you have caught a bug that was reported [here] (https://github.com/espressif/esp32-camera/issues/436).
The default image format is JPEG. This only happens for 96x96:JPEG. For earlier firmwares, this bug will persist, i.e. the lowest framesize for jpeg will then be 2:160x120 or 5:240x240 for a square image.
The help.py is no longer correct, the note on pixformat is wrong.
MicroPython v1.20.0-206 was the last version built with esp-idf-4. All MicroPythons after that will only build with esp-idf-5.
I am working on new firmwares. These firmwares will use esp-idf-5.x.x, and with some minor fixes in the camare module, the 96x96:JPEG bug seems to be fixed.
>>>
MPY: soft reboot
MicroPython v1.20.0-242-g6a9db521e on 2023-07-03; ESP32 AIT OV2640 (KAKI5) with ESP32
>>> import camera
>>> camera.init()
True
>>> camera.framesize(1)   # 96x96
>>> camera.pixformat(4)   # Grayscale
>>> img=camera.capture()
>>> len(img)
1043
>>> camera.pixformat(5)   # jpeg
>>> img=camera.capture()
>>> len(img)
1027
>>> img=camera.capture()
>>> print(len(img))
1079

The help.py needs to be fixed. As soon as I finish testing, I will upload the latest firmwares to the github.
If you need to use 96x96:JPEG, you will have to wait a little bit longer.

Thanks a lot!
👍


Arrow pointing upward, not on road.

Looks like a promising fix!!
https://i.imgur.com/sfFVDqo.png
https://openstreetcam.org/details/2867422/0/track-info

not sure about that. is that arrow on map supposed to always point to north?
Originally posted by @jose1711 in https://github.com/openstreetcam/upload-scripts/issues/101#issuecomment-669214585
The above is from openstreetcam/upload-scripts#101
The arrow is not pointing upward.

Looks like Android application calculates (unlike the upload scripts) the view angle by looking at the next location in the sequence (i. e. compass data is not used). This is similar to Mapillary does - however OSC website does not provide a way to "normalize" (term coming from Mapillary) the views.

@jose1711 ok, thanks for the info.
also, thanks for the script, i made a pr for jose1711/upload-scripts#1 for the easy usage of the new uploader.


Improve setup.py and install docs

This PR:

Simplifies setup.py to just require pyparsing>=2.0 and make it clear that we only support Python 2.7 and 3.4+. As far as I can see, pyparsing>=2.0 should just work on Python 2.7 and 3.4+, it's no longer necessary to require different pyparsing versions for Python 2 and 3.
Rewrites the installation page to make it (hopefully) better:

Simplified description of dependencies
Separate instructions how to install stable and dev version
Add instructions for conda install
Add instructions how to run tests

Coverage remained the same at 63.13% when pulling 09893d91a5ff878a9335e7ebc4f0575a01e40cbe on cdeil:conda-install-docs into 41a7f5873d396f3297e89f1417a4201ba9bb2b69 on astropy:master.

travis-ci passed.
I think this is un-controversial, merging this now.
Of course, review and feedback (here or as new PRs and issues) are welcome any time.


Fixed swapped links in the live data FAQ page

The links for the DataLogger and DataStreamer examples were swapped.

Thanks @frostblue!
https://scottplot.net/faq/live-data/


Al 2035

Codecov Report

Merging #677 (0402f88) into master (3efb30e) will increase coverage by 0.79%.
The diff coverage is 8.51%.

:mega: This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more
@@            Coverage Diff             @@
##           master     #677      +/-   ##
==========================================
+ Coverage   43.23%   44.02%   +0.79%
==========================================
  Files          47       47
  Lines        7036     7189     +153
==========================================
+ Hits         3042     3165     +123
- Misses       3994     4024      +30

Impacted Files
Coverage Δ

assemblyline_core/metrics/es_metrics.py
0.00% <0.00%> (ø)

assemblyline_core/metrics/metrics_server.py
0.00% <0.00%> (ø)

assemblyline_core/scaler/scaler_server.py
27.43% <0.00%> (-0.40%)
:arrow_down:

assemblyline_core/updater/helper.py
0.00% <0.00%> (ø)

assemblyline_core/updater/run_updater.py
0.00% <0.00%> (ø)

...mblyline_core/scaler/controllers/kubernetes_ctl.py
11.50% <16.66%> (+0.12%)
:arrow_up:

assemblyline_core/server_base.py
82.22% <100.00%> (+0.19%)
:arrow_up:

assemblyline_core/alerter/processing.py
89.00% <0.00%> (-0.53%)
:arrow_down:

assemblyline_core/dispatching/dispatcher.py
75.60% <0.00%> (ø)

assemblyline_core/ingester/ingester.py
79.25% <0.00%> (+0.30%)
:arrow_up:

... and 1 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.


Added myFriendGroups (Friend Tags) functionality

friendsGroupList is now emitted when our friends group list is
downloaded from Steam after logon.
user.myFriendGroups

This looks good. Please just make another commit to fix the readme issue and it'll automatically update this pull request.
Also please change **v1.9.X or later is required to use this event** to **v1.10.0 or later is required to use this event**.
Finally, if you can please add a note to the readme that friend groups are called "tags" in the client, that should help to clear up any confusion.

Ok I removed the parseInt because the Integers are too large. Everything is tested and it is working.


useSWRPages does not reset its state when pageKey changes

Hi again!
I have a component that uses useSWRPages to display a paginated chat.
useSWRPages has a key that looks like chat:channel:<channel-id>
the issue is that when the channel ID changes (and therefore the key changes), useSWRPages does not reset its internal state, so it still uses the pageCount, pageOffsets, and pageSWRs of the previous channel (resulting in strange behaviors such as displaying duplicated content or content from another channel).
I have a workaround where I basically put a key on my component to force reset it completely, but this sounds like a bug
I think the solution is simple, you need a setState that is able to reset its state to the default value whenever its dependencies change

I'm also having this issue and would really appreciate if it got fixed. For the time being I'm considering calling trigger('page-key') from the button that should cause the list to be refreshed because of the key change, but it is really not what we should be doing going forward.

I was trying to come up with a fix in SWR's code when I realised that there's a 4th argument in the useSWRPages called deps which one is supposed to use to make pages reset according to a value.  I've tried it out and it is working as expected. deps is array, so you should pass something like [chat:channel:${channelId}].

The new pagination API has launched: https://swr.vercel.app/docs/pagination. Feel free to reopen if you are still encountering an issue!


Clarify regex usage for constr in documentation

It might be helpful to clarify that the constr type validator's regex argument uses re.match() which only requires a partial match on the string. This personally bit me as I assumed the ^ and $ weren't required and put a length restriction in the expression but the field validated as the start of the string matched.
Updating the example in the documentation would probably cover it:
regex_str: constr(regex='^apple (pie|tart|sandwich)$')

Alternatively, it could use re.fullmatch() but that would change the behavior of the validator.

Thanks for reporting, perhaps fullmatch would have been a good idea, but we can't really change the behaviour until v2 (if you think that's a good idea, I guess create a clear new issue).
In terms of documentation, I completely, PR very welcome.


What to do with Analyzers after upgrade?

What should be done with Microsoft.Dotnet.UpgradeAssistant.Extenstions.Default.Analyzers package after upgrade? Is it supposed to be removed?
I completed upgrade of a class library and now I several warnings from different Analyzers like these
Warning	CS8032	An instance of analyzer Microsoft.DotNet.UpgradeAssistant.Extensions.Default.CSharp.Analyzers.AllowHtmlAttributeAnalyzer cannot be created from C:\Users\xxxx.nuget\packages\microsoft.dotnet.upgradeassistant.extensions.default.analyzers\0.2.217201\analyzers\dotnet\cs\Microsoft.DotNet.UpgradeAssistant.Extensions.Default.CSharp.Analyzers.dll: Could not load file or assembly 'Microsoft.CodeAnalysis, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=31bf3856ad364e35' or one of its dependencies. The system cannot find the file specified.

Where are you seeing this warning? Is it in VS or .NET CLI? If so, can you share which version of the tool you're using?

I get the warnings in VS and in command line when running dotnet build. I'm using version 0.2.217201+d343ba735920891597ff387f9445430b478cf267
When I build the project in Release configuration some of these warnings show up are errors.

@sitty, does the .csproj files have any PackageReference with microsoft.dotnet.upgradeassistant.*?

Yes it does
   <PackageReference Include="Microsoft.DotNet.UpgradeAssistant.Extensions.Default.Analyzers" Version="0.2.217201">

@sitty which version of VS? Sounds like we may be using too late of a version of the code analysis library when run in VS.
Upgrade Assistant will add the analyzers to your project. If you are done with them, feel free to remove them. We could look at removing them as well. However, if we were to downgrade which of code analysis library we use, they should run with no problem in VS/CLI and you won't know the difference.

I can try to upgrade VS to16.9.2 and retry. I'm also getting the same warnings upon running dotnet build from terminal.

I tested with VS 16.9.3 and I don't get these warnings.

Ok - so we should look at downgrading some of our analyzer dependencies so that doesn't show up for people

@twsouthwick Going to follow-up with Roslyn team on what version to downgrade to.


Grid off when I create dwg file

Hi
how can I have Grid off in model when I create dwg file

Hi @sigster
To disable the Grid check the *Active VPort and disable the ShowGrid flag.

Hi
Any change you can help me with sample code
Regards
Sigster

	CadDocument doc;
	using (DwgReader reader = new DwgReader(_file))
	{
		doc = reader.Read();

		//This sets the grid off for the *Active VPort
		doc.VPorts[VPort.DefaultName].ShowGrid = false;

		//This guarantees that all VPort configurations have the grid off
		foreach (VPort vp in doc.VPorts)
		{
			vp.ShowGrid = false;
		}
	}

Let me know if this helps.

This works
Thanks ComCR


Regression in Pip

I'm using the python:alpine Docker image. Last week, an updated version of it was released, which, among other things, upgraded Pip to 19.0.1. This version of Pip contains bug pypa/pip#6197, a regression from Pip 18.1. As a result, some of my images based on this one are failing to build unless I use one of the workarounds listed there. Would it be possible to update the image again to include Pip 19.0.2, which fixes the regression?

https://github.com/docker-library/python/issues/372

Fixed in docker-library/official-images@31e4aec


dyld: Library not loaded: @rpath/ObjectiveGit.framework/ObjectiveGit

I build  objective-git by Carthage as the readme told me, and run it in my iPad Simulator, but it cant run,and the console show as below:
dyld: Library not loaded: @rpath/ObjectiveGit.framework/ObjectiveGit
Referenced from: /Users/chenyl/Library/Developer/CoreSimulator/Devices/533A4827-3BD7-4ABE-BFDE-B5AF7F87E998/data/Containers/Bundle/Application/431C8BF3-1E5D-477A-8403-BA32F3DDAF52/yomi.app/yomi
Reason: image not found

Are you sure you followed the copy-frameworks step of the Carthage instructions?
That message means that ObjectiveGit.framework wasn't copied into your application bundle.

@mdiep  yes,im sure

Oh, have you set the @rpath value for your application?
You'd need to go to the app target's build settings and look at Runpath Search Paths. @executable_path/../Frameworks should be one of the values for that setting.

@zixun I just faced the same problem in another project with another library somehow during all the Xcode betas it messed up the project and I couldn't get it to work. The workaround for me was to remove the target and create a new one while strange it makes sure all the new Xcode defaults are set correctly.

@pietbrauer  thx~ i'll try your idea

@zixun any update on this?

Closing this as it is most likely solved, feel free to reopen if it still occurs.


fix: Deployment name in HPAs scaleTargeRef spec

The Deployment name in helm/oauth2-proxy/templates/deployment.yaml is configured with {{ template "oauth2-proxy.fullname" . }} which can cause Deployment not found issues when the default Release name is overwritten.

@losil Thank you.


[v0.16.0] Granite/Mistral models respond with nonesense/hallucinate

Describe the bug
Models like granite or mistral when served with the v0.16.0 hallucinate pretty badly when even prompted with a simple 'hello'. Both for the base and trained models.
The exact same models work fine with v0.15.1
To Reproduce
Steps to reproduce the behavior:

Serve https://huggingface.co/instructlab/granite-7b-lab-GGUF/blob/main/granite-7b-lab-Q4_K_M.gguf with the v.0.16.0
Chat and send a "hello"

Expected behavior
Model shouldn't hallucinate that badly
Screenshots

Device Info (please complete the following information):

Hardware Specs: M1, 32GB
OS Version: Sonoma 14.5
Python Version: Python 3.12.3
InstructLab Version: [output of ilab --version]

Additional context

I was able to reproduce this

I am also able to reproduce this.

We have also had a few reports in the #users channel in slack about this too.

@jjasghar was anyone on Slack able to determine a root cause? I think this bug would be worthy of a 0.16.1 - if we can get a fix I can backport/release that next week

Bug is also present on the main branch

We have also had a few reports in the #users channel in slack about this too.

which is the slack channel? cause I only saw one IBM internal one without much going on

Thanks for the report.  I used git bisect to narrow it down
It broke here:

[bf332e84a3ddeaa4150bbeb6fb05648d6d0e8537] option --model-family forces model_family

from #1174
I'm looking into a fix (or I'll just revert the change if needed)

I see the problem and will post a fix shortly.

Yesterday I posted in #users in the InstructLab Community, the error seem to happen because of the wrong model family, I could get merlinite running by setting the model family while serving merlinite, but by default, it didn't even choose the right model family for the merlinite model. I think it uses the wrong template.

We have also had a few reports in the #users channel in slack about this too.

which is the slack channel? cause I only saw one IBM internal one without much going on

https://github.com/instructlab/community/blob/main/Collaboration.md#chat

@Ardian0x26 Yes, exactly


SocketSender: Software caused connection abort is not passed to IConnectionInterface

Describe the bug
When the connection is lost (for example, if data is turned off) none of the Exception callbacks are called.
To Reproduce
Steps to reproduce the behavior:

Connect to mysql database
Disable Wifi and mobile data

Expected behavior
The error is passed to the callbacks passed to the connection.

how you managing to find all the bugs :)
Is it after you disable wifi and mobile data and you then go to run a query the error callback isn't being triggered and nothing happens or it just crashes, or are you expecting the library to throw an error straight after disabling data?
If the former where you run a query and the error callback isn't being triggered, are you giving it enough time to trigger, as it might take up to 30 seconds for a TCP timeout to occur. The library doesn't check the wifi/mobile data state as I think it requires extra permissions that might put some users off - but I can look into this in case that isn't correct.

My hostname is a local ip address and I expect it should lose connection once WiFi is turned off. If I turn off both WiFi and mobile data I get the following logs:
E/SocketSender: java.net.ConnectException: failed to connect to /<IP_ADDRESS> (port 3306) from /:: (port 38458): connect failed: ECONNABORTED (Software caused connection abort)
I expected this to be passed to the IConnectionInterface so that I can show an error message. I've waited a long while and nothing yet!
I don't think we'll need to monitor the connection state - it's just that SocketSender currently doesn't pass the IO Exception on 59 to the interface, and then exceptions that occur on line 307 in Connection.java aren't being sent anywhere either. Could we just pass this to the connectionInterface?

Ah I see, the IConnectionInterface is at a higher lever error handling in terms of direct MySQL errors, this error is happening at a lower level. I'll probably need to see if I can pass the IConnectionInterface into the SocketSender constructor so that when the SocketSender itself throws a lower level error, it can bubble up into IConnectionInterface.
I'll take a look at see how that would be implemented - a while since I wrote that part of the code.
I'll keep you updated.
Thanks
Chris

I've push out 0.44_MySQL8 which allows the socket sender to throw an IOException and pass that back to the IConnectionResult interface instead of it just throwing an error exception internally.
JitPack is currently building it though so its not available yet - its been going for around 30 minutes - this has happened once before where JitPack for some reason took a really long time to make it available so hopefully all being well it should be available in the not too distant future.
Thanks
Chris

There was an issue with 0.44 release for JitPack so you can use 0.45_MySQL8 instead

Hi Chris,
This is perfect. Thank you for taking the time to fix this, and for being so responsive here on GitHub. Been a lifesaver for the project I'm working on! I'm now able to show a message if the connection was lost which is fantastic.
Let me know if you have a donations link or anywhere I can send some appreciation :)

No problem at all, glad its working for you now.
I don't have any donation links anywhere but thank you for offering, much appreciated.
Any other issues though let me know :)
Thanks
Chris

I wasn't able to get the byte array from the server making any sense - it was always different to the byte array that I would send to the database. Luckily client didn't need this as a feature (just upload). Thanks for your help!


How to download older firmware version?

Hi,
thanks for the great project. My Fimi X8 is on the latest firmware and I'm constantly getting a "System is initializing" warning and am unable to take off.
I'd now like to try if a lower firmware version for flight control (e.g. 1060C) would help. Unfortunately I don't know where to download older versions. Can anybody help?

I think I have the same problem.
"System is preparing" and "System initializing" and unable to take off.
I also wanted to try an older firmware, but I cannot find any.


How to see console

How am i supposed to see the minecraft servers console, i cant do /op commands without it so

Yes I have the same question

remove the nogui tag from the shell command, or just use the nogui interface

@AkiPelaa and @Bobisawesome07, you could use something like tmux to run it in an second screen


💡[Feature]: K-means clustering to group customers based on their purchase history

Is there an existing issue for this?

[X] I have searched the existing issues

Feature Description
Create a K-means clustering algorithm to group customers of a retail store based on their purchase history.
Use Case
A retail store wants to understand their customer base better to develop targeted marketing campaigns and improve customer satisfaction. They have a dataset containing customer purchase history, including information like:
Customer ID
Transaction date
Amount spent
Items purchased (optional)
By applying K-means clustering to this data, the store can segment customers into groups with similar buying behaviors. This helps them create targeted marketing campaigns for each segment.
Benefits
No response
Add ScreenShots
No response
Priority
High
Record

[X] I have read the Contributing Guidelines
[X] I'm a GSSOC'24 contributor
[X] I want to work on this issue

I would like to work on this project. Please assign it to me.


Add "Deploy Static Site to AWS" action

Added due to a suggestion on reddit. This action handles everything needed to deploy a static site to AWS, including certificates, DNS records, cache invalidation...
Action: https://github.com/onramper/action-deploy-aws-static-site

Seems like the CI fail is not related to my changes:
  ✖   1:1  Forbidden license section found  remark-lint:awesome-license
  ✖  15:1  ToC missing item for "License"   remark-lint:awesome-toc


breaking: stricten types around depends and invalidate

require a : when passing a string now
closes #9763
Please don't delete this checklist! Before submitting the PR, please make sure you do the following:

[x] It's really useful if your PR references an issue where it is discussed ahead of time. In many cases, features are absent for a reason. For large changes, please create an RFC: https://github.com/sveltejs/rfcs
[x] This message body should clearly illustrate what problems it solves.
[ ] Ideally, include a test that fails without this PR but passes with it.

Tests

[x] Run the tests with pnpm test and lint the project with pnpm lint and pnpm check

Changesets

[x] If your PR makes a change that should be noted in one or more packages' changelogs, generate a changeset by running pnpm changeset and following the prompts. Changesets that add features should be minor and those that fix bugs should be patch. Please prefix changeset messages with feat:, fix:, or chore:.

Looks like some tests are failing because they don't contain : in the strings passed to invalidate

This actually unveiled a mistake I made - invalidate should still be allowed to be passed a string, because you can pass root-relative URLs to it and it will prepend the current host to it then.

Should depends also support root-relative URLs? I'm not super familiar with the APIs, but it seems a little surprising to me that it'd be allowed in only one of the two


Successfully redeeming promo code for in-app purchase in IOS app store is not triggering purchaseUpdatedListener

Description
In Testflight app on iphone, on entering promo code for in-app purchase, we are getting a success message from the app store but purchaseUpdateListener is not being triggered. Tested by adding alerts within purchaseUpdateListener.
Expected Behavior

Trigger Promo Code redemption using this URL(itms-apps://buy.itunes.apple.com/WebObjects/MZFinance.woa/wa/freeProductCodeWizard?code=PROMO_CODE') on click of button within app for an in-app purchase.
Click Redeem.
Success message shown in app store.
purchaseUpdatedListener receives an event and receipt.

Actual Behavior

Trigger Promo Code redemption using this URL(itms-apps://buy.itunes.apple.com/WebObjects/MZFinance.woa/wa/freeProductCodeWizard?code=PROMO_CODE') on click of button within app for an in-app purchase.
Click Redeem.
Success message shown in app store.
purchaseUpdatedListener receives NO event.

Environment:

react-native-iap:12.10.5
react-native:0.71.8
Platforms (iOS, Android, emulator, simulator, device): Testflight app on IOS real device

Additional Context
We are using the same purchase flow for in-app purchases and that is working accurately.

Can you describe the flow?


firstOrCreated with multiple conditions

I'm trying to get or create an object filtering using more conditions:
let person = context.people.firstOrCreated { $ 0.identifier == 123 && $0.name == "name"}.
it seems that the library is not allowing to do this. Is there any workaround?
Thank you

Hello. I could not pay more attention to the repository for some time. Sorry for not answer you before.
The firstOrCreated was a convenience method only. And it worked only with one condition. You can try to fetch the entity from context before and if it does not exist, insert one new instance.


Missing type definitions for jsc.record

It seems jsc.record is missing from the Typescript definitions.
In addition, it would be a really great addition to be able to get automatic generators for a Typescript class, making tests more resilient to changes in data. See https://github.com/rasmus-storjohann/TsAutofixture for an example of what I mean. Thanks!

Looks like this was already fixed in master months and months ago, could we get another release so we can use it? :)

For now you can work around it by copying the tsc file locally and using jsverify like:
///<reference path="./jsverify.d.ts" />
import jsc = require("jsverify");

Yep, this can be closed when there is a new npm release.

This can be closed now.


cc_vertexz=automatic not rendering the tile map layer

Tile map layer does not render and is blank when cc_vertexz is set to automatic in layer properties of an isometric tile map.

@mu1ex Are you still working on your game?


Add dropHead and dropTail.

See #9 - dropHead(n) would basically be the equivalent of slice(n), and dropTail(n) the equivalent of slice(0, length - n).

What's the direction of this project, are you creating api base on Lodash and Underscore or not?
Lodash has drop and dropRight

The lodash/underscore API is definitely an inspiration, however I've decided to do some naming slightly differently because unlike lodash, trine operates mostly on iterators instead of collections. Hence for example the prefix Right doesn't quite semantically fit because there is no right, just an end. As such, the terminology commonly used for streams (e.g. bash) makes more sense. However, Unix CLI tools often do too many things making it harder to reason about them, while with Trine I attempt to make the "do one thing and do it well" as absolute as possible, which is why head or tail don't have overloads that take instead of dropping.
This brings nice symmetry as well:

take -> filter out items that don't satisfy the condition.
drop -> filter out items that satisfy the condition.
takeWhile -> filter out items after the condition is first not satisfied.
dropWhile -> filter out items before the condition is first satisfied.
head (could also be named takeHead) -> take only N first items.
tail (could also be named takeTail) -> take only N last items.
dropHead -> take all except N first items.
dropTail -> take all except N last items.

however I've decided to do some naming slightly differently because unlike lodash, trine operates mostly on iterators instead of collections. Hence for example the prefix Right doesn't quite semantically fit because there is no right, just an end. As such, the terminology commonly used for streams (e.g. bash) makes more sense.

That sound even better, just what to understand more about this project and what direction you are going, keep up the good work :)


[SDA-6733] Added redhatmanaged=true tag to roles when rosa upgrade operator-roles is ran

SDA-6733

/lgtm


Failed to resolve import "../../extras/Gltf.vue" from "demo/gltf/App.vue". Does the file exist?

It looks like recently the extras folder disappeared, making Gltf and OrbitControlsWrapper not importable.
As a result, the Gltf demo doesn't work anymore.

Good find, thanks for flagging! I pushed and published a fix for that and a few other demos that were broken in the move to the monorepo. Closing as complete, but please do reopen if you see any other issues like this!


Third Person Character Sample for Unity

Wondering if a sample similar to the "Explore with Third Person Character" in the Unreal SDK  could be added for Unity?
I've been playing around with the Unity built in Third person template - it would be really cool to somehow import an Integrated Mesh Layer (.slpk) and have the character walk around in it.

Hi Francis. We have a third person sample for Unity. When using your own .slpk, remember to enable mesh colliders in the ArcGIS Map component.
Zack

Great! Not sure how I missed that.

I've added an integrated mesh layer to the project, and I'm able to zoom to the layer. I'd like the level to start at this location and have the player drop onto it. I tried updating both the Origin Position within the ArcGIS Map as well as ArcGIS Location within the Camera (this always seems to snap back to the original position). Any ideas?


System Call [Proposal & PR]

Add support for creating new processes with shell commands.
I propose to add this as a call method to the Process object in os with the following signature:

call(command): run the command, and return the exit code
call(command, async): run the command, and return the stdout of the command

if async is false, blocks until the command is done and returns its output as one string
if async is true, does some cool fibrous stuff, I'd like to discuss exactly what, as I'm not sure what the best course of action is.

My initial thought for the async method would be to mirror the API for Stdin.readline, though I'd like a little guidance on how best to achieve this.
I've already got a PR of the first method ready to go, tested on linux, I'm afraid I have no access to a windows PC.

On reflection, it seems that it would make most sense to superclass Stdin from io into a Stream class, that is inherited by Stdin, Subprocess.Stdin, and possibly File.  I'm really happy to re-write my code and try to do this properly over the next few months, but would really appreciate some outside input before I start coding :)


Per-Type Confidence Thresholds

fixes #897

Update bring a copy of the overall threshold over to the right menu since it affects the child threshold bars.
Add a reset button.

Styling native browser elements (does thumb and track count as shadow dom?) is a huge pain and I'd rather just not do it?
Still need to indicate something

Tweaked a bit more to add some color, make the size and color of the types consistent between the type list and the new threshold controls.


How to handle app with no extension

If I try to call an app with no extension - eg mapserv - then it assumes it's a directory and tries to add /index.js to it  .../mapserv/index.js
How do I specify not to add index.js ?

Oh, one more thing. If you wish to lookup for a script index.cgi instead of the default index.js inside directories, you may set this config: indexExtension: "cgi".
For your use case, assuming you are running your HTTP server on a POSIX system, setting a symlink pointing to your script mapserv would probably be a good workaround:
ln -s mapserv mapserv.cgi


[PDI-14172] - Text file input Repeat doesn't work

applying changes from 9e3e72d9d85ce5222a44b4ebe46d4e7163057e9e to new implementation of the step

@mattyb149, @brosander, review it please. This is a fix migration from https://github.com/pentaho/pentaho-kettle/pull/1731 to the new implementation

@mattyb149, @brosander, review it please.

@rpbouman if you can, please review

@mattyb149, @brosander, review it please.

@dkincade, would you minding looking at this? I believe it is better to include the fix into 6.0


On sign in you get a message" Welcome back, enjoy your bookmarks" even when you are not in the bookmarks

Describe the feature
Replace this message with a different message which is not specific to bookmarks instead
Add ScreenShots

Record

[X] I agree to follow this project's Code of Conduct
[X] I'm a GSSOC'24 contributor
[X] I want to work on this issue

Please assign me this issue @SiddharthBahuguna @anurag6569201


Apache HttpClient does not respect TLS configuration

During our attempted upgrade to 1.1.0 we noticed that some calls from the controller to the servers were failing due to TLS issues. We have 2-way TLS configured for our clusters and after investigation it seems like the Apache Http clients do not use the configured key/trust stores but just pickup the system defaults.
Error
2024/06/04 17:00:56.849 WARN [MultiHttpRequest] [async-task-thread-6181] Caught 'javax.net.ssl.SSLHandshakeException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target' while executing: GET on URL: https://{{server}}/tables/{{table}}/segments/{{segment}}/metadata?columns=
2024/06/04 17:00:56.849 ERROR [CompletionServiceHelper] [grizzly-http-server-6] Connection error . Details: javax.net.ssl.SSLHandshakeException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target

This seems to be due to two concrete issues:

We are not configuring the SSLConnectionSocketFactory correctly whenever we create a PoolingHttpClientConnectionManager and that defaults to creating the default socket factory
There is a bug in the version of the Apache httpcomponents-client that is being used where the default SocketFactory is always used instead of using the SSLConnectionSocketFactory. The bug is located here.

cc @zhtaoxiang @soumitra-st

This issue has been resolved and verified against the clusters we are running now. Thank you!


Introduce tile and multi-threads distribution of linalg ops for LLVMIR backends

Add support for tiling linalg ops and distributing them among logical IREE threads. Two ops are added to IREE dialect to model the indexing iree.workgroup_id {dimension} & iree.workgroup_size {dimension} assuming cubic grid dims (x, y, z).
In this PR:

The TileAndDistribute pass is following same structure as SPIRV/TileAndDistribute including constructing a function emitting grid size and inlining it.
Some common code is factored out to Conversion/CodegenUtils & Conversion/Common and used here only a follow up PR to use common code in SPIRV.
The pass is disabled by default but test with pass enabled is added

Next steps/PRs:

Add TileAndVectorize Pass.
llvm-flags driven  CPUKernelDispatch.
Support for linalg.batchmatmul tile and vectorize.
Support for other linalg ops.

cc: @nicolasvasilache


TextInput: filled input background-color is invalid on a dark theme

Expected behaviour
Filled input's background color should not change.
Actual behaviour
When filling the TextInput with a value, its internal input has light background-color.

UPD: this issue seems to only be valid when input is filled through browser's autocomplete.

Can't be fixed adequately as of today.


Add NVIDIA AV1 encoding support

Gstreamer finally supports NVIDIA hardware offloading for AV1, but it is not in the latest release so gstreamer must be build from main for now (verify with gst-inspect-1.0 | grep AV1).
Using the same nvav1enc settings as https://github.com/selkies-project/selkies-gstreamer/blob/main/src/selkies_gstreamer/gstwebrtc_app.py#L425 successfully works.  It will complain about the connection and crash if Moonlight's video bitrate is too high so adjust to something like 3 Mbps first.

Thanks for taking the time to make a PR, unfortunately it seems that we've overlapped!
We were testing this in Discord over the past few days, would you mind giving a go at the latest
ghcr.io/games-on-whales/wolf:dev-multi-gpu

?
It should take care of upgrading the config.toml with the latest defaults and automatically pick the AV1 encoder if available. Unfortunately I don't have 40xx to properly test it myself, so I'm relying on user inputs for the Nvidia encoder. Let me know how it goes!

I meant for this to be a draft, but I couldn't make it one.  I wasn't sure you'd want to merge in hard-coding git clone -b main for gstreamer.Dockerfile, but wanted to at least demonstrate it's working.
I think I had to delete my local /etc/wolf/cfg/config.toml to make it regenerate; if there's an "upgrade" script I need to fix, let me know.
If you're still interested in merging I'd be happy to rebase.

Thanks for your work, on my PR I've already pinpointed to the latest git commit on Gstreamer (instead of just pulling main) so unfortunately I'm afraid there's no need for this PR.
If you could test out the other image, that would be very helpful. If there's no issue with it, I'm going to close this one and merge the other one which includes a whole bunch of other improvements.
I'm really sorry we overlapped. If you'd like to contribute again, please send me a message so that we can coordinate our efforts! 😉

I see the overlapping changes you are referring to and I can confirm latest dev-multi-gpu works with AV1 codec from fresh config.toml.  Thanks!
One minor thing you might consider adding to yours is the cuda upgrade in gpuDrivers.dockerfile.

Thanks for testing it out!
We try to keep the cuda version as old as possible to support older cards. If that doesn't cause any issue I'll keep it at 11.x as long as I can!


fix: handle insecure-tls in all commands

I wasn't able to run the access-token-create command with the --insecure-tls flag.
So I suggest to handle the insecure-tls in all commands. I confirm that the lower layers of the CLI handle it perfectly.
Signed-off-by: francois  samin<EMAIL_ADDRESS>
[x] All tests passed. If this feature is not already covered by the tests, I added new tests.
[x] This pull request is on the dev branch.
[x] I used gofmt for formatting the code before submitting the pull request.

I have read the CLA Document and I hereby sign the CLA

recheckcla

@fsamin,
Thanks for creating this PR.
Just adding the --insecure-tls flag to those commands will not make it work. This is because the implementation does not use it. Unlike the mvn command, which translates this flag into maven equivalent maven options, gradle or the docker commands do not.

@fsamin,
Please let me know if you'd like to keep this PR open.


Policy create issues with Dead Letter Queue and XRay Tracing

I tried adding my function Dead Letter Queue(DLQ) SQS queue and enabling XRay tracing. The stack executer role also had the permissions enabled for the following resources sqs:* and xray:*.
The function has following inline policies for XRay:
- Effect: "Allow" # xray permissions (required)
  Action:
    - "xray:PutTraceSegments"
    - "xray:PutTelemetryRecords"
  Resource:
    - "*"

For SQS:
- Effect: Allow
  Action:
    - sqs:SendMessage
  Resource: "*"

When the stack's changeset is applied it would fail because:

12:47:11 UTC+0200 | UPDATE_ROLLBACK_IN_PROGRESS | AWS::CloudFormation::Stack | notifications-lambda | The following resource(s) failed to update: [GeneratorFunction].
-- | -- | -- | -- | --
  | 12:47:08 UTC+0200 | UPDATE_FAILED | AWS::Lambda::Function | GeneratorFunction | The provided execution role does not have permissions to call PutTraceSegments on XRAY

The current workaround is to deploy the function first time without the following options:
      DeadLetterQueue:
        Type: SQS
        TargetArn: !GetAtt NotificationDeadLetterQueue.Arn
      Tracing: Active

After that you can enable the options again, deploy and the stack apply would succeed. Seems like the serverless guys have same issue https://github.com/serverless/serverless/pull/3742.

It would be great if you guys could add your voice to the CloudFormation issue, it might help with getting it prioritised. Essentially roles take a while to be available, and CloudFormation continues before they are ready to use. I did get some feedback that they had fixed it for policies, but I still encounter the same problem. I've run into this outside of serverless as well, e.g. custom config rules or anything involving lambda needing a recently provisioned role.

@caevyn I was planning on trying to dig up what I can internally and see if I can't bring it to their attention more, especially if it was communicated it was fixed (from what I read on the other issue). The reality is that me commenting on an issue internally isn't enough. The more the community brings this up and pushes the pain point, the better shot we have to get this done (and done sooner).

I have let them know it didn't solve our issue, so they are aware of that. My communication with them is via a small not-for-profit's AWS support, so if it is coming from these high profile OSS projects it might get more visibility. There are work arounds, like splitting up stacks etc, but they don't work well with tools like serverless and SAM.

Ok, so at least they are aware. I should be able to find the issue for it and add some more details to it. I am not sure exactly what I will be able to share out of that (if anything), but I will see what I can do. :)
I agree they don't work well for these types of tools. We are trying to stream line some of this configuration for customers but needing to split up into stacks or to deploy twice is not ideal at all. That leads to the tools being harder to use. We totally hear ya and I am completely with you on that.

I was thinking about this more. If there was a way we could for a arbitrary wait (effectively sleep) between resources, we may be able to stop the bleeding until CloudFormation has the root caused fixed. I looked into WaitConditions, but that only waits for a certain number of success signals and don't see a way we could leverage that to help solve this. I looked at Custom Resources as well. I still don't understand them completely but at first glance that doesn't look like it helps much either. :(
Open to other ideas that you guys have. Going to leave this as closed for now, since I don't think we have any options to get around it at the moment but happy to reopen if we can figure out a path forward (other than bug CloudFormation).

Hi, I got some additional info from AWS support regarding this issue. See https://github.com/serverless/serverless/pull/3742#issuecomment-362946277
Initial testing with the serverless framework seems promising, although not perfect.


Create pipeline for creating a VSIX with a specific version of botbuilder-dotnet

Azure DevOps Pipeline for VSIX:

[ ] Stage 1: "Building VSIX"

[ ] Uses the latest nightly BotBuilder SDKs from MyGet/Nuget to update VSIX templates' dependency versions
Should also have a nullable "BotBuilderVersion" variable used to generate VSIX generators off of a specific nightly version
[ ] Building & invoking VSIX generators should succeed.

[ ] Stage 2: "E2E testing for generated bots"

[ ] Deploy VSIX-generated bots to Azure
[ ] Run functional tests against the deployed bots
The work performed by @BruceHaley in #2492 and #2493 should help here

Removed priority and added backlog label as future around VSIX is unclear


zstd compression

Is a support of zstd planned in near future?

No.
It should be kafka_protocol to support it.

see https://github.com/klarna/kafka_protocol/issues/55


Editing shared documents w/o write permissions located on webdav folder

I have Community Server with connected webdav folder (nextcloud).
When i'm trying to edit read-only document, it stores all the modifications locally.
For example:

create file on nextcloud read-only shared folder with "111" content with nextcloud GUI
open this file with CommunityServer Document Editor
edit "111" to "11", save, close
open this file with nextcloud GUI
see no modifications (only "111" inside), it's OK
open this file with CommunityServer Document Editor
see "11" inside, it's not OK

How to set CommunityServer not to store read-only files modifications in its cache?

Hello @eugenov
There is currently no way to customize Community Server not to store read-only files modifications in its cache.
Thank you for your suggestion. We will take it into consideration.