Dataset to zarr not working with newest s3fs Storage (s3fs > 0.5.0)

What happened:
A call to zarr storage to mino instance fails with newest s3fs storage (s3fs > 0.5.0) while perfectly working with s3fs == 0.4.0. Might be due to s3fs' reliance on aiobotocore as Traceback.
Traceback (most recent call last):
Exception in callback <TaskStepMethWrapper object at 0x7fbe34300350>()
handle: <Handle <TaskStepMethWrapper object at 0x7fbe34300350>()>
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/asyncio/events.py", line 88, in _run
    self._context.run(self._callback, *self._args)
RuntimeError: Leaving task <Task finished coro=<sync.<locals>.f() done, defined at /usr/local/lib/python3.7/site-packages/fsspec/asyn.py:43> result=None> does not match the current task None.
  File "test_without.py", line 27, in <module>
    array.to_dataset().to_zarr(store=s3store, mode="w", consolidated=True, compute=True)
  File "/usr/local/lib/python3.7/site-packages/xarray/core/dataset.py", line 1662, in to_zarr
    append_dim=append_dim,
  File "/usr/local/lib/python3.7/site-packages/xarray/backends/api.py", line 1369, in to_zarr
    writes = writer.sync(compute=compute)
  File "/usr/local/lib/python3.7/site-packages/xarray/backends/common.py", line 161, in sync
    regions=self.regions,
  File "/usr/local/lib/python3.7/site-packages/dask/array/core.py", line 981, in store
    result.compute(**kwargs)
  File "/usr/local/lib/python3.7/site-packages/dask/base.py", line 167, in compute
    (result,) = compute(self, traverse=False, **kwargs)
  File "/usr/local/lib/python3.7/site-packages/dask/base.py", line 452, in compute
    results = schedule(dsk, keys, **kwargs)
  File "/usr/local/lib/python3.7/site-packages/dask/threaded.py", line 84, in get
    **kwargs
  File "/usr/local/lib/python3.7/site-packages/dask/local.py", line 486, in get_async
    raise_exception(exc, tb)
  File "/usr/local/lib/python3.7/site-packages/dask/local.py", line 316, in reraise
    raise exc
  File "/usr/local/lib/python3.7/site-packages/dask/local.py", line 222, in execute_task
    result = _execute_task(task, data)
  File "/usr/local/lib/python3.7/site-packages/dask/core.py", line 121, in _execute_task
    return func(*(_execute_task(a, cache) for a in args))
  File "/usr/local/lib/python3.7/site-packages/dask/array/core.py", line 3722, in store_chunk
    return load_store_chunk(x, out, index, lock, return_stored, False)
  File "/usr/local/lib/python3.7/site-packages/dask/array/core.py", line 3711, in load_store_chunk
    out[index] = np.asanyarray(x)
  File "/usr/local/lib/python3.7/site-packages/zarr/core.py", line 1115, in __setitem__
    self.set_basic_selection(selection, value, fields=fields)
  File "/usr/local/lib/python3.7/site-packages/zarr/core.py", line 1210, in set_basic_selection
    return self._set_basic_selection_nd(selection, value, fields=fields)
  File "/usr/local/lib/python3.7/site-packages/zarr/core.py", line 1501, in _set_basic_selection_nd
    self._set_selection(indexer, value, fields=fields)
  File "/usr/local/lib/python3.7/site-packages/zarr/core.py", line 1550, in _set_selection
    self._chunk_setitem(chunk_coords, chunk_selection, chunk_value, fields=fields)
  File "/usr/local/lib/python3.7/site-packages/zarr/core.py", line 1665, in _chunk_setitem
    fields=fields)
  File "/usr/local/lib/python3.7/site-packages/zarr/core.py", line 1729, in _chunk_setitem_nosync
    self.chunk_store[ckey] = cdata
  File "/usr/local/lib/python3.7/site-packages/fsspec/mapping.py", line 150, in __setitem__
    self.fs.mkdirs(self.fs._parent(key), exist_ok=True)
  File "/usr/local/lib/python3.7/site-packages/fsspec/spec.py", line 1066, in mkdirs
    return self.makedirs(path, exist_ok=exist_ok)
  File "/usr/local/lib/python3.7/site-packages/s3fs/core.py", line 488, in makedirs
    self.mkdir(path, create_parents=True)
  File "/usr/local/lib/python3.7/site-packages/fsspec/asyn.py", line 118, in wrapper
    return maybe_sync(func, self, *args, **kwargs)
  File "/usr/local/lib/python3.7/site-packages/fsspec/asyn.py", line 97, in maybe_sync
    return sync(loop, func, *args, **kwargs)
  File "/usr/local/lib/python3.7/site-packages/fsspec/asyn.py", line 68, in sync
    raise exc.with_traceback(tb)
  File "/usr/local/lib/python3.7/site-packages/fsspec/asyn.py", line 52, in f
    result[0] = await future
  File "/usr/local/lib/python3.7/site-packages/s3fs/core.py", line 462, in _mkdir
    if not key or (create_parents and not self.exists(bucket)):
  File "/usr/local/lib/python3.7/site-packages/fsspec/asyn.py", line 118, in wrapper
    return maybe_sync(func, self, *args, **kwargs)
  File "/usr/local/lib/python3.7/site-packages/fsspec/asyn.py", line 90, in maybe_sync
    return _run_until_done(func(*args, **kwargs))
  File "/usr/local/lib/python3.7/site-packages/fsspec/asyn.py", line 28, in _run_until_done
    loop._run_once()
  File "/usr/local/lib/python3.7/asyncio/base_events.py", line 1771, in _run_once
    handle = self._ready.popleft()
IndexError: pop from an empty deque

What you expected to happen:
Storage succeeding. No Exception.
Minimal Complete Verifiable Example:
# Put your MCVE code here
import dask.array as da
import xarray
import s3fs
import xarray as xr

bucket = "zarr"
name = "sample"

nana = xarray.DataArray(da.zeros((1023,1023,3)))

s3_path = f"{bucket}/{name}"
s3 = s3fs.S3FileSystem(client_kwargs={"endpoint_url": "s3://minio:9000"}, username="weak_access_key", password="weak_secret_key")
s3store = s3.get_mapper(s3_path)

print("Storing")
nana.to_dataset().to_zarr(store=s3store, mode="w", consolidated=True, compute=True)
print("Getting")

Anything else we need to know?:
Thanks and keep up the great work!
 There were recently some big changes to s3fs. We will look into it.
cc @martindurant

The following code, modified to the style of the s3fs test suite, works OK:
def test_with_xzarr(s3):
    da = pytest.importorskip("dask.array")
    xr = pytest.importorskip("xarray")
    name = "sample"

    nana = xr.DataArray(da.zeros((1023, 1023, 3)))

    s3_path = f"{test_bucket_name}/{name}"
    s3store = s3.get_mapper(s3_path)

    print("Storing")
    nana.to_dataset().to_zarr(store=s3store, mode="w", consolidated=True, compute=True)

  File "/usr/local/lib/python3.7/asyncio/base_events.py", line 1771, in _run_once
    handle = self._ready.popleft()

This looks like it may be a race conditions where multiple threads are calling the event loop at once. I wonder if you could list the event loops in use and the threads (perhaps best run with base python than ipython/jupyter).

Martin, thanks for your comments. I have read them several times but am left scratching my head as to their meaning. It would be useful if you could help identify a specific development direction to address @jhnnsrs's bug. In your best judgement, is this

a bug in xarray
a bug in dask
a bug in zarr
a bug in s3fs
some problem relating to @jhnnsrs's environment / dependencies
something else?

Thanks for the troubleshooting.  I encountered the problem within an sync worker in django channels (has been and is still working with s3fs=0.4.1 ) (same error).  So I tried running the refactored relevant code in a vanilla python script on a linux docker container with WSL2 backend, no event loops and no threads running. Same results and the reason I posted in in xarray issues.
No coming back to this problem a day the vanilla script works perfectly sound and gets the job down! The Django sync worker example still runs into problems:
[ERROR]  asyncio 2020-10-02 09:40:10,950 :: Exception in callback BaseSelectorEventLoop._sock_connect_cb(<Future finished result=None>, <socket.socke...8.0.4', 9000)>, ('<IP_ADDRESS>', 9000))
handle: <Handle BaseSelectorEventLoop._sock_connect_cb(<Future finished result=None>, <socket.socke...8.0.4', 9000)>, ('<IP_ADDRESS>', 9000))>
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/asyncio/events.py", line 88, in _run
    self._context.run(self._callback, *self._args)
  File "/usr/local/lib/python3.7/asyncio/selector_events.py", line 510, in _sock_connect_cb
    fut.set_result(None)
asyncio.base_futures.InvalidStateError: invalid state
[ERROR]  asyncio 2020-10-02 09:40:11,609 :: Exception in callback BaseSelectorEventLoop._sock_connect_cb(<Future finished result=None>, <socket.socke...8.0.4', 9000)>, ('<IP_ADDRESS>', 9000))
handle: <Handle BaseSelectorEventLoop._sock_connect_cb(<Future finished result=None>, <socket.socke...8.0.4', 9000)>, ('<IP_ADDRESS>', 9000))>
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/asyncio/events.py", line 88, in _run
    self._context.run(self._callback, *self._args)
  File "/usr/local/lib/python3.7/asyncio/selector_events.py", line 510, in _sock_connect_cb
    fut.set_result(None)
asyncio.base_futures.InvalidStateError: invalid state
[ERROR]  asyncio 2020-10-02 09:40:12,478 :: Exception in callback BaseSelectorEventLoop._sock_connect_cb(<Future finished result=None>, <socket.socke...8.0.4', 9000)>, ('<IP_ADDRESS>', 9000))
handle: <Handle BaseSelectorEventLoop._sock_connect_cb(<Future finished result=None>, <socket.socke...8.0.4', 9000)>, ('<IP_ADDRESS>', 9000))>
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/asyncio/events.py", line 88, in _run
    self._context.run(self._callback, *self._args)
  File "/usr/local/lib/python3.7/asyncio/selector_events.py", line 510, in _sock_connect_cb
    fut.set_result(None)
asyncio.base_futures.InvalidStateError: invalid state
[ERROR]  asyncio 2020-10-02 09:40:12,743 :: Exception in callback BaseSelectorEventLoop._sock_connect_cb(<Future finished result=None>, <socket.socke...8.0.4', 9000)>, ('<IP_ADDRESS>', 9000))
handle: <Handle BaseSelectorEventLoop._sock_connect_cb(<Future finished result=None>, <socket.socke...8.0.4', 9000)>, ('<IP_ADDRESS>', 9000))>
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/asyncio/events.py", line 88, in _run
    self._context.run(self._callback, *self._args)
  File "/usr/local/lib/python3.7/asyncio/selector_events.py", line 510, in _sock_connect_cb
    fut.set_result(None)
asyncio.base_futures.InvalidStateError: invalid state
[ERROR]  asyncio 2020-10-02 09:40:12,745 :: Exception in callback BaseSelectorEventLoop._sock_connect_cb(<Future finished result=None>, <socket.socke...8.0.4', 9000)>, ('<IP_ADDRESS>', 9000))
handle: <Handle BaseSelectorEventLoop._sock_connect_cb(<Future finished result=None>, <socket.socke...8.0.4', 9000)>, ('<IP_ADDRESS>', 9000))>
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/asyncio/events.py", line 88, in _run
    self._context.run(self._callback, *self._args)
  File "/usr/local/lib/python3.7/asyncio/selector_events.py", line 510, in _sock_connect_cb
    fut.set_result(None)
asyncio.base_futures.InvalidStateError: invalid state
[ERROR]  asyncio 2020-10-02 09:40:12,757 :: Exception in callback BaseSelectorEventLoop._sock_connect_cb(<Future finished result=None>, <socket.socke...8.0.4', 9000)>, ('<IP_ADDRESS>', 9000))
handle: <Handle BaseSelectorEventLoop._sock_connect_cb(<Future finished result=None>, <socket.socke...8.0.4', 9000)>, ('<IP_ADDRESS>', 9000))>
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/asyncio/events.py", line 88, in _run
    self._context.run(self._callback, *self._args)
  File "/usr/local/lib/python3.7/asyncio/selector_events.py", line 510, in _sock_connect_cb
    fut.set_result(None)
asyncio.base_futures.InvalidStateError: invalid state
[ERROR]  asyncio 2020-10-02 09:40:13,631 :: Exception in callback BaseSelectorEventLoop._sock_connect_cb(<Future finished result=None>, <socket.socke...8.0.4', 9000)>, ('<IP_ADDRESS>', 9000))
handle: <Handle BaseSelectorEventLoop._sock_connect_cb(<Future finished result=None>, <socket.socke...8.0.4', 9000)>, ('<IP_ADDRESS>', 9000))>
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/asyncio/events.py", line 88, in _run
    self._context.run(self._callback, *self._args)
  File "/usr/local/lib/python3.7/asyncio/selector_events.py", line 510, in _sock_connect_cb
    fut.set_result(None)
asyncio.base_futures.InvalidStateError: invalid state
[ERROR]  asyncio 2020-10-02 09:40:13,633 :: Exception in callback BaseSelectorEventLoop._sock_connect_cb(<Future finished result=None>, <socket.socke...8.0.4', 9000)>, ('<IP_ADDRESS>', 9000))
handle: <Handle BaseSelectorEventLoop._sock_connect_cb(<Future finished result=None>, <socket.socke...8.0.4', 9000)>, ('<IP_ADDRESS>', 9000))>
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/asyncio/events.py", line 88, in _run
    self._context.run(self._callback, *self._args)
  File "/usr/local/lib/python3.7/asyncio/selector_events.py", line 510, in _sock_connect_cb
    fut.set_result(None)
asyncio.base_futures.InvalidStateError: invalid state
[ERROR]  asyncio 2020-10-02 09:40:15,025 :: Exception in callback BaseSelectorEventLoop._sock_connect_cb(<Future finished result=None>, <socket.socke...8.0.4', 9000)>, ('<IP_ADDRESS>', 9000))
handle: <Handle BaseSelectorEventLoop._sock_connect_cb(<Future finished result=None>, <socket.socke...8.0.4', 9000)>, ('<IP_ADDRESS>', 9000))>
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/asyncio/events.py", line 88, in _run
    self._context.run(self._callback, *self._args)
  File "/usr/local/lib/python3.7/asyncio/selector_events.py", line 510, in _sock_connect_cb
    fut.set_result(None)
asyncio.base_futures.InvalidStateError: invalid state
[ERROR]  asyncio 2020-10-02 09:40:16,317 :: Exception in callback BaseSelectorEventLoop._sock_connect_cb(<Future finished result=None>, <socket.socke...8.0.4', 9000)>, ('<IP_ADDRESS>', 9000))
handle: <Handle BaseSelectorEventLoop._sock_connect_cb(<Future finished result=None>, <socket.socke...8.0.4', 9000)>, ('<IP_ADDRESS>', 9000))>
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/asyncio/events.py", line 88, in _run
    self._context.run(self._callback, *self._args)
  File "/usr/local/lib/python3.7/asyncio/selector_events.py", line 510, in _sock_connect_cb
    fut.set_result(None)
asyncio.base_futures.InvalidStateError: invalid state
Exception in thread Thread-1:
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/local/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "/usr/local/lib/python3.7/asyncio/base_events.py", line 541, in run_forever
    self._run_once()
  File "/usr/local/lib/python3.7/asyncio/base_events.py", line 1771, in _run_once
    handle = self._ready.popleft()
IndexError: pop from an empty deque

I guess this is now more of a problem with the way django >=3.1  and particularly django-channels is dealing with the event loop. Do you have by any chance quick thoughts on this? Is there a way to get the django "superpowered" event loop instead of the asyncio one?
Anyway will mark this bug report as resolved as it is cleary not xarrays issue.
Thanks a lot !

Okay. That was too fast. Wasn't able to get the django implementation running, so I setup a testing environment with a docker composition running minio and a python3.8 based container with the libraries (repo attached). The setup runs fine for dask arrays of size (1024,1024,8,2,1) but causes the same asyncio problematic at (1024,1024,10,2,1) (tested with random arrays)
https://github.com/jhnnsrs/s3fs_bugreport

Thanks for the digging, I'll look into it

I have reproduced it locally (also with moto). Indeed, many threads are trying to stall the event loop at once. This will take a little finesse.

Can you confirm that this works ok with fsspec and s3fs master?

Confirmed! Works like a charm. Went up all the way to (1024,1024,100,3,1) without any issues. Thanks for the fast fix! 👍

That's a lot of data!

@jhnnsrs: just a tip based on my own experience. In the code above, you are not specifying any chunks explicitly. The default is then to let zarr choose the chunk sizes. Zarr's default chunks are usually much smaller than what is optimal with cloud storage. I would recommend you explicitly chunk you array and aim for chunks around 100 MB.
Closing this as it appears to be fixed by @martindurant's quick response in fsspec / s3fs.

I'm still suffering from IndexError: pop from an empty deque. Can somebody tell me which s3fs version to use after fix by @martindurant?
Here are my relevant packages:
# Name                    Version                   Build  Channel
aiobotocore               0.10.3                     py_0    conda-forge
aiohttp                   3.7.3            py39hb82d6ee_0    conda-forge
botocore                  1.12.91                    py_0    conda-forge
dask                      2.30.0                     py_0    conda-forge
dask-core                 2.30.0                     py_0    conda-forge
distributed               2.30.1           py39hcbf5309_0    conda-forge
fsspec                    0.8.4                      py_0    conda-forge
python                    3.9.0           h7840368_5_cpython    conda-forge
s3fs                      0.5.1                      py_0    conda-forge
xarray                    0.16.2             pyhd8ed1ab_0    conda-forge
zarr                      2.5.0                      py_0    conda-forge

Thanks in advance!

Please try with fsspec master.


Veldrid.ImGui nuget out of date

The nugget package for Veldrid.ImGui is out of date compared to the source here. It also seems the src uses ImGui.net 1.72 where the ImGui.net nugget is at 1.78.
I also noticed while looking at Veldrid.ImGui .Csproj that their is a shader for each backend. Is there any reason why it doesn't just use a portable shader?
Thanks for the awesome projects. Veldrid, ImGui.net and the helper projects are great really been enjoying working with them.

Up-to-date as of now


set db_max_conn_size to 1 when deployed in AWS Lambda

lambda doesn't need to open a pool of connection because we have a 1:1 request/lambda behaviour
stac-fastapi: db_min_conn_size / db_max_conn_size
timvt: db_min_conn_size / db_max_conn_size
tifeatures: db_min_conn_size / db_max_conn_size
titiler-pgstac: db_min_conn_size / db_max_conn_size

closed by https://github.com/developmentseed/eoAPI/commit/96938753cbe16869d5f59424c712f21b8731c5a2


🐛 Media Manager - Fix Cloudinary not accepting video uploads

Fixes #4657.
Cloudinary was only accepting image uploads and the error message given to the user was very bad.

Figure: MKV video uploaded to Cloudinary using the Media Manager

Figure: Fixed error message

Changes are in main, waiting on next Tina patch release


Merging modified lora_key lead to shape error

According to tutorial https://lightning.ai/pages/community/lora-insights/#toc9 I tryed to modify the params:
lora_r = 16
lora_alpha = 32
lora_dropout = 0.05
lora_query = True
lora_key = True
lora_value = True
lora_projection = True
lora_mlp = True
lora_head = True
When I try to merge model with lora I get shape error:
size mismatch for transformer.h.30.attn.attn.lora_B: copying a param with shape torch.Size([6144, 16]) from checkpoint, the shape in current model is torch.Size([5120, 8]).
size mismatch for transformer.h.31.attn.attn.lora_A: copying a param with shape torch.Size([48, 4096]) from checkpoint, the shape in current model is torch.Size([16, 4096]).
size mismatch for transformer.h.31.attn.attn.lora_B: copying a param with shape torch.Size([6144, 16]) from checkpoint, the shape in current model is torch.Size([5120, 8]).

Any option for merging properly modified Lora params ?
Ps: I used /mistralai/Mistral-7B-v0.1 model.

Ok my bad, just found the answer here: https://github.com/Lightning-AI/lit-gpt/issues/629


AMD Butler commands not accessible in Windows version of Sublime 3

No matter what version/build of Sublime Text 3 for Windows I try to install (x86/x64, portable/full, dev/stable/old, etc.), I can't seem to get AMD Butler to work with it (I've tried older versions of AMD Butler as well). After installing Sublime, I install Package Control, and then from Package Control I install AMD Butler and it says it installs successfully, but no AMD Butler commands ever show up in the command palette. I've tried this on multiple Windows 7 machines with the same result.
There are no errors in the console - it just shows these lines on loading:
reloading plugin AMD Butler.init
reloading plugin AMD Butler.amdbutler
reloading plugin AMD Butler.buffer_parser
reloading plugin AMD Butler.crawler
reloading plugin AMD Butler.zipper

Do I need to modify anything in Package Settings->AmdButler? Whenever I try to open either the Default or User settings it gives me the following error:
Unable to open //Packages/AmdButler/AmdButler.sublime-settings
Unable to open //Packages/User/AmdButler.sublime-settings

I think you will only see the commands if you have a javascript syntax file open.

Aha, that was it. The commands aren't accessible on javascript inside HTML files. I guess I should make that as a feature request then.
Thanks!


Can't filter on multi-select field

What happened?
If a project has a column with a multi-select value, the only available filter criteria are Blank/Not Blank
What did you expect to happen?
I would expect to be able to filter by "Contains/Does Not Contain" a specific value
How can we reproduce it (as minimally and precisely as possible)?
Create a note with the following frontmatter:
---
MyField: [foo, bar]
---

In the table view, click filter and select the MyField column. Only the Blank/Not criteria will be shown
Anything else we need to know?
No response
Plugin version
1.11.5
Obsidian version
1.1.14
OS
macOS

That would be perfect, thanks!!On Mar 15, 2023, at 7:18 AM, Marcus Olsson @.***> wrote:
Should definitely be added, though I think "Contains" it might be confusing since there's already "Contains" for text fields, which does a substring match.
Would "has any of", "has all of", or "has none of" work for you?
—Reply to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you authored the thread.Message ID: @.***>


Fix RangeError

The reason this is happening has something to do with the _compile_array internals and the problem is solved using emscripten 1.38.32+ and adding the flag -Os or -Oz (https://emscripten.org/docs/optimizing/Optimizing-Code.html#optimizing-code-size) to the emcc call when building the WASM.
We also adjusted the memory in this to allow for growth.
cc @damaneice 🍐

Hi @jeffrafter and thank you for the PR! I'm sorry for the delay.
@willglynn this seems better suited for your review when you have time.


frontend: Extract the verifyAuthentication method

This allows other code path to re-use the app loading code to verify authentication. One example is when the user is logged out, the requests will typically return a 401 response to the application. The code handling this response code can request the server to verifyAuthentication and thus differentiate between a logged out user and one trying to access a forbidden resource.

This will allow to fix evolution's issue https://github.com/chairemobilite/evolution/issues/53


chore(FDS-250,FDS-251) Table DX and Cosmos Testing

TableDX
There is a related task with the first items for this work. A test has been created to capture these items. Not all work is completed, so they are currently TODOs in the test.
Cosmos For Tests
This PR also explores importing Cosmos fixtures which we can use to generate our tests. This pattern could save us a significant amount of effort. We could essentially put together our UI for a test case, then import each fixture into a test. We would have a visual rendering of the actual content for the test to look at while writing tests. This might also be the way we can validate if Cosmos fixtures are still working. If we used a fixture for a test and it gets changed in a way that breaks a test case, we would know the fixture got broken (or potentially the component itself).

Fails

:no_entry_sign:
Please add a '### Snapshots' section to explain the reason we are changing snapshots.

Messages

:book:

packages/cascara/src/ui/Table/fixtures/ActionStack.Table.fixture.js: This fixture has been changed.

:book:

packages/cascara/src/ui/Table/fixtures/Conditional.Actions.fixture.js: This fixture has been changed.

:book:

packages/cascara/src/ui/Table/fixtures/EditingTable.fixture.js: This fixture has been changed.

  Generated by :no_entry_sign: dangerJS against df65a404a1acfe70484eed312793fa11fad3831f


Creating a primary key for a table that had none before

This is probably more of a documentation issue: I could not figure out how to create a primary key for a table that (by accident) was missing the PK. I've tried all options I could find that are related to it. But when running this migration
		$this->table('wa_project_partner_companies_translations', [
				'id' => 'id',
				'primary_key' => 'id',
				'identity' => 'id'
			])
			->addColumn('project_partner_company_id', 'integer',  ['null' => false])
			->addIndex(['locale', 'project_partner_company_id'], ['unique' => 'true', 'name' => 'UNIQUE_TRANSLATION'])
			->addIndex(['locale'])
			->addIndex(['project_partner_company_id'])
			->update();

my table is still missing the PK.
It would be nice if there would be a method lie addPrimaryKey and removePrimaryKey.

I think this is duplicity of #335

Yes it is. What do you think about adding these two methods?

I vote for it, so now we have to wait :)


rTorrent: Add stability patches

This commit adds multiple stability patches to rtorrent. I have tested these for multiple months. The reason for modifying the software is to resolve stability issues. The software owner is no longer releasing new versions.
libtorrent

Fixes an issue where the throttle plugin on ruTorrent is required to limit upload/download speed to 1gbps.

rTorrent

Fixes a crash caused by some hardening flags during the build process.
Fixes a crash caused by ruTorrent sending invalid xmlrpc data to rTorrent.
Fixes a crash caused by external configurations sending invalid xmlrpc data to rTorrent.
Fixes an issue where torrent information will not update if too many torrents are running.
Fixes an issue where a power loss during torrent session saving will corrupt torrents.

@crazy-max I can see from the build log these patches installed successfully and the build passed. I do not have a configuration to build this docker image. The only step required to build the docker image and ensure rTorrent runs properly before pushing changes. I have tested these changes for months. There should be zero issues and significantly improved rTorrent stability.

Overall LGTM thanks

All fixed up. Suggestions implemented.

Small nit as follow-up would be to update this section in the README: https://github.com/crazy-max/docker-rtorrent-rutorrent#features about Latest rTorrent / libTorrent release compiled from source to say some patches are also applied to enhance rTorrent stability or smth like that.

Small nit as follow-up would be to update this section in the README: https://github.com/crazy-max/docker-rtorrent-rutorrent#features about Latest rTorrent / libTorrent release compiled from source to say some patches are also applied to enhance rTorrent stability or smth like that.

I will update that next pull request when 10gbps throttle support is added. This container will be the first to support 10gbps by default on ruTorrent with throttling capabilities. This will bring the configuration into the next decade!


When starting minecraft, Dynamic trees fails to load

Describe the bug
org.spongepowered.asm.mixin.injection.struct.InjectionInfo.postInject(InjectionInfo.java:468) ~[mixin-0.8.4.jar:0.8.4+Jenkins-b308.git-2accda5000f7602229606b39437565542cc6fba4] {re:classloading}
To Reproduce
Unknown, it just started happening
Additional context
Add any other context about the problem here.
Crashes
Crash Report
What version of Forge are you running? (e.g. 1.12.2-<IP_ADDRESS>68)
forge-1.16.5-36.2.35

Not caused by DT - see #743.


Issue 138

#138 Correctly handling model containing Dictionary<int, _>

Changes included in the 1.8.0 release now live on NuGet


Merge latest Bloom Upstream

Issue

Closes #issue
Addresses #issue
[ ] This change is a dependency for another issue
[ ] This change has a dependency from another issue

Description
Please include a summary of the change and which issue(s) is addressed. Please also include relevant motivation and context. List any dependencies that are required for this change.
Type of change

[ ] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] Prototype/POC (not to merge)
[ ] This change is a refactor/addresses technical debt
[ ] This change requires a documentation update
[ ] This change requires a SQL Script

How Can This Be Tested/Reviewed?
Provide instructions so we can review.
Describe the tests that you ran to verify your changes. Please also list any relevant details for your test configuration.
Checklist:

[ ] My code follows the style guidelines of this project
[ ] I have performed a self-review of my own code
[ ] I have reviewed the changes in a desktop view
[ ] I have reviewed the changes in a mobile view
[ ] I have commented my code, particularly in hard-to-understand areas
[ ] I have made corresponding changes to the documentation
[ ] My changes generate no new warnings
[ ] I have added tests that prove my fix is effective or that my feature works
[ ] New and existing unit tests pass locally with my changes
[ ] Any dependent changes have been merged and published in downstream modules
[ ] I have assigned reviewers
[ ] I have updated the changelog to include a description of my changes
[ ] I have run yarn generate:client if I made backend changes
[ ] I have exported any new pieces in ui-components

created a new branch to merge latest and merged


Fix the useMap and isMap properties

Also clarify the documentation around usemap to correctly state "hash name reference" instead of "id".

Thank you!


NavigateAsync to pages

How I can call NavigateAsync with multi pages like PRISM?
like this: NavigateAsync("NavigationPage/Page1/Page2")
Thanks.

As of now we don't have support to multipage navigation in a single call.
But I think you can archive the simililar behavior by doing it in 2 steps:
Step 1
var parameters = new Page2Args
{
    AutoNavigateToPage2 = true
};

NavigateAsync<INavigationPage<Page1ViewModel>>( parameters.ToNavigationParameters());

Step 2
public class Page1ViewModel
{
     public override void OnInitialized(INavigationParameters parameters)
     {
          var args = parameters.GetValue<Page2Args>();

          if (args.AutoNavigateToPage2 == true)
          {
               _navigationService.NavigateAsync<Page2ViewModel>();
          }
     }
}

We will try to add support to multi level page navigation in future versions.
If you would like to contribute to speed-up adding this feature, please fell free to submit a PR.


Added docker-py to Debian.yml

I've added docker-py install from pip

Well seems that in debian this pip package can't be installed...


No pagination buttons are shown.

I installed django-admin-inline-paginator 0.4.0 and I use python 3.10.11,
class ModelWithFKAdminInline(ReadOnlyAdminMixin, NestedTabularInline, TabularInlinePaginated):
    fields = (...)
    per_page = 5
    model = ModelWithFK

It shows 5 items, but no pagination buttons are shown that only first 5 items are shown.

I think you need to customize template file to have pagination.
Or you can have only TabularInlinePaginated.

Thanks @diamonddev107 for your reply. I will check that.


removed cookieSyncDelay from config

Removed cookieSyncDelay from config since we have more configuration options now with the userSync object.
Documents https://github.com/prebid/Prebid.js/issues/3061.

thanks for this @thewizarodofoz -- but since we can't merge it until 2.0 -- API change, I think we want to add the deprecation now and remove it later.

Yes I thought a deprecation notice is more suitable, but then I saw that cookieSyncDelay is actually not being used anywhere in the master branch (except for in the config object itself).
The user sync module is using the new syncDelay param. So unless I am missing something, I think leaving cookieSyncDelay is actually misleading.

@bretg FYI: https://github.com/prebid/Prebid.js/pull/3142#issuecomment-427854451

Ok.


Support for JakartaEE JAXB/XJC 4.0 + major dependency upgrades

Drop support for Gradle versions before 6.8
Added support for Gradle 8.0
Kotlin upgrade to 1.8.10
Upgrade to Asciidoc Plugin JVM plugin
More dependency/plugin upgrades
Added support for JAXB/XJC v4.0

Is there a possibility that this can be released?


Combine chatbot container and vector ingestor into one image to reduce number of images

Dealt with in https://github.com/aishwaryaprabhat/BigBertha/issues/3


Can anyone ncurses expertise explain why this happens with CursesDriver?

This is caused by the use of this line reset_shell_mode (); in the binding.cs file. This avoid writing reset every time when quitting the UICatalog. Running the Editor scenario the first time and open the Find/Replace dialog corrupts the output. Pressing Ctrl+Q to quit and running again the Editor, this corruption doesn't happens anymore. I want some help to try fix this issue, please.

Not sure I can help but it looks related that when using the Down cursor to move focus around in the Find/Replace dialog then the cursor jumps to the left of the screen.  Again it is only with the Curses driver (running with -usc makes problem go away).  Also when CtrlQ out and going back into editor it doesn't show.

Not sure I can help but it looks related that when using the Down cursor to move focus around in the Find/Replace dialog then the cursor jumps to the left of the screen.

Due the output corruption all works badly, including cursor position.

Again it is only with the Curses driver (running with -usc makes problem go away).

Of course because it is using NetDriver and is a CursesDriver related issue.

Also when CtrlQ out and going back into editor it doesn't show.

Because the driver is restarted in the UICatalog, using the Application.Shutdown and running the Application.Init again. My curiosity is why it stop giving the corruption behavior, if it is executed the same code as the first time.

Any idea what commit this first started happening on?

This is caused by the use of this line reset_shell_mode (); in the binding.cs file.
https://github.com/migueldeicaza/gui.cs/blob/8bfa2f042509138dbcd5c904fe94912f1e344949/Terminal.Gui/ConsoleDrivers/CursesDriver/binding.cs#L107

If comment out this, the issue would stop, but if you start the application through the terminal, you have no cursor and you have to typing reset, with no output, to restore it.

@tznind can you confirm if it works for you too, please? The test errors maybe are caused by the clipboard tests, but since I only tested on Windows I received no errors. I have to test it on Linux.

@tznind can you confirm if it works for you too, please? The test errors maybe are caused by the clipboard tests, but since I only tested on Windows I received no errors. I have to test it on Linux.

Can confirm that the rendering/cursor corruption does not seem to be present on the above branch of your fork.  Good stuff!

Well, the problem is the fix I made causes error on FakeDriver, as obvious because it uses Curses.Raw. The main problem, is that I can't debug unit tests on VS Code to try a workaround. Gives the "Cannot destructure property 'debugEventListener' of '(intermediate value)' as it is undefined." error.

For the first time I used the .devcontainer\devcontainer.json in the VS Code and was very useful.


Kafka support

Find here the spec of this:
https://download.eclipse.org/microprofile/microprofile-reactive-messaging-1.0/microprofile-reactive-messaging-spec.pdf
It was mostly done by @danielkec months ago. I only took his changes and I did some small fixes and some tests.

/oca-checked

I added tck tests, but as KafkaSubscriber and KafkaPublisher are package private, I had to create the tck under the same package. Normally in tck we name the packages ending with .tck.
This pull request is ready for review.

I added tck tests, but as KafkaSubscriber and KafkaPublisher are package private, I had to create the tck under the same package. Normally in tck we name the packages ending with .tck.
This pull request is ready for review.

@jbescos Cool!
That is reactive streams for jvm TCK, that one have nothing to do with MicroProfile or Arquillian, we should keep it in the Kafka module, because we are actually unit testing, right @tomas-langer ?

Dependency for the tck should be just, then there would be no Arquillian and no MP:
        <dependency>
            <groupId>org.reactivestreams</groupId>
            <artifactId>reactive-streams-tck</artifactId>
        </dependency>

I added tck tests, but as KafkaSubscriber and KafkaPublisher are package private, I had to create the tck under the same package. Normally in tck we name the packages ending with .tck.
This pull request is ready for review.

@jbescos Cool!
That is reactive streams for jvm TCK, that one have nothing to do with MicroProfile or Arquillian, we should keep it in the Kafka module, because we are actually unit testing, right @tomas-langer ?

In case we move it to Kafka, I would create a new module for it just because in current Kafka we use junit, and that TCK uses testng. We cannot move all the kafka tests to testng because of the dependency kafka-junit5.
So I will create a new module helidon/microprofile/connectors/kafka-tck for this, ok?.


DNM: configure dns via sudo

Signed-off-by: Miguel Duarte Barroso<EMAIL_ADDRESS>
What this PR does / why we need it:
DNS is broken on ipv6 lane. This might fix - not sure there's more to it ...
Special notes for your reviewer:
NOT IN A REVIEWING STATE
DO NOT MERGE: not sure this will fix the overall issue or there's more to fix
Release note:

NONE

Not really needed.


Update to Ghidra 10.3.3

Seems like the API for Loaders changed slightly.
This also updates the gradle files and gradlew to the latest versions, respective

Thank you!


RAVEN Interface: Input Modification

Pull Request Description
What issue does this change request address? (Use "#" before the issue to link it, i.e., #42.)
Closes #831.
What are the significant changes in functionality due to this change request?
Adds a "input" node to the "conversion" node in the RAVEN code interface for arbitrarily modifying the perturbed input file.

For Change Control Board: Change Request Review
The following review must be completed by an authorized member of the Change Control Board.

[ ] 1. Review all computer code.
[ ] 2. If any changes occur to the input syntax, there must be an accompanying change to the user manual and xsd schema. If the input syntax change deprecates existing input files, a conversion script needs to be added (see Conversion Scripts).
[ ] 3. Make sure the Python code and commenting standards are respected (camelBack, etc.) - See on the wiki for details.
[ ] 4. Automated Tests should pass, including run_tests, pylint, manual building and xsd tests. If there are changes to Simulation.py or JobHandler.py the qsub tests must pass.
[ ] 5. If significant functionality is added, there must  be tests added to check this. Tests should cover all possible options.  Multiple short tests are preferred over one large test. If new development on the internal JobHandler parallel system is performed, a cluster test must be added setting, in  XML block, the node <internalParallel> to True.
[ ] 6. If the change modifies or adds a requirement or a requirement based test case, the Change Control Board's Chair or designee also needs to approve the change.  The requirements and the requirements test shall be in sync.
[ ] 7. The merge request must reference an issue.  If the issue is closed, the issue close checklist shall be done.
[ ] 8. If an analytic test is changed/added is the the analytic documentation updated/added?

Job Test qsubs on 103475d : invalidated by @milljm
killed zombied processes that were causing filesystem locks

Comments addressed...
PR can be accepted...


Warning 'undefined has no sReplFunctionNames'

We have disable almost every console output by setting wdio and wdi5 loglevel to 'error' and starting chrome with parameter '--log-level=3'.
After this we see for every browser.asControl call the warning undefined has no sReplFunctionNames or sap.m.CheckBox{"editable":true} has no sReplFunctionNames. But the tests are working fine.
Is there a way to avoid this warning (besides setting loglevel to silent)?
WDI5 version 0.9.0-rc4.2
SAPUI5 1.101.0
WDIO version 7.19.6
Node version v16.12.0
OS: Windows 10 Enterprise
Chrome 100.0.4896.127 (Official Build) (64-bit)

on it. Will be fixed soon.


Dynamic predicate clobbering?

I ran into an issue where clause/2 failed instead of returning results with a module qualifier when the predicate is dynamic and multifile and clobbered by something else (weird case I imagine), bisected it to: https://github.com/trealla-prolog/trealla/commit/e63ca12c4d99d340f16c77e7563e14993ea890b0#diff-17781a95c59b149a546046ab0ca7a972784e56c5c737a42961131727e368feebR91 but it's difficult to isolate.
However I think the root cause may lie elsewhere.
Here is a minimal test case:
% main.pl
:- module(main, [test/2]).

:- dynamic(hello/2).

hello(b, c).

test(X, Y) :-
    clause(foo:hello(a, X), Y).

% foo.pl
:- module(foo, []).

:- dynamic(hello/2).

hello(a, world).
hello(a, bar).

Testing it:
% ../tpl -f foo.pl main.pl
?- test(X,Y).
   false. % unexpected

Scryer output for comparison:
% scryer-prolog -f foo.pl main.pl
?- test(X,Y).
   X = world, Y = true
;  X = bar, Y = true.

Thanks, the fix works for me!
I have something like this which is working good now
has_validator(field(Spec, Name)) :-
    spec_module(Spec, Module),
    Module:clause(valid(Name, _), _).

But changing the last goal to clause(Module:valid(Name, _), _) seems to still be acting funny. I can't reproduce it with a simple test case yet so I'll dig into it more and try to figure out what's going on.

Hmm, I think that's just something dumb I'm doing elsewhere so probably unrelated.
I'll make an issue if I find anything else.


How to create GIN private repo for crab data

A guide on how to set up a GIN private repo for the crab data.
To be shared with NIU team when we finalise it

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Comparison is base (224b2bd) 29.81% compared to head (81c6304) 29.81%.
 Consider uploading reports for the commit 75d1607 to get more accurate results

Additional details and impacted files
@@           Coverage Diff           @@
##             main      #81   +/-   ##
=======================================
  Coverage   29.81%   29.81%
=======================================
  Files           6        6
  Lines         332      332
=======================================
  Hits           99       99
  Misses        233      233

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


Add services section cherrypick

Closing this PR because it was getting messy to rebase. New PR here: https://github.com/alphagov/collections/pull/565

Closed this PR because it was getting messy to rebase. New PR here: https://github.com/alphagov/collections/pull/565


Clean up UI. Update modals. Fix timestamps. Verbiage updates.

Clean up UI. Update modals. Fix timestamps. Verbiage updates.

@jdm135  pending conflicts for this


@mmumshad Scheduling presentation PDF is missing labels & Selectors and Resource Limit section

@mmumshad Scheduling presentation PDF is missing labels & Selectors and Resource Limit section
https://kodekloud.slack.com/archives/CHMV3P9NV/p1572722266026200

I assigned it to the concerned team.


Template + Model to SQL translation

[x] Support for scalar operations
[ ] Support for vector operations
[ ] Recursion support

Example template:
template += R.h(V.X)[1,] <= (R.feature(V.Y)[1,], R.edge(V.X, V.Y)[1,])
template += R.h(V.X)[1,] <= (R.feature(V.X)[1,])
template += R.q[1,] <= R.h(V.X)[1,]

Example SQL output:
CREATE OR REPLACE FUNCTION __h_1_0()
RETURNS Table(value NUMERIC, t0 TEXT)
AS $$
    SELECT AVG(pynelo_mul(0.46193557475331404, out.value)) as value, out.t0 as t0
    FROM (SELECT s1.t0 AS t0, pynelo_sigmoid(pynelo_sum(pynelo_mul(-0.5189271686570283, s0.value), pynelo_mul(0.2748348507002165, s1.value))) as value FROM feature AS s0 INNER JOIN edge AS s1 ON s1.t1 = s0.t0) AS out GROUP BY out.t0
$$ LANGUAGE SQL STABLE;

CREATE OR REPLACE FUNCTION __h_1_1()
RETURNS Table(value NUMERIC, t0 TEXT)
AS $$
    SELECT AVG(pynelo_mul(0.10087401023526787, out.value)) as value, out.t0 as t0
    FROM (SELECT s0.t0 AS t0, pynelo_sigmoid(pynelo_mul(0.19509055559440358, s0.value)) as value FROM feature AS s0) AS out GROUP BY out.t0
$$ LANGUAGE SQL STABLE;

CREATE OR REPLACE FUNCTION __h_1()
    RETURNS Table(value NUMERIC, t0 TEXT)
    AS $$
    SELECT AVG(out.value) as value, out.t0
    FROM (SELECT COALESCE(s0.t0,s1.t0) as t0, pynelo_sigmoid(pynelo_sum(COALESCE(s0.value, 0), COALESCE(s1.value, 0))) as value FROM __h_1_0() as s0 FULL OUTER JOIN __h_1_1() AS s1 ON s1.t0 = s0.t0) AS out GROUP BY out.t0
$$ LANGUAGE SQL STABLE;

CREATE OR REPLACE FUNCTION h(p0 TEXT) RETURNS Table(value NUMERIC) AS $$
    SELECT out.value FROM __h_1() as out WHERE out.t0 = p0
$$ LANGUAGE SQL STABLE;

CREATE OR REPLACE FUNCTION __q_0_0()
RETURNS Table(value NUMERIC)
AS $$
    SELECT AVG(pynelo_mul(-0.33356320104670045, out.value)) as value
    FROM (SELECT pynelo_sigmoid(pynelo_mul(-0.229621630518563, s0.value)) as value FROM __h_1() AS s0) AS out
$$ LANGUAGE SQL STABLE;

CREATE OR REPLACE FUNCTION __q_0()
    RETURNS Table(value NUMERIC)
    AS $$
    SELECT AVG(out.value) as value
    FROM (SELECT pynelo_sigmoid(COALESCE(s0.value, 0)) as value FROM __q_0_0() as s0) AS out
$$ LANGUAGE SQL STABLE;

CREATE OR REPLACE FUNCTION q() RETURNS Table(value NUMERIC) AS $$
    SELECT out.value FROM __q_0() as out
$$ LANGUAGE SQL STABLE;

Usage:
SELECT * FROM h('2');
SELECT * FROM h('1');
SELECT * FROM h('3');

SELECT * FROM q();

Codecov Report

Merging #29 (79a4107) into master (e2de251) will decrease coverage by 3.75%.
The diff coverage is 5.62%.

@@            Coverage Diff             @@
##           master      #29      +/-   ##
==========================================
- Coverage   74.65%   70.90%   -3.76%
==========================================
  Files          55       58       +3
  Lines        2801     2952     +151
==========================================
+ Hits         2091     2093       +2
- Misses        710      859     +149

Impacted Files
Coverage Δ

neuralogic/db/__init__.py
0.00% <0.00%> (ø)

neuralogic/db/sql_convertors.py
0.00% <0.00%> (ø)

neuralogic/db/sql_helpers.py
0.00% <0.00%> (ø)

neuralogic/nn/dynet.py
0.00% <0.00%> (ø)

neuralogic/core/template.py
77.50% <100.00%> (ø)

neuralogic/nn/base.py
76.71% <100.00%> (+0.32%)
:arrow_up:

neuralogic/nn/java.py
81.39% <100.00%> (+0.21%)
:arrow_up:

neuralogic/nn/torch.py
77.31% <100.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update e2de251...79a4107. Read the comment docs.


can you share the training code?

Your papper has been accepted, can you share the training code? please.

@MarcoForte Love to repeat your result by your training code.


Add initialization logging

The java jaeger client logs nothing during setup and startup/shutdown, making debugging difficult. Adding logs would ease this.

Released with 0.15.0


Doesnt change the model :(

The mod doesnt change the texture into the model :(

You might be using a texture pack that overrides the totem model, try making sure the "Fabric Mods" resource pack is at the top of your active packs list.

You might be using a texture pack that overrides the totem model, try making sure the "Fabric Mods" resource pack is at the top of your active packs list.

works now, ty :D


feat: MouseDuck, MyTextures, WindowPositioner, DesktopMe

Changes
Settings

Make window borderless
Add WindowPositioner autoload scene
Change run scene to main.tscn

DesktopMe

Adjusts the existing me scene to be under a main scene with a sister Camera2D. This was to allow the MouseDuck to work as the camera won't follow the DesktopMe so the change is visible.
Adds script

To apply MyTextures to a DesktopMe
To add exports to easily adjust part positioning

Features
MouseDuck
A script to duck the DesktopMe as the mouse approaches
MyTextures
Combines textures for a DesktopMe into a resource for easy swapping. Useful for expressions.
WindowPositioner
Autoload scene/script to move window to a corner of the screen

Looks good to me!


fix(list): make horizontal scroll bar visible

@vikram-raj fabric8/fabric8-ui:SNAPSHOT-PR-2433-1 is deployed and available for testing at https://fabric8-ui-fabric8-ui-pr-2433-fabric8-planner.badger.fabric8.io

scroll doesn't show up until and unless i start scrolling

@SMahil That's MAC default behavior, we can not change that until. For that, we have to implement custom scrollbar.

@SMahil do you have a fix for Mac? If yes, add it to this PR.
It works on Fedora Firefox and Chrome.

@nimishamukherjee If we want to change the default behaviour it should be applicable for all instances

LGTM on Fedora at 1440x900 resolution.

@vikram-raj fabric8/fabric8-ui:SNAPSHOT-PR-2433-2 is deployed and available for testing at https://fabric8-ui-fabric8-ui-pr-2433-fabric8-planner.badger.fabric8.io

@nimishamukherjee Agree. If we are going to change the default behavior of scrollbar for MAC then we have to change it into the entire OSIO otherwise there is inconsistency.


[slo init] Better handle the way we ask users for a resource ID

Is your feature request related to a problem? Please describe.
When asking users for a resource ID, we offer two different experiences.

For AWS, they're asked to type/paste an ARN, which is efficient if you know the ARN, but isn't helpful if they're not sure.
For GCP, we asked them questions to help them identify the resource.

Describe the solution you'd like
We could try to make the experience more consistent, by providing the two ways of identifying a resource.
On AWS:
Type the ARN of an API Getaway or press ENTER to select from a list.

On GCP
Type the URI of a Load Balancer or press ENTER to select from a list.

If they just press ENTER, we use the AWS or GCP APIs (and the fact they're authenticated) to fetch available resources.
For example, for AWS it could be something like:
Select an AWS partition
> aws
> aws-cn
> aws-us-gov

Select a resource type
> API Getaway
> Something else

Select an AWS region
> US
> Asia
> Europe
...

Select an API
> simple-http-api (3ix4qm7v4d)
> another-api (theapiid345)

PR has been merged; https://github.com/reliablyhq/cli/pull/206
closing issue


bluetooth-samples/device-info-demo fails with error

The sample bluetooth-samples/device-info-demo fails with the error "Uncaught TypeError: Cannot read property 'getAdapterState' of undefined".

As noted in https://developer.chrome.com/apps/bluetooth, This API works only on OS X, Windows and Chrome OS. Which platform are you running on?

I've tried it on Windows and OS X, same problem.

It looks like the error says chrome.bluetooth is undefined.
It should not be the case when bluetooth is in your manifest.
Did you update manifest somehow?

No. I'm using a standard install of Chrome 43 and opening main.html from Github, I haven't changed anything.
Are you saying that this works for you?

As stated in https://github.com/GoogleChrome/chrome-app-samples/tree/master/samples/bluetooth-samples/device-info-demo, you might want to install the Chrome App from https://chrome.google.com/webstore/detail/device-information-servic/dblimghcclaakknbpajckcamddhjaaai  and try again. It should work better that way.

The sample bluetooth-samples/device-info-demo fails to discover the nearby devices. Can anyone help me with this issue..?


Cannot read property 'hasPivotFields' of undefined

Hello,
i'm trying to use One to One relationship in one of my models. Incoming request data has a following format:

And my models looks like that:
import { Model } from '@vuex-orm/core'

export default class Account extends Model {
  // This is the name used as module name of the Vuex Store.
  static entity = 'accounts'

  // List of all fields (schema) of the post model. `this.attr` is used
  // for the generic field type. The argument is the default value.
  static fields() {
    return {
      id: this.attr(null),
      is_admin: this.attr(false),
      username: this.attr(''),
      display_name: this.attr(''),
      bio: this.attr(''),
      avatar_urls: this.attr({}),
    }
  }
}

export default class Comment extends Model {
  static entity = 'comments'

  static fields() {
    return {
      id: this.attr(null),
      body: this.attr(''),
      body_html: this.attr(''),
      children_count: this.attr(0),
      created_at: this.attr(null),
      depth: this.attr(null),
      is_voted: this.attr(false),
      votes_count: this.attr(null),
      story_id: this.attr(null),
      parent_id: this.attr(null),
      account_id: this.attr(null),
      closed: this.attr(false),
      replyOpened: this.attr(false),
      account: this.belongsTo(Account, 'account_id'),
      story: this.attr({}),
    }
  }
}

And i'm triggering:
dispatch('entities/comments/create', { data: resp.data }, { root: true })

This all gives me

What does this error means? Can you please advise me on what have i done wrong? :)
Thanks

It was caused by the fact that vuex-orm is not auto-populating associations when using create - i need to fill the association store first.

Hi! Glad you found fix! Let me know if you have any other trouble : )

I don't get it, how would you fill the associations store? Do you mean that your "accounts" are preloaded in a different request? I'm running into this issue as well, but I'm not sure whether it's due to my relationships being polymorphic or something else yet.

 It populates the association stores automatically for me.

@tinco Glad you found a way! Let me know if you have anything else 👍

@tinco same here i wasted 3 hour to digg on vuex-orm source ... and after this read i know i forgot to register XD XD XD

Yeah, we should have more friendly errors for sure :/


Update dataTables to latest security release (1.13.1)

The current version of dataTables in use is 1.12.1, whereas the 1.13.1 release is now available. Update libraries to reflect latest patches.
jquery latest version is now 3.6.3 which will upgrade from the existing 3.6.0 version

Note https://github.com/WCRP-CMIP/CMIP6_CVs/issues/1114 and #1115 for update tips


container: update container iamge name to use another registry for PR…

Summary
For Context please read here

/update-branch

/update-branch

will close this for now


New plot type: hexplot

There are a couple of space-partitioning plot types in geoplot: quadtree and voronoi. These are both fine options, but there's also a simpler space partitioning plot type, familiar from seaborn, that's more common than these two: the hexplot.

This would be a great addition. +1
Thanks for the great GIS plotting package, it has been very useful.


Support async benchmarks

Closes #203

This was extremely straightforward!! Speaks to the excellent underlying design ;) Thanks for the incredibly fast turnaround 🤩

This was extremely straightforward!! Speaks to the excellent underlying design ;) Thanks for the incredibly fast turnaround

hehe thanks! Yeah it actually took me longer to add the Async Effect shootout lol. Speaking of which, this is how it went:

Surprising results!

Wow you are right, CE3 got smoked!! Lol. Which browser is this btw?
These are my results on Firefox.
Benchmark     Library                     Size     Cnt      ms/op ±  error       ops/s ±   error

FlatMap       Cats Effect v3.2.2           500      10     23.003 ± 10.352      47.427 ±  22.936
FlatMap       JS Promise                   500      10      4.123 ±  3.318     274.770 ± 106.401
FlatMap       ScalaJsReact v2.0.0-RC3      500      10      4.307 ±  0.419     232.980 ±  20.827
FlatMap       ZIO v1.0.10                  500      10      5.416 ±  0.505     185.248 ±  16.600

Woah, at first I was like "wow Firefox is FAST!" and then I realised the units are different (ms vs us) and then I was like "wow Firefox is SLOW!" :laughing:
My results were from Chrome. If you're running locally, use bin/serve-demo so that Chrome starts in a more time-precise mode

And I'm not happy seeing ZIO beat scalajs-react. That was surprising and sad for me :( Good on them though, they must be doing something really well


Possible to make this strong named?

Just wondering if possible, thanks

Sorry for the late reply!
I guess this is fine, but for the sake of ease I'd take the same approach as the "official" Serilog repos, and just keep the key publically accessible in this repo.
I haven't used .NET Framework for a few years now (only .NET Core), so I'm afraid it won't be high on my list - would happily take a PR if this is something you want sooner tho 😃


Add deploy:configure command for make configure files for stage from templates

Add deploy:configure command for make configure files for stage from templates like version 3.x
:smile:

Ping @elfet

@oanhnn please, fix what @mbrodala found.


Support untrusted workspace

We can support the new VS Code security feature - untrusted workspace directly,
since this extension do not depend on any part of the untrusted code base.
There since no document page about this. Currently it's only mentioned in VS Code release notes:
https://code.visualstudio.com/updates/v1_56

You can declare your extension to provide complete or partial or no support in untrusted workspaces using the untrustedWorkspaces capability in package.json.

"capabilities": {
  "untrustedWorkspaces": {
    "supported": true
  }
}

I will take a look at it tomorrow.


flynn cluster not reachable after apt-get dist-upgrade

Hi there,
I was running on all hosts (using cluster-ssh):
apt-get update && apt-get dist-upgrade && apt-get autoremove && apt-get autoclean && reboot

Now the dashboard is not reachable, and none of the apps.  The flynn client also does not reach the hosts:
$ flynn apps
Get https://controller.idonttell.flynnhub.com/apps: dial tcp this.is.my.ip:443: getsockopt: connection refused

But there is no problem to reach the digialocean droplets via ssh using their ip addresses.
It looks like there is no server started wich answers on port 443.
What can I do?
I tried to check the status:
root@flynn-1493633356-2:~# systemctl status flynn-host
● flynn-host.service - Flynn host daemon
   Loaded: loaded (/lib/systemd/system/flynn-host.service; enabled; vendor preset: enabled)
   Active: active (running) since Thu 2017-05-11 07:55:41 UTC; 4min 24s ago
     Docs: https://flynn.io/docs
 Main PID: 2746 (flynn-host)
    Tasks: 12
   Memory: 27.4M
      CPU: 1.719s
   CGroup: /system.slice/flynn-host.service
           └─2746 /usr/local/bin/flynn-host daemon

May 11 07:55:41 flynn-1493633356-2 systemd[1]: Started Flynn host daemon.
May 11 07:57:43 flynn-1493633356-2 flynn-host[2746]: 2017/05/11 07:57:43 resurrecting flynn14936333562-9699d9f1-1b78-4577-b3c1-6bbb9a35190b as flynn14May 11 07:57:43 flynn-1493633356-2 flynn-host[2746]: 2017/05/11 07:57:43 resurrecting flynn14936333562-ce2f2114-9ed6-44a6-b89e-75be844b5fee as flynn14

Thanks,
Martin

@grauschnabel did you upgrade the kernel? If so, you may need to re-install ZFS for the new kernel.

@lmars, yes there was a kernel upgrade I think.  i did now
 apt-get install --reinstall libzfs2linux zfs-zed zfsutils-linux && reboot

on the maschines, but it didn't help.  so anything else?  Any logs where I can find something?   I think I checked it all... :(

Please run sudo flynn-host collect-debug-info and post the resulting gist.

this seems to hang on:
EROR[05-11|18:23:13] error getting scheduler state            err="object_not_found: no leader found"

maybe I need to repair something there?

it seems to be something with the controller, from flynn-host fix -n 3:
INFO[05-11|19:00:58] no controller web process running, getting release details from hosts
INFO[05-11|19:00:59] provisioning volume for controller web job job.id=flynn14936333562-09570ba1-1439-4d14-81bb-ec159486a2ff release=c03dd500-f7fc-47ea-b31d-014e9c9d1dd2
INFO[05-11|19:00:59] starting controller web job              job.id=flynn14936333562-09570ba1-1439-4d14-81bb-ec159486a2ff release=c03dd500-f7fc-47ea-b31d-014e9c9d1dd2
INFO[05-11|19:00:59] waiting for job to start
19:01:59.210994 host.go:166: discoverd: timed out waiting for instances

but mabe this is a zfs issue?

EROR[05-11|19:16:09] error fixing controller                  err="error getting controller release: Get http://<IP_ADDRESS>:80/apps/controller/release: dial tcp <IP_ADDRESS>:80: i/o timeout"

it seems that /bin/start-flynn-controller and /bin/flynn-controller files are missing here.  how can I get them back?

I did the following:
copied the database files from the bigest zfs to my local machine and set up a local postgresql-9.5 server with this files.  then I could create a dump which worked with a new created flynn cluster.


Add new file as step 6

Updating description as per bot's request

Updating description as per bot's request


Avoid using intermediate vars instead object properties in Expressions ( for Where(), Get())

TableQuery.Where and Get methods takes Expression, analyze it and build SQL “where” sentence. Some kind of expressions works on Android but don’t work on iOS. Let’s use classical example with Employee and Department tables (http://www.oracle.com/ocom/groups/public/@otn/documents/digitalasset/513145.jpg). We have 2 corresponded classes with needed attributes. Code:
var dep = connection.Table<Department>().Where(d => d.Name == “blabla”).First();
int count = connection.Table<Employee>().Where(e => e.Department_ID == dep.Department_ID).Count();

This code will work on Android, but wil not on iOS due to problems with AOT compilation in CompileExpr method. To fix it on iOS you can:
var dep = connection.Table().Where(d => d.Name == “blabla”).First();
int depId = dep.Department_ID;
int count = connection.Table().Where(e => e.Department_ID == depId).Count();

It works! And there are question: can we avoid using intermediate var for compability with AOT compilation on iOS?
May be upgrade to latest SQLiteNet version would solve the problem?

Hi @cardinalby, I'm extending the SQLConnection class with some methods that avoid the use of Interfaces so it will be up to you to use whatever you want. Just a question about what you pose here. This solution works even with interface use? Or only without the interfaces?

I can't reproduce the error with my iPad following your first example. It works for me... I'll try to make it crash with a more complicated query. Do you get error with such a query?

I am waiting for IDisposable (commented in https://github.com/codecoding/SQLite4Unity3d/issues/5) fix, then will test on the latest version and prepare the reproducible example.

I can't reproduce it too on last version :). May be it was due to interface usage, which was fixed.

I'm glad but I have to say that I couldn't reproduce it even with the interfaces. In fact I tested it before removing the interfaces just to see if I could learn something. Anyway, I'll close this issue and if you somehow manage to reproduce the behaviour don't hesitate to tell me. I will reopen it again and see how we deal with it.


add redis plugin to rspamd plugin

requires the rspamd plugin from #371

@mimugmail I have added an error box if the config has this logical issue. It will be shown when the user opens the page.


Text is garbled in pdf.js (Cygwin / UB Mannheim binaries)

PDFs generated using either Cygwin (3.04.01) or one of the windows binaries (3.05.00dev) gives offset highlighted text and garbled text when copied, in pdf.js. Attached TIF is output from Scan Tailor. Related: #337 .
Copied from pdf.js:
An  exactmethodis  presentedfor  numericallycalculating,withinthe  frameworkof  thestochasticformulationof  chemicalkinetics,the   timeevolutionof  anyspatiallyhomog-

Attached txt output from tesseract:
An exact method is presented for numerically calculating, within the framework of the
stochastic formulation of chemical kinetics, the time evolution of any spatially homog-
Gillespie-000.txt
Gillespie-000.pdf
Gillespie-000.zip

IMO this is not tesseract problem but pdf rendered problem. I tried your files in acrobat reader and here is copied text from it:
An exact method is presented for numerically calculating, within the framework of the
stochastic formulation of chemical kinetics, the time evolution of any spatially homogeneous
mixture of molecular species which interreact through a specified set of coupled
Here is screenshot:

i think as @ebogaard pointed out this issue and sumatrapdf #544 are very closely related to tesseract #373, which is more than just a pdf renderer issue. a lot of the pdfs referenced in that issue open correctly in adobe but not in other pdf renderers.
would be great to have the pdfs generated by tesseract render correctly in pdf.js

The vertical problem in pdf.js was fixed by adjusting font metrics for Tesseract. The fix was handed off to Ray and is pending a code merge from Ray. I suspect the horizontal problem is due to a flaw pdf.js when interpretting the Tz directive, but am not sure. Can only make forward progress if a programmer on the pdf.js  side can work with me.

@jbreiden: Is this fixed or are you still waiting for Ray?

Should be in v4. Very easy to back port to v3 if desired.

Good. Can you create Pull request against 3.05 branch?

@jbreiden
Isn't a new pdf.ttf needed?

Yes there should be a new pdf.ttf in v4. Today is a major holiday in my country and I probably can't do anything (including take a careful look) until later, possibly Monday.

https://en.wikipedia.org/wiki/Thanksgiving
:-)

Github Tesseract is currently wrong; there is a mismatch between code and font.
Needs to have this. Checking with Ray to see what else might have been incorrectly
synchronized.
$ md5sum pdf.ttf
e436074b54ed9cc5bf4789f79059b01b pdf.ttf

Everything is now correct on 3.05 and 4.x branches. Should fix vertical highlight problems but not horizontal ones in pdf.js / Firefox

@jbreiden
https://wiki.mozilla.org/Mortar_Project

Project Mortar is aiming to explore the possibility to bring PDFium library and the Pepper API based Flash plugin into Firefox.


Change the way to get the last_quote

Using ticker it should resolve some issues (#92) :
ticker_info = ticker.info
history = ticker.history()
last_quote = (history.tail(1)['Close'].iloc[0])

Hi @vutsalsinghal,
Can you test with this fix ? You can use the docker-compose.dev.yaml file to build the image from this branch.

@pbrissaud  thanks for quick response. I tested it and it works but something else fails...
KeyError: 'sector' on line 110

it can be suppressed using
info_values = label_values + [ticker_info['currency'], ticker_info['exchange'],
                                              ticker_info['logo_url'], ticker_info['market'], ticker_info.get('sector',"")]

The default vault for sector - ""
With the above change, it seems to be working fine.

Weird thing is, BTC-USD is getting pushed to prometheus but doesnt show up on grafana

Hi @vutsalsinghal ,
Using your fix, I set the default value "undefined" for all share infos. Using this, I see well the Bitcoin in Grafana.
Can you test if it's good for you ?

Its working now! Thank you.


atclient_connection_send fails to send cram command to secondary server

Describe the bug
I have been trying to send the cram command to the secondary server. The mbedtls_ssl_write (used by atclient_connection_send) somehow returns a valid int value but the cram command is not received on the server side. Then the program exits with 'mbedtls_ssl_read failed with exit code -26624' (26624 converted to hex is 0x6800).
Note that the rest of the commands before cram - fetching secondary address from root server and fetching challenge from secondary(from:@atsign) are executing as expected.
Steps to reproduce

First I 'fetch the challenge from the server'
Then I 'generate a digest with this challenge and cram secret'
And then 'send the command cram:digest/r/n'
This command does not reach the server and also the existing socket is terminated

Expected behavior
The command should go through to the server and the server should respond with 'data:success'
Screenshots
Note: The server is using my local time but the client seems to be using UTC
Server:

Client:

Additional context
No response

Are you remembering to add \r\n at the end of the src buffer?
Also make sure not to send the null-terminator.
So sending cram:$digest\r\n is right, but cram:$digest\r\n\0 might give you that error

Closing this ticket as this is solved. The fix will be part of the at-activate PR that will be linked to https://github.com/atsign-foundation/noports/issues/1325.


On Consumer - Error: Too much pending tasks

Package Name: @azure/event-hubs
Package Version: 5.3.1
Operating system: ubuntu docker
[ ] nodejs

version: 14.15

Describe the bug
Getting "Error: Too much pending tasks" on consumer service.
There seems to be no impact on the consumption of events but still we are getting a lot of this error.
Stack
Error: Too much pending tasks     at AsyncLock.acquire (/src/node_modules/async-lock/lib/index.js:160:15)     at ManagementClient.<anonymous> (/src/node_modules/@azure/event-hubs/dist/index.js:618:56)     at Generator.next (<anonymous>)     at /src/node_modules/tslib/tslib.js:114:75     at new Promise (<anonymous>)     at Object.__awaiter (/src/node_modules/tslib/tslib.js:110:16)
azure:event-hubs:warning [3783cb9e-658e-424d-8584-4dc094e43863] An error occured within the EventProcessor loop: Error: Too much pending tasks

@RazYahkovnia
So you're still seeing events come in even while encountering this error?
This looks the same as #14606 except in that case I believe we're not seeing any events come in while this is happening.

As I can see we are not losing data, but we are getting a lot of this errors. is there an update on that?


Incorrect assertion.

Challenge Bonfire: Check for Palindromes has an issue.
User Agent is: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/45.0.2454.101 Safari/537.36.
Please describe how to reproduce this issue, and include links to screenshots if possible.
The console says that:
assert(palindrome("0_0 (: /-\ :) 0-0") === true, '"0_0 (: /-\\ :) 0-0" should return true.');"0_0 (: /-\ :) 0-0" should return true.

however, it should not return true because it has an underscore in the first 0_0 and a hyphen in the second 0-0.
My code:
function palindrome(str) {
  // Good luck!

  str = str.toLowerCase();

  str = str.replace(/\s/g, "");
  str = str.replace(/\./g, "");
  str = str.replace(/,/g, "");
  str = str.replace(/\!/g, "");

  var regular = str;
  var rev = str.split("").reverse().join("");
  if(regular == rev){
    return true;
  } else {
    return false;
  }
}

palindrome("eye");

Just ran into this a few minutes ago. Very annoying as I'm failing because someone made a typo

The test is also wrong because the (: and :) sections are not the same.

Please read issue #3400

Makes sense. Thank you

Closing this issue. @Tim15 feel free to reopen if you still experience problems, thanks.


***** IGNORE  - TEST OF BUGZILLA UNDER RH9 *****

Reported by Kevin M O Brien on 19 Dec 2003 19:06 UTC
just a test to see if i can check a bug into bugzilla...
Migrated-From: http://dunkel.pmel.noaa.gov/trac/ferret/ticket/756

Modified by karl.smith on 5 Jan 2011 20:49 UTC


Version 0.8.6

[ ] Address issue with TikTokLive package failure to retrieve Room ID: https://github.com/isaackogan/TikTokLive/issues/23

Hotfix release. No new additional features will be included.

Release: https://github.com/isaackogan/TikTokLive/releases/tag/v0.8.6


How to handle the base class scernario.

I have an entity class B which inherits from class A. For Eg @interface B : A . So for class A I have written as @interface A : JSONModel. But it is giving an error as EXCEPTION: Invalid type in JSON write (A) when I try to convert the object of class B to json string using toJSONString method.

https://github.com/jsonmodel/jsonmodel/blob/master/CONTRIBUTING.md#issues


Merge pull request #6 from skyeflier/feature/add-html

add starter code

Worked with tutor, and didn't notice I needed to add a note when submitting this pull request: Added CSS to HTML for prework assignment


Freeze names in serialization

Resolves #316
We freeze names and then rebuild the function to avoid trying to serialize functions. Custom layers will still present an issue, but I think fixing that might require a different solution

For custom layers we need to either support MFArgs tuples or force people to pass functions in the &Mod.fun/arity format.

@josevalim Do you think it's enough to document that in order to serialize custom layers you need to use the fully qualified MFA function? We could probably also raise in unsupported cases?

I think we should warn if you try to serialize something with "improper layers". I am, however, concerned that &Mod.fun/3 won't be enough and we will also have to support MFArgs tuples ({mod, fun, additional_args}).
For example, if we want to serialize the models in Bumblebee, which we likely want, they will have to be written in said format... so I am even thinking if we should enforce MFArgs altogether.


Syntax highlighting on InfluxData homepage does not work fully

InfluxData Homepage, go to the section Code in the languages you love.
Syntax highlighting only works with Javascript programming language.
If you select one of the 4 other langauges, syntax highlighting does not work.
Relevant URLs

https://www.influxdata.com/

Additional Infos

Browser: Firefox 99.0
OS: Win10 64bit

Thanks for reporting @Franky1. This section of the site isn't managed by the Docs team, but I'm transferring this issue to the appropriate repo.


Add Currently Playing Media Image to MediaServiceData

Fixes #1047
This PR is ready for review.
Risk
This PR makes minor API changes.
Testing Plan
Code snippet
                    final SdlArtwork mediaImage = new SdlArtwork("mediaImage.png", FileType.GRAPHIC_PNG, R.drawable.media_image, false);
                    sdlManager.getFileManager().uploadArtwork(mediaImage, new CompletionListener() {
                        @Override
                        public void onComplete(boolean success) {
                            Log.i(TAG, "onComplete: service published and file sent");
                            if(!success){
                                Log.e(TAG, "onComplete: file didn't send correctly");
                                return;
                            }
                            OnAppServiceData onAppServiceData = new OnAppServiceData();
                            MediaServiceData mediaServiceData = new MediaServiceData();
                            mediaServiceData.setMediaTitle("The title is media");
                            Image image = new Image();
                            image.setImageType(ImageType.DYNAMIC);
                            image.setIsTemplate(false);
                            image.setValue(mediaImage.getName());
                            mediaServiceData.setMediaImage(image);

                            AppServiceData appServiceData = new AppServiceData();
                            appServiceData.setServiceType(AppServiceType.MEDIA.toString());
                            appServiceData.setServiceID(serviceID);
                            appServiceData.setMediaServiceData(mediaServiceData);
                            onAppServiceData.setServiceData(appServiceData);

                            sdlManager.sendRPC(onAppServiceData);

Summary

Added the mediaImage param to MediaServiceData

Changelog
Enhancements

Added the mediaImage param to MediaServiceData

Tasks Remaining:

[x] Add param to RPC class
[x] Add tests

CLA

[x] I have signed the CLA

Codecov Report

Merging #1074 into develop will increase coverage by 0.04%.
The diff coverage is 100%.

@@             Coverage Diff              @@
##             develop   #1074      +/-   ##
============================================
+ Coverage      46.05%   46.1%   +0.04%
- Complexity      3692    3694       +2
============================================
  Files            433     433
  Lines          20260   20263       +3
  Branches        2190    2190
============================================
+ Hits            9331    9342      +11
+ Misses         10445   10435      -10
- Partials         484     486       +2

Impacted Files
Coverage Δ
Complexity Δ

...om/smartdevicelink/proxy/rpc/MediaServiceData.java
100% <100%> (ø)
28 <2> (+2)
:arrow_up:

...smartdevicelink/encoder/VirtualDisplayEncoder.java
28.97% <0%> (+4.54%)
8% <0%> (ø)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 38b8d22...f20420d. Read the comment docs.


Autoexpose types by [Exposed]

This reads [Exposed] and use it to determine whether this type should be written to the target lib file, so that we won't forget to expose new types on webworker.generated.d.ts.

some merge conflicts need attention.


Implemented Caching in loaded datasets for Improved Performance

Description:
This PR introduces caching mechanisms for loaded datasets and summary-based functions to enhance application performance and reduce load times. By leveraging Streamlit's built-in st.cache_data function, we aim to optimize repeated access to static CSV data and eliminate unnecessary reloading.
Changes:

Implemented a new caching function: cache_data using Streamlit’s st.cache_data feature.
Considered implementing a custom caching solution but opted for Streamlit’s in-built function due to its simplicity and efficiency.

Impact:

Performance Boost: By caching static datasets (CSV) and summary functions, load times will be significantly reduced, especially in scenarios where real-time data is not required.
Resource Efficiency: Reduces redundant processing by storing results from repetitive dataset loading and computation tasks.

References:
https://docs.streamlit.io/develop/api-reference/caching-and-state/st.cache_data

Comparison videos of existing load and new load time after cache_data:
Existing: https://drive.google.com/file/d/1DhsmF-K-hCKsOF3mAHOdkFp8q8aB2rqX/view?usp=sharing
New: https://drive.google.com/file/d/1ZF7YFSDCMZ2Y0K9ZTMGbYY2l0nuY6hi8/view?usp=sharing
Related issue:
#372

@sanjay-kv Could you please review the PR?

@sanjay-kv Thanks for adding labels. Please let me know if I had to do any changes!

its all good .


Guzzle Error on laravel 8

Root composer.json requires sc0vu/web3.php dev-master -> satisfiable by sc0vu/web3.php[dev-master].

sc0vu/web3.php dev-master requires guzzlehttp/guzzle ~6.0 -> found guzzlehttp/guzzle[6.0.0, ..., 6.5.x-dev] but it conflicts with your root composer.json require (^7.0.1).

Unable to install on latest laravel 8

I'm having the same issue.
If we have the v7 of guzzle it gives this error.
In the composer.json it has as a requirement the possibility of guzzle 7, so i dont get it why this not working...
At the moment i'm using my fork (https://github.com/Morinohtar/web3.php/tree/g7) which works fine and i only added guzzle 7 as a possibility also in composer.json.
My code:
"guzzlehttp/guzzle": "~6.0|^7.0",
Original:
"guzzlehttp/guzzle": "^6.3 | ^7.0",

Any news regarding this? Does not seem so complicated and time consuming to fix this...

Please solve guzzle error please

Issue not resolve ? I got the same error. @Morinohtar How can i use your fork ?

Issue not resolve ? I got the same error. @Morinohtar How can i use your fork ?

unfortunately this simple issue to solve keeps dragging...
You can use this: https://github.com/Morinohtar/web3.php/tree/g7
The g7 branch.

Issue not resolve ? I got the same error. @Morinohtar How can i use your fork ?

unfortunately this simple issue to solve keeps dragging...
You can use this: https://github.com/Morinohtar/web3.php/tree/g7
The g7 branch.

Thanks but how to install it with composer ?

Like i said before the only changes i did was this in the composer.json:
"guzzlehttp/guzzle": "~6.0|^7.0",
"PHP": "^7.1|^8.0",

Perfect it's working ! Thanks you.


feat(eventsub): add automod events

Type: Feature
Fixes: #569
Implemented subscription types:

automod.message.hold
automod.message.update
automod.settings.update
automod.terms.update
channel.chat.user_message_hold
channel.chat.user_message_update

Tested this manually using yalc.
Ignore discrepancies with the documentation. As is often the case on Twitch, the documentation doesn't match the actual payload.
UPD:
I just noticed channel.chat.user_message_hold and  channel.chat.user_message_update topics may additionally require user:bot scope if an app access token is used. I don't know how to handle this properly.

I just noticed channel.chat.user_message_hold and  channel.chat.user_message_update topics may additionally require user:bot scope if an app access token is used. I don't know how to handle this properly.


Redshift: Query returning broken Japanese character

My data in AWS Redshift is in Japanese. When I am selecting data row by row there is no problem. I am getting perfect characters. But when I am selecting all data from the table the query returning me some broken characters.
When my query is: select * from table_A where item_id=x;
My query returning: 日配
When my query is: select * from table_A;
My query returning the same value as  ���配
This happens only for one or two rows only. the rest are okay. If I re-order my query with order by clause instead of the previous values some new values become broken.
Normally, I upload data using the Pyspark Glue job, but I tried uploading directly using the copy command. I used both Parquet and CSV formats. But, the result is the same. Before uploading the data I confirmed that the data encoding is UTF-8. The data was imported from the Microsoft Excel file using panda read_excel and then saved in Parquet format. I also tried manually saving the data in UTF-8 and UTF-8 BOM from excel and from notepad. But, no luck.
Any help will highly be appreciated.

Question does not relate to Github code. Question has also been asked on Stack Overflow. Closing this issue.


[Feat]: Implement Syntax Highlighting in Webview Chat

Is your feature request related to a problem?
The chat interface in the webview currently does not support syntax highlighting, which can make it difficult for users to read and understand code snippets.
Describe the solution that you'd like
Integrate a syntax highlighting library into the webview chat interface to automatically highlight code snippets in messages. This should support Dart/Flutter syntax at a minimum.
Describe alternatives that you have considered

Additional Information
Investigate libraries like PrismJS or highlight.js that can be embedded into webviews for syntax highlighting. Explore media/chat/scripts/main.js to know how currently code markdown to plain text works.
Acceptance Criteria

Code snippets in chat messages are syntax-highlighted.
The highlighting supports Dart/Flutter syntax.
The feature does not significantly impact the performance of the chat interface.

Hello @yatendra2001, I can made this feature

Awesome @matiasdev30 , assigned this to you.

@matiasdev30 , can we also make sure that the background colour for the code is black?
Try to look for a showdown library for that inside code. You can find it under the media/chat/scripts/main.js file.

Hi @matiasdev30, do we have an ETA for the issue? please let us know and we're happy to help.

Reassigning this issue because of no response.
@matiasdev30 we understand if you were not able to find time. Please feel free to share your interest on the other open issues.

Hi @samyakkkk please assign this issue to me

Assigned to you @wadhia-yash. Thanks.

closed by #154


can not use multi-gpu in data2vec training

I use this code
code------------------
python fairseq_cli/hydra_train.py -m --config-dir examples/data2vec/config/audio/pretraining
--config-name base_librispeech task.data=/path/to/manifests common.user_dir=examples/data2vec
code------------------
to train data2vec model, distributed_training.distributed_world_size is set to 16, but, the log and the system shows there are only one gpu used in training.
log------------------
[2022-02-18 08:45:58,583][fairseq_cli.train][INFO] - training on 1 devices (GPUs/TPUs)
log------------------

Did you find a workaround ?

you might need to check WORLD_SIZE env var


Kapt Failing to Generate .java files

I'm unable to get kapt to generate .java files on compiling a kotlin project (that is not an android project). So I have neither Entity implementations nor Models.java This is my build.gradle
group 'FastFood'
version '0.0.1'

buildscript {
    ext.kotlin_version = '1.2.30'
    ext.ktor_version = '0.9.2-alpha-2'

    repositories {
        mavenCentral()
    }
    dependencies {
        classpath "org.jetbrains.kotlin:kotlin-gradle-plugin:$kotlin_version"
    }
}

apply plugin: 'java'
apply plugin: 'kotlin'
apply plugin: 'application'
apply plugin: 'kotlin-kapt'

sourceCompatibility = 1.8

repositories {
    mavenCentral()
    maven { url  "http://dl.bintray.com/kotlin/ktor" }
    maven { url "https://dl.bintray.com/kotlin/kotlinx" }
}

kotlin {
    experimental {
        coroutines "enable"
    }
}

kapt {
    generateStubs = true
}

sourceSets {
    main.kotlin.srcDirs += "src/main"
    test.kotlin.srcDirs += "src/test"
}

dependencies {
    compile "org.jetbrains.kotlin:kotlin-stdlib-jdk8:$kotlin_version"
    compile "io.ktor:ktor-server-netty:$ktor_version"
    compile "io.ktor:ktor-jackson:$ktor_version"
    compile "ch.qos.logback:logback-classic:1.2.1"
    compile 'io.requery:requery:1.4.0'
    compile 'io.requery:requery-kotlin:1.4.0'
    kapt 'io.requery:requery-processor:1.4.0'
    compile 'com.zaxxer:HikariCP:2.7.8'

    testCompile group: 'junit', name: 'junit', version: '4.12'
    testCompile "io.ktor:ktor-server-test-host:$ktor_version"
}

mainClassName = 'io.ktor.server.netty.DevelopmentEngine'

compileKotlin {
    kotlinOptions.jvmTarget = "1.8"
}
compileTestKotlin {
    kotlinOptions.jvmTarget = "1.8"
}

and this is one of the classes that I have annotated with @Entity
package data

import io.requery.*

@Entity
abstract class FoodItem : Persistable {

    @get:Generated
    @get:Key
    abstract val id: Int

    abstract val name: String

    @get:ManyToOne
    abstract val vendor: Vendor

}

Right now on compilation it seems like kapt might not even be running? I tried with versions 1.3.0, 1.3.2, 1.4.0 all without success. Any help would be awesome, if you need more information let me know.

That doesn't seem to do the trick. Any other recommendations?

    generateStubs = true
}``` is not relevant with the `kotlin-kapt` plugin

all property must use var not val except key property.

Try updating your model to use var for modifiable columns/fields as mentioned. Also check the gradle build output or the IDE message window any error running kapt should be there.


Drop EoL module support

This is a requirement to update the module dependencies. The dependencies don't support such ancient operating systems.
also contains:

#154

Thanks for all the PR's! Is there any order in which they should be merged? Because some changes are in different PR's as well. Also wondering if we're not disabling too many Rubocop checks.

Every branch is built on top of each other. https://github.com/sensson/puppet-powerdns/pull/151 is the latest. When you merge that, all other PRs will be marked as merged as well. But you can also merge them in a random order.
I'm also not a big fan of this particular rubocop config, but it's the default from pdk update: https://github.com/puppetlabs/pdk-templates/blob/main/config_defaults.yml#L66-L486


Weird Problem about libLLVM

I have encountered a weird problem when running the program in Project 1. It says that FFMPEG is not installed properly and when I try to run '] build FFMPEG' it says unable to open libLLVM. I have tried to re-install Julia, but the problem remains. Some answers I found online suggests checking the LLVM version info, but I still couldn't see the problem. I have attached relevant information as txt.
FFMPEG not installed properly.txt
build FFMPEG.txt
versioninfo.txt

That works, thanks a lot.


How to send notification to another user's slack workspace

I want to send slack notification (message as an app to another workspace).

I have created a slack app as slack_app
I have installed slack_app into my own_workspace as own_ws.
A external users say user_x has installed my slack app into their workspace.

I want to automate this sending notification business using third parties for example, using courier or using something else library.
I have webhook url of user_x's slack workspace which i caught during oauth installation and that is something can be used to send messages but how to automate this sending notification via some third party.
How we can send notification/message into another workspace ? I did research a bit but could not find relevant information anywhere.
Sorry that creating this an issue, It is Question/discussion label. I could not find anything, hence posted here for some positive response.

Sorry, you have the wrong project. I think you're looking for one of the Slack SDK repos


Mailgun region API selection based on region parameter

Added support for EU Mailgun region (https://documentation.mailgun.com/en/latest/api-intro.html#mailgun-regions)

US (global) API is kept as default
Region can be configured by query parameter "region" (example: mailgun://api-key@mg.domain.cz?region=eu)
List of API endpoints is kept in MailgunApiWrapper

Thank you! Soon I will generate the release 2.0.5

Release created


Option to remove default HTML wrapper

Currently by default the content is wrapped with

 tags
Is it possible to remove this default

 tags from the content and have just the raw content without any html tags wrapped around them, and only add tags by selecting from the menu?

https://github.com/ueberdosis/tiptap/issues/154
I think it can be like this.
https://github.com/yikoyu/vuetify-pro-tiptap/blob/808d9ce684e9f05650f521ead1df3491118723a3/src/components/VuetifyTiptap.vue#L149..L154
function getOutput(editor: CoreEditor, output: Props['output']) {
  if (output === 'html') return editor.isEmpty ? '' : editor.getHTML()
  if (output === 'json') return editor.isEmpty ? {} : editor.getJSON()
  if (output === 'text') return editor.isEmpty ? '' : editor.getText()
  return ''
}

If everything goes smoothly, it will be fixed in v2.3.1.

:tada: This issue has been resolved in version 2.4.0 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Error on first run - ValueError: unknown locale: UTF-8

I just installed aws-shell on El-Capitan (10.11.5), and getting this error:
First run, creating autocomplete index...
Traceback (most recent call last):
  File "/usr/local/bin/aws-shell", line 9, in <module>
    load_entry_point('aws-shell==0.1.1', 'console_scripts', 'aws-shell')()
  File "/Library/Python/2.7/site-packages/awsshell/__init__.py", line 43, in main
    from awsshell.makeindex import write_index
  File "/Library/Python/2.7/site-packages/awsshell/makeindex.py", line 7, in <module>
    from docutils.core import publish_string
  File "/Library/Python/2.7/site-packages/docutils/core.py", line 20, in <module>
    from docutils import frontend, io, utils, readers, writers
  File "/Library/Python/2.7/site-packages/docutils/frontend.py", line 41, in <module>
    import docutils.utils
  File "/Library/Python/2.7/site-packages/docutils/utils/__init__.py", line 20, in <module>
    import docutils.io
  File "/Library/Python/2.7/site-packages/docutils/io.py", line 18, in <module>
    from docutils.utils.error_reporting import locale_encoding, ErrorString, ErrorOutput
  File "/Library/Python/2.7/site-packages/docutils/utils/error_reporting.py", line 47, in <module>
    locale_encoding = locale.getlocale()[1] or locale.getdefaultlocale()[1]
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/locale.py", line 543, in getdefaultlocale
    return _parse_localename(localename)
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/locale.py", line 475, in _parse_localename
    raise ValueError, 'unknown locale: %s' % localename
ValueError: unknown locale: UTF-8

Python version:
$ python --version
Python 2.7.10

Found the solution here: http://stackoverflow.com/questions/22265659/trying-to-install-aws-cli-stuck-on-a-step
Still leaving this open, maybe it should give a more meaningful error if it expects those environment variables to be set?

This seems to be an issue affecting various Python projects.  Here's a similar Stack Overflow post that points to a bug in Python.

There is an outstanding bug report related to this issue. It appears that Python makes some assumptions about the format of locale names that aren't universally valid. Explicitly setting these environment vars is basically just a workaround for that bug.

Seeing as this is an upstream bug (potentially as far upstream as Python itself) and the only action we could take here is to re-throw a more meaningful error message I'm going to close this out. At least presently searching for the exact error that's being thrown now will easily lead you to the solution of setting those environment variables. Changing the error message might actually make it harder to find a solution.


next: SSO should support auto link existed user account

connects #841

If app's authRecordKeys contains ['email'], then auto connect procedure will be executed.
If auto connect is executed, it will find corresponding password principal base on authData (which is a map contains provider email), if it finds one, then will use it as the user principal.
When signup a new user, and app's authRecordKeys contains ['email], it will generate an empty password principal as well.

@kaojohnny I find the same problem of test setup in login with custom token, which I've just opened a PR to fix it https://github.com/SkygearIO/skygear-server/pull/854


Exception: FileSizeExceeded when running subset with whole files

Description
Subset workflow raises FileSizeExceeded error.
Environment

rook version used, if any: 0.4.0
Python version, if any:
Operating System:

Steps to Reproduce
Running a subset (return whole files) workflow on:
c3s-cmip6.ScenarioMIP.MOHC.HadGEM3-GC31-LL.ssp245.r1i1p1f3.day.tas.gn.v20190908

Get an pywps exception when building the metalink document:
Traceback (most recent call last):
  File "/usr/local/anaconda/envs/rook/lib/python3.7/site-packages/pywps/app/Process.py", line 248, in _run_process
    self.handler(wps_request, wps_response)  # the user must update the wps_response.
  File "/usr/local/src/rook/rook/processes/wps_orchestrate.py", line 96, in _handler
    response.outputs["output"].data = ml4.xml
  File "/usr/local/anaconda/envs/rook/lib/python3.7/site-packages/pywps/inout/outputs.py", line 460, in xml
    return self._template.render(meta=self)
  File "/usr/local/anaconda/envs/rook/lib/python3.7/site-packages/jinja2/environment.py", line 1090, in render
    self.environment.handle_exception()
  File "/usr/local/anaconda/envs/rook/lib/python3.7/site-packages/jinja2/environment.py", line 832, in handle_exception
    reraise(*rewrite_traceback_stack(source=source))
  File "/usr/local/anaconda/envs/rook/lib/python3.7/site-packages/jinja2/_compat.py", line 28, in reraise
    raise value.with_traceback(tb)
  File "/usr/local/anaconda/envs/rook/lib/python3.7/site-packages/pywps/templates/metalink/4.0/main.xml", line 14, in top-level template code
    {% if file.size %}
  File "/usr/local/anaconda/envs/rook/lib/python3.7/site-packages/jinja2/environment.py", line 471, in getattr
    return getattr(obj, attribute)
  File "/usr/local/anaconda/envs/rook/lib/python3.7/site-packages/pywps/inout/outputs.py", line 364, in size
    return os.stat(self.file).st_size
  File "/usr/local/anaconda/envs/rook/lib/python3.7/site-packages/pywps/inout/outputs.py", line 387, in file
    return self._output.file
  File "/usr/local/anaconda/envs/rook/lib/python3.7/site-packages/pywps/inout/basic.py", line 462, in file
    raise FileSizeExceeded(error_message)
pywps.exceptions.FileSizeExceeded: 400 FileSizeExceeded: File size for input "?" exceeded. Maximum allowed: 209715200.0 megabytes

Exception says "megabytes" ... but should be "bytes".
Additional Information
Code in pywps:
https://github.com/geopython/pywps/blob/bbca1e42b63cf9c31c40fa3e2a731a1528adb2b9/pywps/inout/basic.py#L462

Need to fix the unit in the error message using bytes:
 File "/usr/local/anaconda/envs/rook/lib/python3.7/site-packages/pywps/inout/basic.py", line 462, in file
    raise FileSizeExceeded(error_message)
pywps.exceptions.FileSizeExceeded: 400 FileSizeExceeded: File size for input "?" exceeded. Maximum allowed: 209715200.0 megabytes

Also in production mode we don't see this error message ... maybe use a different exception type.

For whole files we are just returning URLs pointing to the data node. But the metalink extension in pywps is smart and checks the file size of those URLs.
Need to increase the default value in pywps config:
maxsingleinputsize = 3000mb
maxrequestsize = 200mb

Updated default in ansible deployment:
https://github.com/bird-house/ansible-wps-playbook/pull/135
Can be overwritten in custom.yml.


Update README.md with new release instructions.

Instead of bundle exec rake release, let's use GitHub as a trusted publisher moving forward.
There's still a lot of manual wrangling here. Tempted to wrap more of this up into a rake task to make it simpler, less steps, and less error-prone. That's a future effort.

I used the instructions in this PR to create the v1.1.0 release


use columns renderer has bug

Description
Warning: render(...): It looks like the React-rendered content of this container was removed without using React. This is not supported and will cause errors. Instead, call ReactDOM.unmountComponentAtNode to empty a container.
Steps to reproduce

Demo

https://jsfiddle.net/handsoncode/c6rgz08x/
Your environment

React wrapper version:
Handsontable version:
Browser Name and version:
Operating System:

@yangQingYu123 Could you be more specific about when this warning appears? I can't see it in the jsfiddle you linked and you didn't provide any steps for reproduction.


Add method to fork stream

It would be useful to have a StreamExt method to “fork” a stream with Item: Clone, returning another stream which receives the same items from that point.

It could also be named tee, like the itertools method.

:+1: for tee