Test Regression from #35

The following tests have started failing since #35

DepthCameraSensor/DepthCameraSensorTest.ImagesWithBuiltinSDF/ogre2

/var/lib/jenkins/workspace/ignition_sensors-ci-ign-sensors2-bionic-amd64/ign-sensors/test/integration/depth_camera_plugin.cc:435
The difference between expectedDepth and d is 0.19999999999999996, which exceeds 1e-6, where
expectedDepth evaluates to 0.19999999999999996,
d evaluates to 0, and
1e-6 evaluates to 9.9999999999999995e-07.

RgbdCameraSensor/RgbdCameraSensorTest.ImagesWithBuiltinSDF/ogre2

/var/lib/jenkins/workspace/ignition_sensors-ci-ign-sensors2-bionic-amd64/ign-sensors/test/integration/rgbd_camera_plugin.cc:553
Expected equality of these values:
  -ignition::math::INF_D
    Which is: -inf
  g_depthBuffer[index]
    Which is: 0

Probably caused by https://github.com/ignitionrobotics/ign-rendering/issues/129

being addressed in https://github.com/ignitionrobotics/ign-rendering/pull/130


improve error messages when socket binding fails, and when albatross_…

…daemon fails to connect to console socket
inspired by the report in #137

Thanks, looks good


added BasePathLocaleGuesser

Tests are failing in this one

do you think it makes sense to add this? if yes I can look about fixing the tests

this is getting old, i'm closing it. if it still relevant, i think that it needs to be re visited


🐛 report BCF2 missing floats

Hi Brent,
This PR gives floats dot notation when you set their missing_value to<PHONE_NUMBER>.
Going off discussion in #28 , I tested the BCF2 value of 0x7F800001/2139095041 as the missing_value to no avail. I was unable to find any i32 value that could generate the necessary f32 value.
This solution mirrors the methodology used in rust-htslib for missing floats: https://github.com/rust-bio/rust-htslib/blob/3008a131f241b423d041c756fc96410f6412e3d8/src/bcf/record.rs#L33.

thanks very much!

I pushed a release with your change: https://github.com/brentp/echtvar/releases/tag/v0.1.9
thanks again.


Change repeat to expand in GQA

This reduces memory usage and improves MFU. Note that there may be some risk of NaNs with small d_head (this was previously seen for MQA). However, there is significant perf benefits for standard d_head.

Will this be backwards compatible with any MPT model using GQA, trained using the code from a commit before this?

@madhavatreplit yes, this is backwards compatible, as the model weights don't change, this is simply an optimization for the attention function to avoid allocating new memory.


Create intial tables from data model

The initial Bionomics and Occurrence tables need to be created from the data model stored in src/Database/DataModel_v1.xlsx. These will need to be created as entity files in the API folder, following the example set by the geo_data.entity file, and replacing said file and associated files. Connections between the tables should be created, and the changes should be applied to a local database before a new dump script is generated to replace db_dump.sql.
Acceptance Criteria:

[x] All the sheets currently in DataModel_v1.xlsx are represented as entity files in the API project, with appropriate data types as defined in the data model sheets
[x] Appropriate other files (model, module, resolver, service) exist for the new entities, which allow data extraction at the Bionomics and Occurrence level (but not lower down)
[x] The db_dump.sql file in the Database folder has been updated to reflect the new state of the data model. When the db docker container is started, this sql file is used to create the correct tables in the dockerised db, and the API can connect to this db without error.

db_dump.sql is now called init_db.sql

All AC met. I had to clear and rebuild my local environment to see the new changes to model/database.


Feature request: Run non-binary targets

Hi,
I think this vscode extension is amazing and I have been using it for several projects, thanks for maintaining it!
I think a feature that would be nice is if you would be able to build all targets and then being able to run a non-binary target from the vscode UI. Currently, I use a terminal interface to do such things, which is fine, but I guess it would be more convenient to have a UI for this. It is currently somewhat already possible to achieve what I am requesting if you set your built target to the particular target you want to execute (instead of all), but then this target will be executed each time you build in vscode (which I personally would not prefer, imagine an SoC programming target).
One way to do this would be to add (in addition to the existing "run" button which displays the executables, one could have a separate "run" button for targets)
Best regards,
Tofik

Hello Tofik!
In the future please revise your concern/concerns with an example. As I don't think, in particular this instance, many will understand what you have portrayed to be an issue.
Yours truly/
Abdi.

Skimming through the source code, there seems to be a command registered in extension.ts, runUtilityTarget, which by name seems to be what I am requesting. The command however does not seem to have an implementation however. Was there a conclusion that this is an unnecessary feature or maybe no one just implemented it yet?

Thank you for the feature idea. We may not be able to implement this immediately but we will track the community reactions to properly triage this feature. runUtilityTarget indeed doesn't look like it's doing anything.


[Improve][Connector-V2][TableStore] Unified exception for TableStore connector

Search before asking

[X] I had searched in the feature and found no similar feature requirement.

Description
sub-task of https://github.com/apache/incubator-seatunnel/issues/2930
Usage Scenario
No response
Related issues
No response
Are you willing to submit a PR?

[X] Yes I am willing to submit a PR!

Code of Conduct

[X] I agree to follow this project's Code of Conduct

This task had been done.


user-v2 regression in master: DNS wouldn't work with existing VMs

@balajiv113: I found that after upgrading from lima to 0.17.2 to HEAD-de1b3ee, DNS wouldn't work with existing VMs. I had to delete and recreate the VM for DNS to work at all. Is that expected?

Originally posted by @aaronlehmann in https://github.com/lima-vm/lima/issues/1333#issuecomment-1707404240

I checked this. Iptables it looks fine.
But the nameservers in user-data is not updated to new record after new version update

I couldn't find a way to fix this yet. One thing i noticed is the dns nameserver not updated correctly. Apart from that all were looking fine only.
Let me know if we have some ways to enforce cloud-init to update nameservers on every boot

If the issue happens only on upgrade we can just let hostagent fix up DNS?

@AkihiroSuda
This is actually not happening.
Started net-user-v2 in old version. Did stop on old version. Started the same in current master DNS is working fine.
There are few other issue but unrelated to regression

Thank you, seems we can close this

I could definitely reproduce this reliably when I reported the issue. I would create a VM with colima, upgrade lima to HEAD, and always get broken DNS. I didn't have this problem when I started with lima HEAD. I'm traveling right now but would be happy to provide more details when I get back.

@AkihiroSuda @balajiv113: Repro steps:
➜  ~ colima delete
are you sure you want to delete colima and all settings? [y/N] y
INFO[0001] deleting colima
INFO[0001] done
➜  ~ brew uninstall --ignore-dependencies lima
Uninstalling /opt/homebrew/Cellar/lima/HEAD-de1b3ee... (111 files, 169.3MB)
lima 0.17.2 is still installed.
To remove all versions, run:
  brew uninstall --force lima
➜  ~ brew link lima
Linking /opt/homebrew/Cellar/lima/0.17.2... 43 symlinks created.
➜  ~ lima -v
limactl version 0.17.2
➜  ~ colima start
INFO[0000] starting colima
INFO[0000] runtime: docker
INFO[0000] creating and starting ...                     context=vm
INFO[0021] provisioning ...                              context=docker
INFO[0021] starting ...                                  context=docker
INFO[0026] done
➜  ~ docker run -ti --rm alpine ping google.com
Unable to find image 'alpine:latest' locally
latest: Pulling from library/alpine
9fda8d8052c6: Pull complete
Digest: sha256:7144f7bab3d4c2648d7e59409f15ec52a18006a128c733fcff20d3a4a54ba44a
Status: Downloaded newer image for alpine:latest
PING google.com (<IP_ADDRESS>): 56 data bytes
64 bytes from <IP_ADDRESS>: seq=0 ttl=63 time=0.760 ms
64 bytes from <IP_ADDRESS>: seq=1 ttl=63 time=0.980 ms
^C
--- google.com ping statistics ---
2 packets transmitted, 2 packets received, 0% packet loss
round-trip min/avg/max = 0.760/0.870/0.980 ms
➜  ~ colima stop
INFO[0000] stopping colima
INFO[0000] stopping ...                                  context=docker
INFO[0001] stopping ...                                  context=vm
INFO[0004] done
➜  ~ brew unlink lima
Unlinking /opt/homebrew/Cellar/lima/0.17.2... 43 symlinks removed.
➜  ~ brew install --head lima
[...]
➜  ~ lima -v
limactl version HEAD-572b94a
➜  ~ docker run -ti --rm alpine ping google.com
ping: bad address 'google.com'

I don't think this has anything to do with user-v2 mode. But i will check on these following steps and see if its failing

@aaronlehmann could you try directly with lima ?? To see if that works.
As far as i know colima adds their own dns resolver as well for qemu, this might be something related to that as well

@aaronlehmann Thanks for the bug. I was able to re-produce it with alpine image
@AkihiroSuda Looks like if a nameserver gets updated in cloud-init that's not reflected in /etc/resolv.conf on next start

Its works if i do rc-service networking restart

Should have been solved in:

https://github.com/lima-vm/lima/pull/1898

Confirmed the fix, thanks!


Bug report: font-gidole

Description of issue
font-gidole fails to install.
Output of `brew cask  --verbose`
❯ brew cask install font-gidole --verbose
==> Downloading https://github.com/gidole/sans/blob/master/gidole.zip?raw=true
/usr/bin/curl -fLA Homebrew-cask v0.51+ (Ruby 2.0.0-648) https://github.com/gidole/sans/blob/master/gidole.zip?raw=true -C 0 -o /Users/jorum/Library/Caches/Homebrew/font-gidole-latest.zip.incomplete
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100   134    0   134    0     0    171      0 --:--:-- --:--:-- --:--:--   171
100   124    0   124    0     0    131      0 --:--:-- --:--:-- --:--:--   131
100   135  100   135    0     0    123      0  0:00:01  0:00:01 --:--:--   123
100  140k  100  140k    0     0  68066      0  0:00:02  0:00:02 --:--:--  187k
==> No checksum defined for Cask font-gidole, skipping verification
Error: It seems the hardlink source is not there: '/usr/local/Caskroom/font-gidole/latest/Gidole-Regular.ttf'
Error: Kernel.exit

Output of `brew doctor`
Unexpected header files:
    /usr/local/include/python2.7/greenlet/greenlet.h

Output of `brew cask doctor`
==> macOS Release:
10.11
==> macOS Release with Patchlevel:
10.11.5
==> Hardware Architecture:
intel-64
==> Ruby Version:
2.0.0-p648
==> Ruby Path:
/System/Library/Frameworks/Ruby.framework/Versions/2.0/usr/bin/ruby
==> Homebrew Version:
Homebrew 0.9.9 (git revision b586; last commit 2016-07-13)
Homebrew/homebrew-core (git revision c136; last commit 2016-07-13)
==> Homebrew Executable Path:
/usr/local/bin/brew
==> Homebrew Cellar Path:
/usr/local/Cellar
==> Homebrew Repository Path:
/usr/local
==> Homebrew Origin:
https://github.com/Homebrew/brew.git
==> Homebrew-cask Version:
0.60.0 (git revision 3c44; last commit 8 hours ago)
==> Homebrew-cask Install Location:
<NONE>
==> Homebrew-cask Staging Location:
/usr/local/Caskroom
==> Homebrew-cask Cached Downloads:
/Users/jorum/Library/Caches/Homebrew
/Users/jorum/Library/Caches/Homebrew/Casks
2 files, 280.3K (warning: run "brew cask cleanup")
==> Homebrew-cask Default Tap Path:
/usr/local/Library/Taps/caskroom/homebrew-cask
==> Homebrew-cask Alternate Cask Taps:
<NONE>
==> Homebrew-cask Default Tap Cask Count:
3238
==> Contents of $LOAD_PATH:
/usr/local/Library/Taps/caskroom/homebrew-cask/lib
/usr/local/Library/Homebrew
/Library/Ruby/Site/2.0.0
/Library/Ruby/Site/2.0.0/x86_64-darwin15
/Library/Ruby/Site/2.0.0/universal-darwin15
/Library/Ruby/Site
/System/Library/Frameworks/Ruby.framework/Versions/2.0/usr/lib/ruby/vendor_ruby/2.0.0
/System/Library/Frameworks/Ruby.framework/Versions/2.0/usr/lib/ruby/vendor_ruby/2.0.0/x86_64-darwin15
/System/Library/Frameworks/Ruby.framework/Versions/2.0/usr/lib/ruby/vendor_ruby/2.0.0/universal-darwin15
/System/Library/Frameworks/Ruby.framework/Versions/2.0/usr/lib/ruby/vendor_ruby
/System/Library/Frameworks/Ruby.framework/Versions/2.0/usr/lib/ruby/2.0.0
/System/Library/Frameworks/Ruby.framework/Versions/2.0/usr/lib/ruby/2.0.0/x86_64-darwin15
/System/Library/Frameworks/Ruby.framework/Versions/2.0/usr/lib/ruby/2.0.0/universal-darwin15
==> Contents of $RUBYLIB Environment Variable:
<NONE>
==> Contents of $RUBYOPT Environment Variable:
<NONE>
==> Contents of $RUBYPATH Environment Variable:
<NONE>
==> Contents of $RBENV_VERSION Environment Variable:
<NONE>
==> Contents of $CHRUBY_VERSION Environment Variable:
<NONE>
==> Contents of $GEM_HOME Environment Variable:
<NONE>
==> Contents of $GEM_PATH Environment Variable:
<NONE>
==> Contents of $BUNDLE_PATH Environment Variable:
<NONE>
==> Contents of $PATH Environment Variable:
PATH="/Users/jorum/.rbenv/shims:/usr/local/bin:./bin:/Users/jorum/.rbenv/shims:/usr/local/sbin:/Users/jorum/.dotfiles/bin:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin:/usr/local/opt/go/libexec/bin:/Users/jorum/Dev/go/bin:/Users/jorum/Dev/go/bin:/usr/local/Library/Taps/caskroom/homebrew-cask/cmd:/usr/local/Library/Taps/homebrew/homebrew-bundle/cmd:/usr/local/Library/Taps/homebrew/homebrew-services/cmd:/usr/local/Library/ENV/scm"
==> Contents of $SHELL Environment Variable:
SHELL="/bin/zsh"
==> Contents of Locale Environment Variables:
LANGUAGE="en_US.UTF-8"
LC_ALL="en_US.UTF-8"
LC_CTYPE="UTF-8"
==> Running As Privileged User:
No

You must always follow the reporting bugs guide. When you opened this issue, the template in place urged you to do so and gave you the relevant links.
When the the guide isn‘t followed we get the same issues over and over again. It may not seem to you like it makes a difference, but we already get a non-trivial amount of new issues and pull requests every day. Having to repeatedly deal with the same solved and documented problems leads to maintainer burnout and a lot of wasted hours that could instead have been spent improving Homebrew-Cask itself and fixing real bugs.
I closed this issue because it’s apparent to me the guide wasn’t followed. If I made a mistake in closing, I ask that you correct me. I will reopen it and we can continue the discussion.
If, however, you have indeed not paid the due attention to the guide, pleased go back and do. We will be waiting for your new properly formatted issue (or pull request) that will have most (if not all) the necessary details required for us to help you. With a little luck you won’t even need to open a new issue, as the instructions to report bugs include a lot of fixes for common problems.
Finally, if it was the guide itself that was unclear, make a new pull request with your suggestions on how to improve it.
Your issue is indeed listed.


docs: Better README

Closes #110
Checklist

[x] I didn't over-scope my PR
[x] My PR title matches the commit convention
[x] I did not include breaking changes
[x] I included unit tests that cover my changes
[x] I added/updated the documentation about my changes
[x] I made my own code-review before requesting one

:tada: This PR is included in version 1.0.0-beta.47 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


Roll Flutter Engine from dc14649e1a51 to 474082412be1 (4 revisions)

https://github.com/flutter/engine/compare/dc14649e1a51...474082412be1
2022-08-24<EMAIL_ADDRESS>[fuchsia] Document found != flatland_views.end(). (flutter/engine#35607)
2022-08-24<EMAIL_ADDRESS>Roll Skia from d965473d8719 to f0593b093a72 (2 revisions) (flutter/engine#35675)
2022-08-24<EMAIL_ADDRESS>Roll Dart SDK from 859e9bbe6f0a to 691aa6246705 (1 revision) (flutter/engine#35672)
2022-08-24<EMAIL_ADDRESS>Zip FlutterMacOS.framework. (flutter/engine#35623)
If this roll has caused a breakage, revert this CL and stop the roller
using the controls here:
https://autoroll.skia.org/r/flutter-engine-flutter-autoroll
Please CC<EMAIL_ADDRESS>on the revert to ensure that a human
is aware of the problem.
To file a bug in Flutter: https://github.com/flutter/flutter/issues/new/choose
To report a problem with the AutoRoller itself, please file a bug:
https://bugs.chromium.org/p/skia/issues/entry?template=Autoroller+Bug
Documentation for the AutoRoller is here:
https://skia.googlesource.com/buildbot/+doc/main/autoroll/README.md

Commit queue failed; closing this roll.


Generic Class/Model is not pickable anymore

Initial Checks

[X] I confirm that I'm using Pydantic V2

Description
Hi,
the following generic model is trying to be pickled using python 3.11.2 and pydantic 2.3.
It worked fine before migrating pydantic to v2.
class Regions(BaseModel, Generic[RegionType]):
    """Generic model for type verification per region."""

    reg_a: RegionType
    reg_b: RegionType

    @classmethod
    def instantiate(cls, obj: RegionType) -> "Regions[RegionType]":
        """Instantiate a Region Model.

        Args:
            obj: object to instantiate with.

                ,   0.        ,
         0.        ,   0.        ,   1.        ,   1.        ,
         1.        ]))),), {})
protocol = None

    @classmethod
    def dumps(cls, obj, protocol=None):
        buf = io.BytesIO()
>       cls(buf, protocol).dump(obj)
E       _pickle.PicklingError: Can't pickle <class 'XXX.api.models.regions.Regions[GlobalParametersRegion]'>: attribute lookup Regions[GlobalParametersRegion] on XXX.api.models.regions failed

It could be related to the prior issue: https://github.com/pydantic/pydantic/issues/1667
Thank you in advance.
Example Code
No response
Python, Pydantic & OS Version
pydantic version: 2.3.0
        pydantic-core version: 2.6.3
          pydantic-core build: profile=release pgo=false
                 install path: /Users/benediktbatton/Projekte/AIDevelopment/daimler/MSDDD/range2profit_optimization/.venv/lib/python3.11/site-packages/pydantic
               python version: 3.11.2 (main, Mar  2 2023, 11:28:13) [Clang 14.0.0 (clang-14<IP_ADDRESS>)]
                     platform: macOS-13.4.1-x86_64-i386-64bit
     optional deps. installed: ['email-validator', 'typing-extensions']

Hi @b-batton-sw,
Could you include the code you're using to serialize the model? Ex - an instantiation of the model, then pickle.dumps(x), etc... I'm not able to reproduce this at the moment. Thanks!

Hi @sydney-runkle,
it actually fails in the ForkingPickler of pyton3.11.2 multiprocessing reduction.py implementation:
`class ForkingPickler(pickle.Pickler):
'''Pickler subclass used by multiprocessing.'''
_extra_reducers = {}
_copyreg_dispatch_table = copyreg.dispatch_table
def __init__(self, *args):
    super().__init__(*args)
    self.dispatch_table = self._copyreg_dispatch_table.copy()
    self.dispatch_table.update(self._extra_reducers)

@classmethod
def register(cls, type, reduce):
    '''Register a reduce function for a type.'''
    cls._extra_reducers[type] = reduce

@classmethod
def dumps(cls, obj, protocol=None):
    buf = io.BytesIO()
    cls(buf, protocol).dump(obj)
    return buf.getbuffer()`

The error is raised in the second last line.
Here some further stack-trace:
Exception has occurred: PicklingError       (note: full exception trace is shown but execution is paused at: _run_module_as_main)
Can't pickle <class 'XXX.api.models.regions.Regions[GlobalParametersRegion]'>: attribute lookup Regions[GlobalParametersRegion] on XXX.api.models.regions failed
File "XXX/.pyenv/versions/3.11.2/lib/python3.11/multiprocessing/reduction.py", line 51, in dumps
cls(buf, protocol).dump(obj)
File "XXX/.pyenv/versions/3.11.2/lib/python3.11/multiprocessing/connection.py", line 205, in send
self._send_bytes(_ForkingPickler.dumps(obj))
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "XXX/.pyenv/versions/3.11.2/lib/python3.11/multiprocessing/pool.py", line 540, in _handle_tasks
put(task)
File "XXX/.pyenv/versions/3.11.2/lib/python3.11/multiprocessing/pool.py", line 774, in get
raise self._value
File "XXX/.pyenv/versions/3.11.2/lib/python3.11/multiprocessing/pool.py", line 367, in map
return self._map_async(func, iterable, mapstar, chunksize).get()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "XXX/.venv/lib/python3.11/site-packages/scipy/_lib/_util.py", line 477, in call
return self._mapfunc(func, iterable)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "XXX/.venv/lib/python3.11/site-packages/scipy/optimize/_differentialevolution.py", line 1117, in _calculate_population_energies
self._mapwrapper(self.func, parameters_pop[0:S])
File "XXX/.venv/lib/python3.11/site-packages/scipy/optimize/_differentialevolution.py", line 984, in solve
self._calculate_population_energies(
File "XXX/.venv/lib/python3.11/site-packages/scipy/optimize/_differentialevolution.py", line 392, in differential_evolution
ret = solver.solve()
^^^^^^^^^^^^^^
File "XXX/analysis/analysis.py", line 529, in run_optimization
opt_result = differential_evolution(
^^^^^^^^^^^^^^^^^^^^^^^
I have been able to fix it temporarily by using the fix proposed in #1667
`    def class_getitem(cls, params: Type[Any] | tuple[Type[Any], ...]) -> Type[Any]:
"""Allows to pickle this generic class.
    Args:
        params: parameters

    Returns:
        get pickable class
    """
    created_class = super().__class_getitem__(params)
    setattr(sys.modules[created_class.__module__], created_class.__name__, created_class)
    return created_class `

@b-batton-sw,
Thanks for the prompt response. We currently have a few issues with pickling, and will work on solving this one in conjunction with the others 😄.

@b-batton-sw, I apologize for mentioning you directly, but I’m encountering the same issue when using multiprocessing + pydantic. Could you explain where you applied this fix? Did you make the function a member of the entity you’re attempting to use? Do I need to propagate this function to all sub-items as well?
I’ve done that (made it a member function), but I’m still getting the error . Tried also the #1667:
class PickleableGenericEntity(BaseModel, Generic[T]):
    value: T

    def __class_getitem__(cls, params: Type[Any] | tuple[Type[Any], ...]) -> Type[Any]:
        created_class = super().__class_getitem__(params)
        setattr(sys.modules[created_class.__module__], created_class.__name__, created_class)
        return created_class

Tried also to force the exclusion from the model itself:
    .......

    lock: Optional[threading.Lock] = Field(
        exclude=True,
        default_factory=threading.Lock
    )

None of the suggested fix worked for me.
python 3.11.5
Deps:
pydantic==2.4.2
pydantic-settings==2.0.3
pydantic_core==2.10.1
I hope you can clarify the solution you applied to me.
Thank you in adavance.

@IcedLeon as indicated in my initial post for me the baseclass which was not pickable was Regions(BaseModel, Generic[RegionType]). I implement the class_getitem function inside of the Regions class and it worked.
I believe if the error results from a subclass the function needs to be implemented in there as well.
How does the stacktrace look like after implementing the fix inside of PickableGenericEntity?

@b-batton-sw Thank you for the quick reply!
I used PickableGenericEntity as a 'wrapper' to see if was a plausable solution like this: ( Sorry in advance, my python knowledge is grabage...)
		self.observed_devices_by_mac = {
			observer.tag_address: [PickleableGenericEntity[ObservableDevice](tag) for tag in all_observed_devices.observables if tag.tag_address == observer.tag_address] for observer in all_observed_devices.observables
		}

This is the model I need to use:
class ObservableDevice(BaseModel):
    timestamp: datetime = Field(default=None)
    last_seen: datetime = Field(default=None)
    tag_address: str = Field(default=None)
    observer_address: str = Field(default=None)
    site_id: int = Field(default=0)
    floor_id: int = Field(default=0)
    floor_x: float = Field(default=0.)
    floor_y: float = Field(default=0.)
    floor_z: float = Field(default=0.)
    floor_height: float = Field(default=0.)
    observer_x: float = Field(default=0.)
    observer_y: float = Field(default=0.)
    observer_z: float = Field(default=0.)
    device_type_id: int = Field(default=-1)
    rssi_profile_id: int = Field(default=-1)
    device_type: str = Field(default='')
    location: str = Field(default='')
    rssi: int = Field(default=0)
    pressure: float = Field(default=0.)
    distance: Optional[float] = Field(default=0.)

    def __class_getitem__(cls, params: Type[Any] | tuple[Type[Any], ...]) -> Type[Any]:
        """Allows to pickle this generic class.

        Args:
            params: parameters

        Returns:
            get pickable class
        """
        created_class = super().__class_getitem__(params)
        setattr(sys.modules[created_class.__module__], created_class.__name__, created_class)
        return created_class

I don't extend Generic[T], so I hope we can apply the same principles.
This is my stacktrace once I hit the function call:
  File "\telemetry\src\telemetry_service.py", line 615, in run_service
    self.multiprocessed_trilateration()
  File "\telemetry\src\telemetry_service.py", line 600, in multiprocessed_trilateration
    result = pool.apply(self._update_trilateration_positions, (tag_mac, observed_devices))
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "\usr\local\lib\python3.11\multiprocessing\pool.py", line 360, in apply
    return self.apply_async(func, args, kwds).get()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "\usr\local\lib\python3.11\multiprocessing\pool.py", line 774, in get
    raise self._value
  File "\usr\local\lib\python3.11\multiprocessing\pool.py", line 540, in _handle_tasks
    put(task)
  File "\usr\local\lib\python3.11\multiprocessing\connection.py", line 206, in send
    self._send_bytes(_ForkingPickler.dumps(obj))
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "\usr\local\lib\python3.11\multiprocessing\reduction.py", line 51, in dumps
    cls(buf, protocol).dump(obj)
TypeError: cannot pickle '_thread.lock' object

@b-batton-sw,
I'm able to run the following with no problems with version 2.5.2. Could you let me know if you're still having issues?
from copy import copy
import io
from multiprocessing.reduction import ForkingPickler
from typing import Generic, TypeVar
import pickle

from pydantic import BaseModel

RegionType = TypeVar("RegionType", bound=str)

class Regions(BaseModel, Generic[RegionType]):
    """Generic model for type verification per region."""

    reg_a: RegionType
    reg_b: RegionType

    @classmethod
    def instantiate(cls, obj: RegionType) -> "Regions[RegionType]":
        """Instantiate a Region Model.

        Args:
            obj: object to instantiate with.

        Returns:
            Region with RegionType
        """
        return cls(
            reg_a=copy(obj),
            reg_b=copy(obj),
        )

# Pickle the model
buffer = io.BytesIO()
regions = Regions.instantiate("Region A")

with open("regions.pickle", "wb") as f:
    # Create a ForkingPickler and use it to pickle the regions
    ForkingPickler(f).dump(regions)

# Unpickle the model
with open("regions.pickle", "rb") as f:
    unpickled_regions = pickle.load(f)
print(unpickled_regions)

Unfortunately the issue still exists with 2.5.2.
It fails within  the ForkingPickler of pyton3.11.2 multiprocessing reduction.py implementation

@b-batton-sw,
Could you please provide a full, reproducible code snippet that we could use to recreate this issue on our end?

Still haven't been able to reproduce this on our end, so closing as stale for now. If anyone is able to provide a snippet with an issue we can reproduce, we'd be happy to take a closer look.

@sydney-runkle I seem to be running into something similar. I don't have a simplified repro yet, only in my larger code base. The only thing that seems to be correlated is when I have multiple pydantic._internal._generics._GENERIC_TYPES_CACHE entries for the same parameterized generic type


install pinpoint via k8s ,it shows (c.n.p.p.s.RetryQueue ) discard retry message(RetryMessage{retryCount=3, maxRetryCount=3, bytes=50, messageDescription='ApiMetaData'})

Prerequisites
Please check the FAQ, and search existing issues for similar questions before creating a new issue.YOU MAY DELETE THIS PREREQUISITES SECTION.

[x] I have checked the FAQ, and issues and found no answer.

the web ui has no data

Hello, @Rookie-Shy
I think you need to debug it with the logs.
As you can see quickstart from  https://github.com/naver/pinpoint-docker
works perfectly which means the docker images have no problem.

Dear Roy,
Thanks for your reply.
the url https://github.com/naver/pinpoint-docker is the way of installation via docker-compose.
In my opinion , there are  a huge different between docker-compose and k8s while install pinpoint .
could you provide the install scripts via k8s?
Thanks very much.
Best Regards.
------------------ 原始邮件 ------------------
发件人: "Roy<EMAIL_ADDRESS>发送时间: 2019年9月10日(星期二) 下午2:20
收件人<EMAIL_ADDRESS>抄送: "随遇而安"389157477<EMAIL_ADDRESS>主题: Re: [naver/pinpoint] install pinpoint via k8s ,it shows(c.n.p.p.s.RetryQueue ) discard retry message(RetryMessage{retryCount=3,maxRetryCount=3, bytes=50, messageDescription='ApiMetaData'}) (#5962)
Hello, @Rookie-Shy
I think you need to debug it with the logs.
As you can see quickstart from  https://github.com/naver/pinpoint-docker
works perfectly which means the docker images have no problem.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or mute the thread.

I've tried running pinpoint on k8s a few months ago.
I can't promise you any dates since I'm already on a few things, but I'll see what I can do.
Will comment here for any updates

was it work well on k8s ? I am expecting your update.
Best Regards.
------------------ 原始邮件 ------------------
发件人: "Roy<EMAIL_ADDRESS>发送时间: 2019年9月10日(星期二) 下午2:37
收件人<EMAIL_ADDRESS>抄送: "随遇而安"389157477<EMAIL_ADDRESS>主题: Re: [naver/pinpoint] install pinpoint via k8s ,it shows(c.n.p.p.s.RetryQueue ) discard retry message(RetryMessage{retryCount=3,maxRetryCount=3, bytes=50, messageDescription='ApiMetaData'}) (#5962)
I've tried running pinpoint on k8s a few months ago.
I can't promise you any dates since I'm already on a few things, but I'll see what I can do.
Will comment here for any updates
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or mute the thread.


Compile ballerina modules to .jar

Design Considerations

Each source file (ballerina files) can be compiled down to java class file.

Each function in the source can be added as a static method in the class file.

Each module will have its own BIR generated.

So a module can be compiled to a java package having one or more class files.

We need a way to read and populate the mapping of imported modules and their functions against the class names - method names.

Each imported module will have its own BIR, so we need to compile each BIR to a java package.
While compiling, it is also required to populate the mapping of ballerina functions to its class names - method names.
This mapping information will be used when compiling the user code which has references to the imported modules, functions, variables, types, etc.

The user code can be compiled to a single jar file, which contains the packages from imported modules, and classes generated for the user code.

The generated jar can be a fat jar with all the dependencies required for runtime, Or it can contain only the user code and the imported packages. This depends on our decision with designing the “ballerina run” command.

Fat jar 	      : $ ballerina build --jvm-target --include-runtime abc.bal
Normal jar : $ ballerina build --jvm-target abc.bal

An improvement for fat jar mode is that analysing what are the needed dependencies and include them with the jar rather than including all the runtime jars.

Closing this as most of them are being covered by the packerina design


Update to Python3 style of print

The Udacity course materials says Python3 is preferred.
But when I run using ``python3 demo.py` there is an error.
http://stackoverflow.com/questions/826948/syntax-error-on-print-with-python-3
So I made the change to put what is printed between quotes.
I also added the Python command in the README.md file.

Thanks!


Invoke-PodeTask enhanceent

Describe the Change
I want to be able to run an elevated command using credentials stored as environment variables.  I would like to do this without running the service as an elevated user.  I just want to elevate the execution of a single script block.  It seems impossible to use Invoke-Command using -Session or -Credential.  Also, there is no way to pass either of these parameters to Invoke-PodeTask.  Is there some other way?

Hi @davidfencik,
If you have the credentials stored in environment variables, then using -Credential on Invoke-Command should work 🤔 Have you got some example code as to what you're trying to achieve?


Pure python rest gateway

Description
As an author of a caikit library, I want to have a REST interface available without any extra work.
Discussion
Currently we use the grpc gateway wrapper to provide rest support. This is problematic because:

It requires a custom build process using go to pull the proto interfaces from the library, generate a gateway, and place it in a container image with configuration carefully wired up
Using go in a build process widens the vulnerability service of the final runtime image
grpc-gateway supports swagger v2 but we would really like openapi v3 support

We have the expertise available both for openapi and protobuf/grpc to write our own rest gateway layer in the runtime. This would allow us to support REST out of the box in python, with no extra build process or go required.
Acceptance Criteria

[ ] Unit tests cover new/changed code
[ ] Examples build against new/changed code
[ ] READMEs are updated
[ ] Type of semantic version change is identified

Closing since we've introduced native HTTP support


Possible new reserved word?

So. I saw that I have one query that stopped working a while ago, I can't pinpoint when though.
Looks like blocked is now a reserved word in the project operator.
This works fine for example:
traces
| project x = itemCount

If I do this though:
traces
| project blocked = itemCount

I get this error now:
Syntax Error
Query could not be parsed at 'blocked' on line [2,10]

Token: blocked
Line: 2
Position: 10

If issue persists, please open a support ticket.
Request id: 9df7dd5a-37f4-486e-910f-620dd1542df5

If this expected now or should I open a support ticket?
In case of being expected, is there a page in the docs with all the reserved words?
Cheers

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 3d21a5c6-ae80-52d0-7d06-43191081b656
Version Independent ID: 799a41ab-2353-1bbc-8132-69eeb4678154
Content: Project operator - Azure Data Explorer
Content Source: data-explorer/kusto/query/projectoperator.md
Service: data-explorer
GitHub Login: @orspod
Microsoft Alias: orspodek

@rafamerlin Thank you for reaching out and bringing this to our notice. At this time we are reviewing the ask and will provide an update as appropriate

Hey @KranthiPakala-MSFT , I may have asked this question on the wrong place. I am having this issue on log analytics query. I didn't realise I was looking at the project operator on the Data Explorer instead. The query looks the same and testing it on the provided test environment in this docs page I could confirm it doesn't work:
https://dataexplorer.azure.com/clusters/help/databases/Samples
StormEvents
| where StartTime >= datetime(2007-11-01) and StartTime < datetime(2007-12-01)
| where State == "FLORIDA"
| project blocked = State

The difference from here and Log Analytics is that in here there's a squiggly line under the blocked when you type it and not on Log Analytics. I'll ask this on the Log Analytics page.


replay

So I think we either need a separate function from move_piece that moves the piece without updating stuff like castling and en passant rights, or we store the state of castling and en passant rights in the move_history so we can copy it when we undo/redo.


Dialog appears only after private key is imported

Steps:
Import a private key.
What happened:
The dialog "The keys were imported. It may take several minutes etc" appears only after the blockchain is scanned.
Expected result:
The dialog appears immediately upon the blockchain scan is started.

In 0.5.10


"Database is locked" when multiple threads and BeginTransaction (Sqlite)

When I call the method shown below from different threads (3 or more), I immediately get a "Database is locked" error:
Microsoft.Data.Sqlite.SqliteException (0x80004005): SQLite Error 5: 'database is locked'.
at Microsoft.Data.Sqlite.SqliteException.ThrowExceptionForRC(Int32 rc, sqlite3 db)
at Microsoft.Data.Sqlite.SqliteCommand.ExecuteReader(CommandBehavior behavior)
at Microsoft.Data.Sqlite.SqliteCommand.ExecuteDbDataReader(CommandBehavior behavior)
at System.Data.Common.DbCommand.ExecuteReader()
Steps to reproduce
Run the following method from 3 or more threads:
public void Run()
        {
            while (true)
            {
                var cs = "Data Source=sandbox.db";

                using (var con = new SqliteConnection(cs))
                {
                    con.Open();

                    using (var tr = con.BeginTransaction())
                    {
                        using (var cmd = con.CreateCommand())
                        {
                            cmd.CommandText = "SELECT Value FROM SandboxItems ORDER BY SandboxItemId DESC LIMIT 1";
                            var currentValue = Convert.ToInt32(cmd.ExecuteScalar());

                            currentValue++;

                            cmd.CommandText = $"INSERT INTO SandboxItems(Name, Value) VALUES ('Sandbox item {DateTime.Now:HH: mm: ss yyyy:MM: dd}', '{currentValue}')";

                            cmd.ExecuteNonQuery();
                        }

                        tr.Commit();
                    }

                    con.Close();
                }

                Thread.Sleep(150);
            }
        }

Further technical details
EF Core version: Microsoft.EntityFrameworkCore.Sqlite (2.0.0)
Database Provider: Microsoft.Data.Sqlite.Core (2.0.0)
Operating system: Windows 10 Pro
IDE: (Visual Studio 2017)

I posted it here because I encountered the problem first in EF Core with:
while (true)
{
var options = new DbContextOptionsBuilder();
            options.UseSqlite("Data Source=sandbox.db");

            using (var context = new SandboxContext(options.Options))
            {
                using (var transaction = context.Database.BeginTransaction())
                {

..

Does increasing the command timeout help? Or addingCache=Shared to the connection string?
Microsoft.Data.Sqlite should automatically retry when it encounters busy or locked errors.

Nope, when set to 30 secs it freezes exactly that long and then throws the error.
Thanks for investigating.

I'll debug further to try and understand the issue a little more.

Another quick thing you can try is the nightly builds. We've made a few fixes that might help this scenario.

Also seeing this in my project. Haven't tested nightly yet, but just as a confirmation: is it expected that EF will handle these scenarios and continue to retry within the CommandTimeout? ie. should I be looking into manually retrying in such scenarios or not?
Also it'd be great if you could reference the recent fix PR/commits that are related to this!

I am also seeing this issue when attempting to run some sort of scheduler e.g. Hangfire, Quartz.net
Did using the nightly builds help anyone?

Also seeing this in my setup. Did anyone find the solution or how to at least avoid it?

you can avoid by not using transactions... 💯

This is still broken on the lastest ef-core release (as tested here.
i'm not sure how a database engine can be useful without transactions.

I encounter this issue semi-regularly when using EF Core (i.e. I don't use transactions directly, just SaveChanges()) with Microsoft.Data.Sqlite v2.0.0. Will updating to 2.0.1 fix this?

@nickbelling This issue is tracked by aspnet/Microsoft.Data.Sqlite#474, which was fixed in the 2.0.1 version, but without a full repro its impossible to say whether this issue is the same as the issue you are seeing. You could try it, and if it still fails then file a new issue with full details.

Still got locked on current version(<PackageReference Include="Microsoft.EntityFrameworkCore.Sqlite" Version="2.1.4" />)

@seanmars Locking is a normal part of relational databases. You'll need to give us more information before we can determine whether you're hitting a bug in Microsoft.Data.Sqlite or EF Core or if your code is just encountering the natural limits of SQLite.

@seanmars from my experience SQLite is awful at concurrency, especially with multiple open connections.

@bricelam Hi, just run the code like @marcova84 which in the first post. Using the BeginTransaction to do something and the same time received other query.

The blocked query should automatically retry for the duration of CommandTimeout. If it can't acquire a lock in that time (possible with long-running queries or heavy traffic), it will throw with database is locked.
Unlike most database which lock specific rows, SQLite locks the entire database file making it poorly suited for heavy traffic.

@bricelam is there any issue with simply calling
SQLitePCL.raw.sqlite3_config(2 /*SQLITE_CONFIG_MULTITHREAD*/);
at startup? Assuming you're disposing your contexts right after using them, you shouldn't be breaking the underlying sqlite threading rules.
From my (somewhat limited) testing, I could spin up many reader/writer threads with no issue after setting that.
Running Core 2.2 with the latest release packages for EF/ASP/SqLite etc.

@cryolithic it would be useful to know whether you encountered the same issues in this thread before you set the config option.

@peppy yes, with more than a couple writer threads I quickly ran into "The database is locked" exceptions.

@cryolithic So you settingSQLitePCL.raw.sqlite3_config also affected the way EF utilizes the connection?

@tidusjar as far as I can tell, yes. Digging through the source for EF core and associated sqlite packages, I see nothing that will override the startup setting.
See option 2 https://sqlite.org/threadsafe.html

Great to know. Might be a step forward for EF to automatically set this mode.

@peppy I'd be happy with proper configuration options.

@tidusjar just clicked through your profile, I'm a big fan of Ombi!

Thanks man! Don't want to take this off topic, but send me a email!

@cryolithic How do you call this in your startup.cs?

SQLitePCL.raw.sqlite3_config(2 /SQLITE_CONFIG_MULTITHREAD/);

@cryolithic How do you call this in your startup.cs?

SQLitePCL.raw.sqlite3_config(2 /SQLITE_CONFIG_MULTITHREAD/);

@seriouz
Near the end of  Configure() in Startup.cs
		SQLitePCL.raw.sqlite3_config(2 /*SQLITE_CONFIG_MULTITHREAD*/);

Also, if you're not running the DB in WallMode, you'll want to change that.

@cryolithic When i use sqlite3_config function i get a null ref error:
Exception has occurred: CLR/System.NullReferenceException
An exception of type 'System.NullReferenceException' occurred in SQLitePCLRaw.core.dll but was not handled in user code: 'Object reference not set to an instance of an object.'
   at SQLitePCL.raw.sqlite3_config(Int32 op)

Do i have to pre configure something for SQLitePCL which EF Core then later uses?

In ConfigureServices I have
services.AddDbContext<MyDbContextClass>(options =>options.UseSqlite(Configuration.GetConnectionString("FileNameForDb")));
aside from that, at least in Asp.net 2.2.1 SQLitePCLRaw.bundle_green should come along with Microsoft.EntityFrameworkCore.Sqlite.
I run context.Database.Migrate() before calling the sqlite3_config as well, but iirc that wasn't required.


[backend-?] Different results of the same parquet data

Describe the bug
I create two tables from local parquet directories.  But they have different query results.
To Reproduce
scala> spark.sql(
     | """
     | CREATE TABLE IF NOT EXISTS  store_sales
     | (
     |    ss_sold_date_sk      INT,
     |        ss_sold_time_sk      INT,
     |          ss_item_sk           INT,
     |          ss_customer_sk       INT,
     |          ss_cdemo_sk          INT,
     |          ss_hdemo_sk          INT,
     |          ss_addr_sk           INT,
     |          ss_store_sk          INT,
     |          ss_promo_sk          INT,
     |          ss_ticket_number     LONG,
     |          ss_quantity          INT,
     |          ss_wholesale_cost     decimal(7,2),
     |          ss_list_price         decimal(7,2),
     |          ss_sales_price        decimal(7,2),
     |          ss_ext_discount_amt   decimal(7,2),
     |          ss_ext_sales_price    decimal(7,2),
     |          ss_ext_wholesale_cost decimal(7,2),
     |          ss_ext_list_price     decimal(7,2),
     |          ss_ext_tax            decimal(7,2),
     |          ss_coupon_amt         decimal(7,2),
     |          ss_net_paid           decimal(7,2),
     |          ss_net_paid_inc_tax   decimal(7,2),
     |          ss_net_profit         decimal(7,2)
     |
     | )
     | USING PARQUET
     | PARTITIONED BY (ss_sold_date_sk)
     | LOCATION '/data/tpcds-data-sf1/store_sales';
     | """
     | );

res0: org.apache.spark.sql.DataFrame = []

scala> spark.sql("select count(*) from store_sales  where ss_quantity between 1 and 20").collect()
res1: Array[org.apache.spark.sql.Row] = Array([0])

scala> spark.sql("""
     | CREATE TEMPORARY VIEW view_store_sales
     | USING org.apache.spark.sql.parquet
     | OPTIONS (
     |   path "/data/tpcds-data-sf1/store_sales/"
     | )
     | """
     | );
res2: org.apache.spark.sql.DataFrame = []

scala> spark.sql("select count(*) from view_store_sales  where ss_quantity between 1 and 20").collect()
res3: Array[org.apache.spark.sql.Row] = Array([550458])

Expected behavior
select count(*) from view_store_sales  where ss_quantity between 1 and 20 and select count(*) from store_sales  where ss_quantity between 1 and 20 should return the same result, which is 550458

Which backend are you using?

ClickHouse

I thought I found the reason.  CREATE TABLE IF NOT EXISTS  store_sales will not metadata of partitioned directories.


config_scANANSE doesnt accept contrasts in vector form

Good catch @Rebecza

contrasts_vector <- c('1_0', '1_2', '1_3',)
config_scANANSE(...,
additional_contrasts = contrasts_vector)

doesnt cause the additional contrasts to be added. This is due to a 'astype == list' check that isnt optimal
This issue is prevented by either supplying a list to the current version on CRAN (CRAN version 1.1.0):

contrasts_vector <- list('3_0', '3_0', '1_0', '0_1', '2_0', '0_2', '2_6', '6_2')
config_scANANSE(...,
additional_contrasts = contrasts_vector)

It however will be updated and will also accept vectors.
These fixes will be incorporated in the next CRAN release

fixed in #8a04b0a


[cluster-test] Make wait_healthy timeouts more nuanced

Default startup timeout is reduced back to 5 minutes - this is how long normal start takes, and increasing it just wastes more time when startup fails

wait_healthy after the experiment now takes deadline from experiment deadline. This should be sufficient for 10% down experiment, and if not, we will increase timeout of this specific experiment, but not everywhere

Do we need to extend deadline for 10% down since it is already addressed timeout?

@bors-libra delegate+

:v: @andll can now approve this pull request

Good point.

@bors-libra r=snakech

:pushpin: Commit f0d481a has been approved by snakech

@bors-libra r=snakech

:bulb: This pull request was already approved, no need to approve it again.

There's another pull request that is currently being tested, blocking this pull request: #4672

:pushpin: Commit f0d481a has been approved by snakech

:hourglass: Testing commit f0d481a56f39891ba98b8f96edc684e52fceaff1 with merge 5833a29cefa1362f29ff6af7a9ab167c021aa4c2...

:sunny: Test successful - checks-actions_land_blocking_test, checks-circle_commit_workflow
Approved by: snakech
Pushing 5833a29cefa1362f29ff6af7a9ab167c021aa4c2 to master...


Should BACKGROUND_EVICTION_INTERVAL be of type Option

https://github.com/r2dbc/r2dbc-pool/blob/dae00e57f5509a7fea769df6ea116fd85a4c990b/src/main/java/io/r2dbc/pool/PoolingConnectionFactoryProvider.java#L60
I'm unable to set BACKGROUND_EVICTION_INTERVAL via ConnectionFactoryOptions.builder().option(PoolingConnectionFactoryProvider.BACKGROUND_EVICTION_INTERVAL,XXXX)
Seem like XXXX can only be Integer and internally, it requires it to be either String or Duration. Am I missing something?

Good catch, do you want to submit a pull request to fix that issue?


Migrate from npm to Yarn

Yarn is a new package manager for node.js packages created by Facebook that solves the many problems of npm dependency management and deployment:
https://code.facebook.com/posts/1840075619545360

Travis CI does not yet include yarn in its build image. They auto-install it if there is a yarn.lock in the root, which this project does not have/use (there would be two yarn.lock files in the client and server directories)... so the option is to install yarn manually in the .travis.yml file.
Yarn will be included in the build image at some point and manual installing won't be necessary.

Fixed in 4b8a352d7df5b45a995985c8b6b8fe69ec9f006b


BrightSign Support

If you don’t know already, BrightScript is also designed for, and originally designed for  Roku’s BrightSign ( a digital signage system ), hence its name, and they later branched out into their own company and added features like HTML5 and interactivity. Sample code is available, however I recommend you implement the legacy BrightSign sample code and work your way up.
https://www.brightsign.biz/
https://web.archive.org/web/2007/rokulabs.com
https://www.brightsign.biz/downloads/overview

I have worked with BrightSign briefly on my previous job, but I basically used their windows client, not actually programming in BrightScript. Will see how far the implementations are at this moment.

I have worked with BrightSign briefly on my previous job, but I basically used their windows client, not actually programming in BrightScript. Will see how far the implementations are at this moment.

https://www.brightsign.biz/resources/demos/

At the very least just add support to the first sample scripts.
https://web.archive.org/web/20080107111812/http://www.rokulabs.com/support/brightsign/download.php

Basic support for Brighsigns would be great. However, a lot of Brightsign stuff depends on hardware connected to the device, so may need to be emulated.
Hadn't even heard of Roku until I started developing Brightsign applications.

https://docs.brightsign.biz/space/DOC/370672721/Language+Reference

First add support for those first scripts from 2008 as a demo


Allwinner v831 too low confidence on image classification when running resnet18

While working on resnet18, I found some interesting issues.

I custom trained resnet18 using transfer learning techniques for 10 classes. Then tested on my laptop using webcam (webcam is the same as on maix-ii dock board) and it showed good results. If I point webcam at a person, it results "people: 99.9%". Shows max confidence up to 100%.

Then, I converted this model to awnn form and uploaded to allwinner v831. Here is interesting - percentage of confidence was only between 15 - 45% no matter on what object (no threshold set, but anyway starts at around 15%). I tried to change focus of camera, bring the objects closer or further from camera, even showed images, on which the model was trained - it showed only this small range of confidence. But, on laptop, it was showing up to 100% confidence. Exact model, but converted to awnn showed much lower confidence.

Also, I looked at first 5 most confidence scores, first 2-3 objects were showing exact same percentage of confidence (e.g. airplane: 23.45%, car 23.45%, buildings 23.45%, road 3%, pheasant 0.23%). This is so weird, it must not show exactly the same confidence on any of objects.

I tried the model that was provided by allwinner (I run python app.py on therminal)  ---  just in rare cases it reached up to 70% confidence, but frequently ranged between 10 - 50% (10% threshold).

I could not find any reason for such behavior of resnet18 on allwinner v831, but I am thinking now is - a) either there are some bugs on converter pytorch - awnn   OR    b) there are bugs on libraries   OR    c) hardware performance
P.S. I attached link to videos and codes to make my words clearer.  https://drive.google.com/drive/folders/17eKPOSqrP54RyBei_gemIOxNq8uV38Uo?usp=sharing
P.S. P.S. if you open sample_output folder, you can see all images of detected "airplanes". But, if you open "airplane.txt" file, you will see first 5 confidence scores of each image. Images are named: class + time + ".jpg". Each row of "airplane.txt" file is
named: time + date + confidence scores. Each row has its corresponding image (match them by time).

It's turned out that when you convert ncnn files to awnn using sipeed's website, part of dataset must be included in folder 'image' together with ncnn files. I thought that 'image' file is not so important, but in fact it is.


GPU Doesn't Work

Hi,
Hope you are doing Good.
Inspite of all the GPU Installations, still it occupies full 100% CPU.
Can you pls assist on this...
Thank You

Hi. In settings page you can see option change gpu on cpu or back. Can you check that gpu is active?
Also, GPU work for modules, but tasks as Segment Objects for frontend, Analysis content on fake, will be work only on CPU, if you use this.

Hi. In settings page you can see option change gpu on cpu or back. Can you check that gpu is active?
Also, GPU work for modules, but tasks as Segment Objects for frontend, Analysis content on fake, will be work only on CPU, if you use this.

Thanks. Can you pls check the attachment.

Thank You

You need to click on "Which processor I need to use?".

Also, I see what you use Pro Wunjo. Can you open restyle or you see message what gpu is not access for computer?

I checked restyle It occupies 100% full CPU

You need to click on "Which processor I need to use?".

I clicked here. Here It states (In GPU mode, models are executed using the GPU for enhanced performance. If you wish to give the machine a break, you can transfer the models back to the CPU by clicking here. Remember, you can only switch processors when there is no active processing.)
Now what to do next...

If the restyle operation was successful, it proves that the GPU is functioning, as there is a module that does not work on the CPU. It is important to note that working on the GPU accelerates processing several times but does not fully occupy your GPU processor, and does not relieve the CPU processor of its duties. Since there are simple operations like video cropping and frame saving, all of this is done using OpenCV and ffmpeg, which utilize the CPU and this can be 100%.

Thanks, but I was using Faceswap even here also CPU occupied was 100% & GPU was 0.3%

It's similar there.  Absolutely all modules do not store many frames in RAM, but save from and load when necessary.  This approach allowed people who have little RAM to use the application and work with very long videos.  By the way, I recommend studying the settings, there are many parameters that you can customize for yourself, for example, to work with a large number of tasks, adjusting memory, video duration, etc.

OK, Thanks & Sorry for bothering you


Add hiob 0.1.5 to stable

Please update my adapter ioBroker.hiob to version 0.1.5.
This pull request was created by https://www.iobroker.dev c0726ff.

RE-CHECK!

Your Adapter has been added to stable repository. If you like you can extend the news message here:
https://github.com/ioBroker/ioBroker.docs/blob/master/docs/en/history/history.md
If you add some more information / description, please consider to add this information to README.md too.
If you have any questions related to the news file, please contact @Apollon77 for further information.
Please note, that the PR announcing the new adapter at stable might not be merged.
https://github.com/ioBroker/ioBroker.docs/pull/


getJWT throws an error

I'm using the current master version and nextjs 9.4.4. I tried to use getJwt method as described in the documentation and got an error that can't get '__Secure-next-auth.session-token' of undefined. During the investigation I found a bug that in the source code:
const getJwt = async ({ req, secret, cookieName }) => {
  if (!req || !secret) throw new Error("Must pass { req, secret } to getJWT()");
  const secureCookieName = "__Secure-next-auth.session-token";
  const insecureCookieName = "next-auth.session-token";
  const cookieValue = cookieName
    ? req.cookies[cookieName]
    : req.cookies[insecureCookieName];

  if (!cookieValue) {
    return null;
  }

req.cookies used however cookies stored in req.headers.cookie object

The function req.cookies middleware is built-in to Next.js and is also is used internally by NextAuth.js. If the getJwt() function isn't working it would be helpful to provide an example of how you are using it.

I've just checked the source and that source code above doesn't match the source of the getJwt() method in master, or any version of it from source control so I'm not sure where it comes from.
This is the only version of the getJwt() function in the history for the master branch:
const getJwt = async ({ req, secret, cookieName }) => {
  if (!req || !secret) throw new Error('Must pass { req, secret } to getJWT()')

  const secureCookieName = '__Secure-next-auth.session-token'
  const insecureCookieName = 'next-auth.session-token'
  const cookieValue = cookieName ? req.cookies[cookieName] : req.cookies[secureCookieName] || req.cookies[insecureCookieName]

  if (!cookieValue) { return null }

  try {
    return await decode({ secret, token: cookieValue })
  } catch (error) {
    return null
  }
}

The the live demo at next-auth-example.now.sh has been updated to use this method as a practical example of how to implement the usage as shown in the documentation.
Once signed in, you can view the decrypted JWT for your session here:
next-auth-example.now.sh/api/jwt-example
You view the source for this route at next-auth-example/api/jwt-example.js

@iaincollins thank you for the answer. My mistake was that I tried to use it within getServerSideProps just to check how does it work and what is the result in return. Now I understand that it works only within API routes where cookies middleware exists.


Error handling for config fetcher

This PR adds changes to error handling in the config fetcher module and a note related to #73.

CI failing due to CVE: https://github.com/chronotope/chrono/issues/499

bors r+

@unleashed I don't have privileged to merge this for now.

bors r+


Support #![feature(extended_key_value_attributes)]

Tracking issue: https://github.com/rust-lang/rust/issues/78835. I hope to replace doc(include) with this, and it would be nice for it to have IDE support.

Tangentially related: this has pretty bad error recovery in the parser, maybe it could be improved somehow?

Parsing implemented in #8097, given #8092 I think this can be closed


Test5a

8+ of the tests from issue #3 have been fixed.
Compact Blocks functionality restored.  It was partially removed during the removal of segwit.
Compact Blocks version 1 is presegwit.  version 2 is for segwit.
Version 1 was restored using Bitcoin-ABC as a guide.

All tests are fixed on my machine.  Lets see if it passes here.

Bitcoin 0.14 appears to the be same as Litecoin 0.14 for the travis tests, which is the same as my latest commit:.  On the windows build, the -win parameter is missing and therefore those qa/pull-tester/rpc-tests.py are not run.
Bitcoin 0.15 is a different story.  The testing system was changed.  The qa folder is not present, but those RPC tests are elsewhere.
On Bitcoin 0.15, the zmq_test (which would fail on the Travis system currently under windows) will check to see if the zmq library is available.  And if it is not, then that test is skipped.  https://github.com/bitcoin/bitcoin/blob/0.15/test/functional/zmq_test.py#L23


Introduce semantic-release, release automation with lerna

This looks promising!
https://github.com/atlassian/lerna-semantic-release
Would be good to re-enable automated releases while supporting an independent versioning scheme. This seems most readily achievable using a commit message convention and tooling that intelligently knows how to version the underlying packages based on their changes. Lerna already knows which packages changed, but this will tell it ideally whether to bump patch, minor or major releases.
Another question - will we be able to continue tagging releases with an independently versioned monorepo?

as per discussion with @benjie in discord, we are going to suggest using lerna's built in conventional git options (changelog, release, version resolution for independent lerna monorepos, etc) at the working group tomorrow

We are making this happen in #948!


Add support for amqpnetlite

Add support for azure amqp net lite library, which theoretically implement amqp 1.0 generically (should work also with rabbitmq). https://github.com/Azure/amqpnetlite

closing as already referenced in #2


Downloads from Oracle failing again

Just ran a periodic build for one of my roles and it seems it's failing when attempting to download a JRE:
https://travis-ci.org/lae/ansible-role-elasticsearch/jobs/289276963#L4473
I didn't get much time to look at it but it looks like Oracle may have changed something with regards to fetching the JRE? 8u144 seems to still be the most recent JRE 8 version (though I guess it might make sense to change the default to JRE 9 maybe).

https://github.com/William-Yeh/ansible-oracle-java/issues/62#issuecomment-336179446 might be relevant

My deployment was also blocked by this issue. I made small investigation. Here are the results:
It happened because Oracle release new update of Java 8 including some security fixes. The previous version was deprecated. Check details here:
http://www.oracle.com/technetwork/java/javase/8u152-relnotes-3850503.html
http://www.oracle.com/technetwork/java/javase/8u151-relnotes-3850493.html
I solved the issue by specifying the following variables:
java_version: 8
java_subversion: 152
java_build: 16
jdk_tarball_hash: aa0333dd3019491ca4f6ddbe78cdb6d0

If you want 151 subversion, find appropriate values for build and tarball hash here:
http://www.oracle.com/technetwork/java/javase/downloads/jdk8-downloads-2133151.html

Ah okay, so it was just an update. My coworker must have been looking at the wrong thing (it looked like the latest was still 8u144). Anyway, looks like you opened #3 so 👍

That's interesting. 8u141 still seems to work. Normally Oracle does not pull the old versions, but 8u144 is gone. So 8u152 seems like a reasonable default now.
I would not make Java 9 the default, because that might break a few things. Most projects I tried to build with Java 9 did not work out of the box because of the changes Jigsaw introduced. That does not mean Java 9 will never be the default, but I think it makes sense to wait a bit.

Fixed with #3 thanks to @yuppie-flu


add versionfrombuild command

This gives a CLI command for getting the version of a node from its build.xml file. The name of the command isn't final; it looks kind of gross int the top-level usage statement:
$ ccm
Missing arguments
Usage:
  ccm <cluster_cmd> [options]
  ccm <node_name> <node_cmd> [options]

Where <cluster_cmd> is one of
  create         Create a new cluster
  add            Add a new node to the current cluster
[...]
or <node_name> is the name of a node of the current cluster and <node_cmd> is one of
[...]
  pause          Send a SIGSTOP to this node
  resume         Send a SIGCONT to this node
  jconsole       Opens jconsole client and connect to running node
  versionfrombuild Print the node's version as grepped from build.xml. Can be used when the node isn't running.

See that last line -- the command name spills over. Don't know if the name of the command should change, if the logic for displaying commands should change, or if we care at all.
But, this could reduce duplication -- we do this in bash in the dtests on CassCI.

I don't really like the name, but it's fine. I would also like if, when the node is up, if we can compare the result of grepping the build.xml, with the output of nodetool version, to see if they match, and warn if not.

I don't really like the name, but it's fine.

Samesies.

I would also like if, when the node is up, if we can compare the result of grepping the build.xml, with the output of nodetool version, to see if they match, and warn if not.

Where should that logic live? I'd vote Node.get_cassandra_version, maybe disabled by default and enabled with a kwarg.

Just put it in the run method?

Yeah, that's simplest thing to do; thanks. Ready for another review.

+1


Add link back to site from admin area

Right now the only way back is to click on "photic" in the header. There should also be a navigation control in the admin area to go back to annotating.

@joefutrelle
Does "home" work as text for a link? Or can we do something better like "Search", "Filter" or "Annotate"? Obviously something that will describe what that main page does


[release-1.5] Fix API calls for token exchange

This is an automated cherry-pick of #20753

I'm approving and expecting further PR to address the naming thing.

@istio-testing: The following test failed, say /retest to rerun all failed tests:

Test name
Commit
Details
Rerun command

gencheck_istio_release-1.5
406390fc3136c092e24317109ecb83eb5f11d3d1
link
/test gencheck_istio_release-1.5

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

/test gencheck_istio_release-1.5

@istio-testing: The following test failed, say /retest to rerun all failed tests:

Test name
Commit
Details
Rerun command

gencheck_istio_release-1.5
406390fc3136c092e24317109ecb83eb5f11d3d1
link
/test gencheck_istio_release-1.5

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@istio-testing: The following test failed, say /retest to rerun all failed tests:

Test name
Commit
Details
Rerun command

gencheck_istio_release-1.5
9d77206602d424bc6b83d7b7e221177d3d23b205
link
/test gencheck_istio_release-1.5

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@istio-testing: The following test failed, say /retest to rerun all failed tests:

Test name
Commit
Details
Rerun command

integ-conformance-local-tests_istio_release-1.5
b955803cf33b5eadd261e207031456d0027ddfb6
link
/test integ-conformance-local-tests_istio_release-1.5

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@istio-testing: The following tests failed, say /retest to rerun all failed tests:

Test name
Commit
Details
Rerun command

integ-conformance-local-tests_istio_release-1.5
b955803cf33b5eadd261e207031456d0027ddfb6
link
/test integ-conformance-local-tests_istio_release-1.5

integ-conformance-k8s-tests_istio_release-1.5
b955803cf33b5eadd261e207031456d0027ddfb6
link
/test integ-conformance-k8s-tests_istio_release-1.5

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

/retest

@istio-testing: The following tests failed, say /retest to rerun all failed tests:

Test name
Commit
Details
Rerun command

integ-conformance-k8s-tests_istio_release-1.5
b955803cf33b5eadd261e207031456d0027ddfb6
link
/test integ-conformance-k8s-tests_istio_release-1.5

integ-conformance-local-tests_istio_release-1.5
b955803cf33b5eadd261e207031456d0027ddfb6
link
/test integ-conformance-local-tests_istio_release-1.5

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@istio-testing: The following tests failed, say /retest to rerun all failed tests:

Test name
Commit
Details
Rerun command

integ-conformance-local-tests_istio_release-1.5
b955803cf33b5eadd261e207031456d0027ddfb6
link
/test integ-conformance-local-tests_istio_release-1.5

integ-conformance-k8s-tests_istio_release-1.5
b955803cf33b5eadd261e207031456d0027ddfb6
link
/test integ-conformance-k8s-tests_istio_release-1.5

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

/retest

@istio-testing: The following tests failed, say /retest to rerun all failed tests:

Test name
Commit
Details
Rerun command

integ-conformance-k8s-tests_istio_release-1.5
b955803cf33b5eadd261e207031456d0027ddfb6
link
/test integ-conformance-k8s-tests_istio_release-1.5

integ-conformance-local-tests_istio_release-1.5
b955803cf33b5eadd261e207031456d0027ddfb6
link
/test integ-conformance-local-tests_istio_release-1.5

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@istio-testing: The following tests failed, say /retest to rerun all failed tests:

Test name
Commit
Details
Rerun command

integ-conformance-local-tests_istio_release-1.5
b955803cf33b5eadd261e207031456d0027ddfb6
link
/test integ-conformance-local-tests_istio_release-1.5

integ-conformance-k8s-tests_istio_release-1.5
b955803cf33b5eadd261e207031456d0027ddfb6
link
/test integ-conformance-k8s-tests_istio_release-1.5

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

I am closing this PR in favor of https://github.com/istio/istio/pull/20852


how to use for ejs template?

exports.index = function(req, res){
res.render('index', { title: 'Welcome' , slides: req.i18n.__('slides') });
};

<%= slides %>

"express": "3.1.0"
I get this error 500 TypeError: Cannot call method '__' of undefined

Why closed? It is not resolved.

It's closed because the solution was given : there was a missing i18n.expressBind() which must be called. See https://github.com/jeresig/i18n-node-2#using-with-expressjs for more informations


.bash-profile

I'm trying to use shell to run ruby and rails command (using rbenv on Mac) but the .bash_profile is probably not loaded when your plugin is activated.
I have tried to loaded manually using "source ~/.bash_profile" but it's not working.  Any clue on how to make it work?
Thanks

Since the last posted question doesn't have an answer and I'm fighting with the same problem I decided to contribute some observations. Manually sourcing the file does not produce errors. To try and get further I decided to manually export a variable to see if it persisted.
This is what the environment looks like after opening the shell:
SHELL=/bin/bash
TMPDIR=
USER=
SSH_AUTH_SOCK=<>
PATH=/usr/bin:/bin:/usr/sbin:/sbin
PWD=
SHLVL=1
HOME=/Users/
LOGNAME=
DISPLAY=
_=/usr/bin/env
What I did:
export PKG_CONFIG_PATH=/usr/X11/lib/pkgconfig
I was expecting to see this variable in the environment but executing env gave me back the same as above.
Afterwards I double checked the settings for bash and the shell that was running was in fact bash using the pid.
Interesting problem. I would love to get this resolved as it would speed up my work since I could run tests from within the editor.

I'm experiencing this exact same problem, I can run my local/bin commands manually - but that's cumbersome. I can't seem to add any new paths to the $PATH environment. I'll keep working on this, but I thought I'd let everyone know it doesn't work no matter which shell you're using "sh" or "bash."

Same problem here with MacOS X Yosemite. Used the shell under Windows very often and was very satisfied with it. But under MacOS it is not usable, since the correct paths are not loaded from ~/.profile

Was having the same issue on OS X but was able to fix it...
What I did:

Changed to config use "/bin/bash"
After running echo $PATH in the shell window, it showed it was using "BASH RC"
Added "/usr/local/bin" to ~/.bashrc path

Same as esko -- this works fine now.

Same as esko -- and thanks!
I added export PATH=/usr/local/bin:$PATH to ~/.bashrc, and brackets-shell works fine!


[89/ab2821] NOTE: Process map_parse_sort_chunks (library:your_library_name_1 run:lane1 chunk:0) terminated with an error exit status (127) -- Execution is retried (1)

Hi,
Distiller is very interesting for my research, so thank you. However, I stumble upon a weird problem upon running it (cf title). Could someone help me please?
Here is the line I enter in my nextflow repository: $ nextflow run distiller.nf -params-file project.yml
And here is the full message:
N E X T F L O W  ~  version 20.01.0
Launching distiller.nf [gigantic_mercator] - revision: 4b2ff8d377
executor >  local (3)
[-        ] process > download_truncate_chunk_fastqs    -
executor >  local (3)
[-        ] process > download_truncate_chunk_fastqs    -
[-        ] process > local_truncate_chunk_fastqs       -
[-        ] process > fastqc                            -
[25/b975c5] process > map_parse_sort_chunks             [ 67%] 2 of 3, failed: 2, retries: 2
[-        ] process > merge_dedup_splitbam              -
[-        ] process > bin_zoom_library_pairs            -
[-        ] process > merge_zoom_library_group_coolers  -
[-        ] process > merge_stats_libraries_into_groups -
[89/ab2821] NOTE: Process map_parse_sort_chunks (library:your_library_name_1 run:lane1 chunk:0) terminated with an error exit status (127) -- Execution is retried (1)
[aa/2fc4a3] NOTE: Process map_parse_sort_chunks (library:your_library_name_1 run:lane1 chunk:0) terminated with an error exit status (127) -- Execution is retried (2)
Error executing process > 'map_parse_sort_chunks (library:your_library_name_1 run:lane1 chunk:0)'
executor >  local (3)
[-        ] process > download_truncate_chunk_fastqs    -
[-        ] process > local_truncate_chunk_fastqs       -
[-        ] process > fastqc                            -
[25/b975c5] process > map_parse_sort_chunks             [100%] 3 of 3, failed: 3, retries: 2 ✘
[-        ] process > merge_dedup_splitbam              -
[-        ] process > bin_zoom_library_pairs            -
[-        ] process > merge_zoom_library_group_coolers  -
[-        ] process > merge_stats_libraries_into_groups -
[89/ab2821] NOTE: Process map_parse_sort_chunks (library:your_library_name_1 run:lane1 chunk:0) terminated with an error exit status (127) -- Execution is retried (1)
[aa/2fc4a3] NOTE: Process map_parse_sort_chunks (library:your_library_name_1 run:lane1 chunk:0) terminated with an error exit status (127) -- Execution is retried (2)
Error executing process > 'map_parse_sort_chunks (library:your_library_name_1 run:lane1 chunk:0)'
executor >  local (3)
[-        ] process > download_truncate_chunk_fastqs    -
[-        ] process > local_truncate_chunk_fastqs       -
[-        ] process > fastqc                            -
[25/b975c5] process > map_parse_sort_chunks             [100%] 3 of 3, failed: 3, retries: 2 ✘
[-        ] process > merge_dedup_splitbam              -
[-        ] process > bin_zoom_library_pairs            -
[-        ] process > merge_zoom_library_group_coolers  -
[-        ] process > merge_stats_libraries_into_groups -
[89/ab2821] NOTE: Process map_parse_sort_chunks (library:your_library_name_1 run:lane1 chunk:0) terminated with an error exit status (127) -- Execution is retried (1)
[aa/2fc4a3] NOTE: Process map_parse_sort_chunks (library:your_library_name_1 run:lane1 chunk:0) terminated with an error exit status (127) -- Execution is retried (2)
Error executing process > 'map_parse_sort_chunks (library:your_library_name_1 run:lane1 chunk:0)'
Caused by:
Process map_parse_sort_chunks (library:your_library_name_1 run:lane1 chunk:0) terminated with an error exit status (127)
Command executed:
TASK_TMP_DIR=$(mktemp -d -p ./ distiller.tmp.XXXXXXXXXX)
touch your_library_name_1.lane1.hg38.0.bam
bwa mem -t 8  -SP hg38_reference.fasta SRR027958_1.fastq.gz SRR027958_2.fastq.gz         | tee >(samtools view -bS > your_library_name_1.lane1.hg38.0.bam)         | pairtools parse  --drop-readid              --add-columns mapq             -c hg38_chrom_sizes.txt             | pairtools sort --nproc 8                              -o your_library_name_1.lane1.hg38.0.pairsam.gz                              --tmpdir $TASK_TMP_DIR             | cat
rm -rf $TASK_TMP_DIR
Command exit status:
127
Command output:
(empty)
Command error:
.command.run: line 259: docker: command not found
Work dir:
/home/biophymember/Projets/HiC_premiere_analyse/essai_nextflow/work/25/b975c5500ab3a684c907871e216052
Tip: you can try to figure out what's wrong by changing to the process work dir and showing the script file named .command.sh
I don't know where the file '.command.sh' is. Here is the content of my folder:
(base)biophymember@rddm503nc:~/Projets/HiC_premiere_analyse/essai_nextflow$ ls bin
configs       docker           LICENSE          pipeline_info  README.md          test     work CHANGES.md distiller.nf  environment.yml  nextflow.config  project.yml sorted_chromsizes  VERSION

Hi!
(1) the command file mentioned by nextflow can be found in the work folder
(i.e. a temporary folder created for execution of this specific task). In
your case, it must be /home/biophymember/Projets/HiC_premiere_analyse/essai_
nextflow/work/25/b975c5500ab3a684c907871e216052 , as mentioned in the bug
report.
(2) looks like you may not have working docker on your computer, is that
right?
Anton.
On Fri, Feb 21, 2020, 16:46 gopel<EMAIL_ADDRESS>wrote:

Hi,
Distiller is very interesting for my research, so thank you. However, I
stumble upon a weird problem upon running it (cf title). Could someone help
me please?
Here is the line I enter in my nextflow repository: $ nextflow run
distiller.nf -params-file project.yml
And here is the full message:
N E X T F L O W ~ version 20.01.0
Launching distiller.nf [gigantic_mercator] - revision: 4b2ff8d377
executor > local (3)
[- ] process > download_truncate_chunk_fastqs -
executor > local (3)
[- ] process > download_truncate_chunk_fastqs -
[- ] process > local_truncate_chunk_fastqs -
[- ] process > fastqc -
[25/b975c5] process > map_parse_sort_chunks [ 67%] 2 of 3, failed: 2,
retries: 2
[- ] process > merge_dedup_splitbam -
[- ] process > bin_zoom_library_pairs -
[- ] process > merge_zoom_library_group_coolers -
[- ] process > merge_stats_libraries_into_groups -
[89/ab2821] NOTE: Process map_parse_sort_chunks
(library:your_library_name_1 run:lane1 chunk:0) terminated with an error
exit status (127) -- Execution is retried (1)
[aa/2fc4a3] NOTE: Process map_parse_sort_chunks
(library:your_library_name_1 run:lane1 chunk:0) terminated with an error
exit status (127) -- Execution is retried (2)
Error executing process > 'map_parse_sort_chunks
(library:your_library_name_1 run:lane1 chunk:0)'
executor > local (3)
[- ] process > download_truncate_chunk_fastqs -
[- ] process > local_truncate_chunk_fastqs -
[- ] process > fastqc -
[25/b975c5] process > map_parse_sort_chunks [100%] 3 of 3, failed: 3,
retries: 2 ✘
[- ] process > merge_dedup_splitbam -
[- ] process > bin_zoom_library_pairs -
[- ] process > merge_zoom_library_group_coolers -
[- ] process > merge_stats_libraries_into_groups -
[89/ab2821] NOTE: Process map_parse_sort_chunks
(library:your_library_name_1 run:lane1 chunk:0) terminated with an error
exit status (127) -- Execution is retried (1)
[aa/2fc4a3] NOTE: Process map_parse_sort_chunks
(library:your_library_name_1 run:lane1 chunk:0) terminated with an error
exit status (127) -- Execution is retried (2)
Error executing process > 'map_parse_sort_chunks
(library:your_library_name_1 run:lane1 chunk:0)'
executor > local (3)
[- ] process > download_truncate_chunk_fastqs -
[- ] process > local_truncate_chunk_fastqs -
[- ] process > fastqc -
[25/b975c5] process > map_parse_sort_chunks [100%] 3 of 3, failed: 3,
retries: 2 ✘
[- ] process > merge_dedup_splitbam -
[- ] process > bin_zoom_library_pairs -
[- ] process > merge_zoom_library_group_coolers -
[- ] process > merge_stats_libraries_into_groups -
[89/ab2821] NOTE: Process map_parse_sort_chunks
(library:your_library_name_1 run:lane1 chunk:0) terminated with an error
exit status (127) -- Execution is retried (1)
[aa/2fc4a3] NOTE: Process map_parse_sort_chunks
(library:your_library_name_1 run:lane1 chunk:0) terminated with an error
exit status (127) -- Execution is retried (2)
Error executing process > 'map_parse_sort_chunks
(library:your_library_name_1 run:lane1 chunk:0)'
Caused by:
Process map_parse_sort_chunks (library:your_library_name_1 run:lane1
chunk:0) terminated with an error exit status (127)
Command executed:
TASK_TMP_DIR=$(mktemp -d -p ./ distiller.tmp.XXXXXXXXXX)
touch your_library_name_1.lane1.hg38.0.bam
bwa mem -t 8 -SP hg38_reference.fasta SRR027958_1.fastq.gz
SRR027958_2.fastq.gz | tee >(samtools view -bS >
your_library_name_1.lane1.hg38.0.bam) | pairtools parse --drop-readid
--add-columns mapq -c hg38_chrom_sizes.txt | pairtools sort --nproc 8 -o
your_library_name_1.lane1.hg38.0.pairsam.gz --tmpdir $TASK_TMP_DIR | cat
rm -rf $TASK_TMP_DIR
Command exit status:
127
Command output:
(empty)
Command error:
.command.run: line 259: docker: command not found
Work dir:
/home/biophymember/Projets/HiC_premiere_analyse/essai_nextflow/work/25/b975c5500ab3a684c907871e216052
Tip: you can try to figure out what's wrong by changing to the process
work dir and showing the script file named .command.sh
I don't know where the file '.command.sh' is. Here is the content of my
folder:
(base)biophymember@rddm503nc:~/Projets/HiC_premiere_analyse/essai_nextflow$
ls bin
configs docker LICENSE pipeline_info README.md test work CHANGES.md
distiller.nf environment.yml nextflow.config project.yml
sorted_chromsizes VERSION
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/mirnylab/distiller-nf/issues/149?email_source=notifications&email_token=AAG64CX42XDLJNQENFBCRTLRD7ZPBA5CNFSM4KZFP3Z2YY3PNVWWK3TUL52HS4DFUVEXG43VMWVGG33NNVSW45C7NFSM4IPKYEEA,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAG64CXN3OLVSHG7DHMJCFLRD7ZPBANCNFSM4KZFP3ZQ
.

Hi,
I don’t have Docker, I did not understand it was necessary. I’ll retry on Monday.
Thank you for your help.
Best regards,
Yanis Bendjelal

Le 22 févr. 2020 à 18:06, Anton Goloborodko<EMAIL_ADDRESS>a écrit :
Hi!
(1) the command file mentioned by nextflow can be found in the work folder
(i.e. a temporary folder created for execution of this specific task). In
your case, it must be /home/biophymember/Projets/HiC_premiere_analyse/essai_
nextflow/work/25/b975c5500ab3a684c907871e216052 , as mentioned in the bug
report.
(2) looks like you may not have working docker on your computer, is that
right?
Anton.
On Fri, Feb 21, 2020, 16:46 gopel<EMAIL_ADDRESS>wrote:

Hi,
Distiller is very interesting for my research, so thank you. However, I
stumble upon a weird problem upon running it (cf title). Could someone help
me please?
Here is the line I enter in my nextflow repository: $ nextflow run
distiller.nf -params-file project.yml
And here is the full message:
N E X T F L O W ~ version 20.01.0
Launching distiller.nf [gigantic_mercator] - revision: 4b2ff8d377
executor > local (3)
[- ] process > download_truncate_chunk_fastqs -
executor > local (3)
[- ] process > download_truncate_chunk_fastqs -
[- ] process > local_truncate_chunk_fastqs -
[- ] process > fastqc -
[25/b975c5] process > map_parse_sort_chunks [ 67%] 2 of 3, failed: 2,
retries: 2
[- ] process > merge_dedup_splitbam -
[- ] process > bin_zoom_library_pairs -
[- ] process > merge_zoom_library_group_coolers -
[- ] process > merge_stats_libraries_into_groups -
[89/ab2821] NOTE: Process map_parse_sort_chunks
(library:your_library_name_1 run:lane1 chunk:0) terminated with an error
exit status (127) -- Execution is retried (1)
[aa/2fc4a3] NOTE: Process map_parse_sort_chunks
(library:your_library_name_1 run:lane1 chunk:0) terminated with an error
exit status (127) -- Execution is retried (2)
Error executing process > 'map_parse_sort_chunks
(library:your_library_name_1 run:lane1 chunk:0)'
executor > local (3)
[- ] process > download_truncate_chunk_fastqs -
[- ] process > local_truncate_chunk_fastqs -
[- ] process > fastqc -
[25/b975c5] process > map_parse_sort_chunks [100%] 3 of 3, failed: 3,
retries: 2 ✘
[- ] process > merge_dedup_splitbam -
[- ] process > bin_zoom_library_pairs -
[- ] process > merge_zoom_library_group_coolers -
[- ] process > merge_stats_libraries_into_groups -
[89/ab2821] NOTE: Process map_parse_sort_chunks
(library:your_library_name_1 run:lane1 chunk:0) terminated with an error
exit status (127) -- Execution is retried (1)
[aa/2fc4a3] NOTE: Process map_parse_sort_chunks
(library:your_library_name_1 run:lane1 chunk:0) terminated with an error
exit status (127) -- Execution is retried (2)
Error executing process > 'map_parse_sort_chunks
(library:your_library_name_1 run:lane1 chunk:0)'
executor > local (3)
[- ] process > download_truncate_chunk_fastqs -
[- ] process > local_truncate_chunk_fastqs -
[- ] process > fastqc -
[25/b975c5] process > map_parse_sort_chunks [100%] 3 of 3, failed: 3,
retries: 2 ✘
[- ] process > merge_dedup_splitbam -
[- ] process > bin_zoom_library_pairs -
[- ] process > merge_zoom_library_group_coolers -
[- ] process > merge_stats_libraries_into_groups -
[89/ab2821] NOTE: Process map_parse_sort_chunks
(library:your_library_name_1 run:lane1 chunk:0) terminated with an error
exit status (127) -- Execution is retried (1)
[aa/2fc4a3] NOTE: Process map_parse_sort_chunks
(library:your_library_name_1 run:lane1 chunk:0) terminated with an error
exit status (127) -- Execution is retried (2)
Error executing process > 'map_parse_sort_chunks
(library:your_library_name_1 run:lane1 chunk:0)'
Caused by:
Process map_parse_sort_chunks (library:your_library_name_1 run:lane1
chunk:0) terminated with an error exit status (127)
Command executed:
TASK_TMP_DIR=$(mktemp -d -p ./ distiller.tmp.XXXXXXXXXX)
touch your_library_name_1.lane1.hg38.0.bam
bwa mem -t 8 -SP hg38_reference.fasta SRR027958_1.fastq.gz
SRR027958_2.fastq.gz | tee >(samtools view -bS >
your_library_name_1.lane1.hg38.0.bam) | pairtools parse --drop-readid
--add-columns mapq -c hg38_chrom_sizes.txt | pairtools sort --nproc 8 -o
your_library_name_1.lane1.hg38.0.pairsam.gz --tmpdir $TASK_TMP_DIR | cat
rm -rf $TASK_TMP_DIR
Command exit status:
127
Command output:
(empty)
Command error:
.command.run: line 259: docker: command not found
Work dir:
/home/biophymember/Projets/HiC_premiere_analyse/essai_nextflow/work/25/b975c5500ab3a684c907871e216052
Tip: you can try to figure out what's wrong by changing to the process
work dir and showing the script file named .command.sh
I don't know where the file '.command.sh' is. Here is the content of my
folder:
(base)biophymember@rddm503nc:~/Projets/HiC_premiere_analyse/essai_nextflow$
ls bin
configs docker LICENSE pipeline_info README.md test work CHANGES.md
distiller.nf environment.yml nextflow.config project.yml
sorted_chromsizes VERSION
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/mirnylab/distiller-nf/issues/149?email_source=notifications&email_token=AAG64CX42XDLJNQENFBCRTLRD7ZPBA5CNFSM4KZFP3Z2YY3PNVWWK3TUL52HS4DFUVEXG43VMWVGG33NNVSW45C7NFSM4IPKYEEA,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAG64CXN3OLVSHG7DHMJCFLRD7ZPBANCNFSM4KZFP3ZQ
.

—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub https://github.com/mirnylab/distiller-nf/issues/149?email_source=notifications&email_token=ABTNDSBUCOO2WMTSCB2IJELREFLRHA5CNFSM4KZFP3Z2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEMVFHZA#issuecomment-589976548, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABTNDSB7TIIRHKQ5FIUED7TREFLRHANCNFSM4KZFP3ZQ.

It seems to work, thanks!

yay!!!
On Tue, 25 Feb 2020 at 15:26, gopel<EMAIL_ADDRESS>wrote:

It seems to work, thanks!
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/mirnylab/distiller-nf/issues/149?email_source=notifications&email_token=AAG64CQE3EDW26N7UASD7XLREUTCVA5CNFSM4KZFP3Z2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEM4E4SA#issuecomment-590892616,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAG64CWXCYNAJ2MG3QMLM4TREUTCVANCNFSM4KZFP3ZQ
.


Fluent builder methods for bevy_reflect ParsedPaths.

What problem does this solve or what need does it fill?
I'd like a set of builder methods for ParsedPaths. Rather than (or in addition to) parsing paths from strings, I'd like to be able to construct paths using a fluent API. Basically I am building a tree of widgets by recursively walking the reflection data, and as I visit each field I want to construct a new path which is the concatenation of the parent path with the path segment for the field being visited.
What solution would you like?
Given a "base path" (which may be empty), I want to generate a new path which is the concatenation of the base plus a new element, which could be a name, index and so on. Similar to path.join() for directories.
What alternative(s) have you considered?
I could do this by manipulating the Vec directly, but fluent methods would be cleaner.

@MrGVSV Here's a rough sketch of what I am thinking of:
let path = ParsedPath::new()
    .push_field("abc")
    .push_list_index(0)
    .join(other_path);

Whether push mutates self, or generates a new path I'm open either way.


feat: endDate field is not in the US format in createTask.

The date format should be standardized. As the Web3Task is aiming to become a global platform, the date fields should follow a standard format, such as MM/DD/YYYY.

Resolution:
End Date should be displayed in the following format: MM/DD/YYYY

This was closed in #95


deno-gfm should load typescript on all deno.land/x pages

I originally posted this upstream in deno-gfm https://github.com/denoland/deno-gfm/issues/29. To summarize, the deno.land/x pages do not support typescript code blocks in their README markdown. This leaves tons of pages without syntax highlighting. My library as an example<EMAIL_ADDRESS>This is the default behavior in deno-gfm, which is understandable if this is a generic github markdown formatter.
In the README it states:

By default syntax highlighting for JavaScript, Markdown, and HTML is included. You can include more languages importing them.

For deno libraries though, at least typescript should be part of the default loaded languages, considering deno is a 'typescript first' runtime. Ideally, any code blocks with a language tag should be dynamically loaded at render-time. I can see this being a more difficult ask though, if memory constraints are high, or if caching dynamic loaded syntax is difficult.

There is no need for dynamically loading. We already load a plethora of prism languages, so that gfm issue is still valid and needs investigation.

https://github.com/denoland/dotland/pull/2659 seems to have fixed this issue. Should this be closed?

👍 thank you so much!


Filled in missing step with module installation

Inserting steps for installing python dependencies to ease installation for other users

Thank you for the PR. Sorry I missed it, as I didn't expect a pull request that early in the project.
I recently automated the installation process, now there is a script install_addon.py that installs the python dependencies.
What is the reason for installing google-api-python-client?

Hi,
Don't remembrr exactly, but i think it was for some module that you have used.
It is also possible, that this is downloaded as a grpc dependcy as well, so it is redundant.


select(selector, options) to customize isolation

E.g. DOMSource.select('.button', {own: false}).events('click') would change how isolation works by allowing click events from the children as well.
https://github.com/TylorS/cycle-snabbdom/issues/29#issuecomment-213075925

why would one use isolation if all in such a use case?

@laszlokorte Just when you want to isolate from siblings. So that a single component could have multiple instances in the same view, but still have access to its children.

@TylorS Oh, that makes sense, thanks.

Suggestion on the API would be welcome, I don't know if own is the best description.

@TylorS I'm thinking includeChildren

That would work for me.

includeEventsThatAreHappeningInsideChildIsolatedComponents )

includeEventsThatAreHappeningInsideChildIsolatedComponents )

Hehe, but this would also work for .observable (being renamed to .elements in v10), so I think it'd have to be
includeEventsThatAreHappeningInsideChildIsolatedComponentOrElementsThatExistInsideOfChildIsolatedComponents :stuck_out_tongue_winking_eye:

I think by default select should include isolated children and their events events, like it is normal behaviour in HTTP driver - parent aware of all that children are doing.

I think by default select should include isolated children and their events events, like it is normal behaviour in HTTP driver - parent aware of all that children are doing.

Actually we discussed this quite a bit with Laszlo, Frikki, and Tylor, and got to the conclusion the DOM driver simply has different isolation semantics than the HTTP driver does. It's very often needed to have parent-child isolation when it comes to the DOM Driver.

Not still completely sure about it, possible default isolation from parent is a good thing, but than {own: false} is needed too.

We actually did this already through a slightly different API than discussed https://cycle.js.org/releases.html#flexible-isolation


Table 5401 - Item Variant -> Length of Code Field

Hi,
we are trying to transfer ower solution into an extension.
We uses the item variant to differ between master data. The master data Table use the No,.Series and as we know the No. Series Lines are Code20.
So we extend the variant code field from Code10 to Code20. As far as I know In an extension this  is not possible.
Is it possible that the base application will extend the variant code from code10 to code20?
Kind regards,
Reiner Ovelgoenne

To cover all city names of the world, the field should be 170 characters long. Or what do I do for example with the Thai city: Krung Thep Mahanakhon Amon Rattanakosin Mahinthara Ayuthaya Mahadilok Phop Noppharat Ratchathani Burirom Udomratchaniwet Mahasathan Amon Piman Awatan Sathit Sakkathattiya Witsanukam Prasit (168 chars, longest city name in the world)

Our ISV has changed the Variant Code length from 10 to 100. This option is no longer available in AL. A longer Variant Code is required for a higher level of granularity in the inventory of products and allows user to understand what they have in inventory. Our customers variant codes can be as complicated as 362PL144X780-0.0001-P-N where every value of that variant code means something about the product itself and therefore requires its own variant code/SKU card for inventory tracking.
Our change over to 100 may be overkill, but 30 would be more than welcome, the more the better because it allows for a higher level of granularity of inventory, which is extremely important in manufacturing and sales.