Init with existing index in non-default location not working

Hello,
I am getting an error trying to init RAGatouille from an existing index at /mnt/index (within a docker container). There is an error message:
The relevant part of my code is
        RAG = RAGPretrainedModel.from_index(f"/mnt/index/.ragatouille/colbert/indexes/{INDEX_NAME}/")
        retriever = RAG.as_langchain_retriever(index_name=INDEX_NAME)

which runs ok, the error below occurs when my langchain chain is invoked.
Here is the log:
Loading searcher for index grt_ragatouille_colbertv20 for the first time... This may take a few seconds
2024-01-13 22:21:19 - [Errno 2] No such file or directory: '.ragatouille/colbert/indexes/grt_ragatouille_colbertv20/plan.json'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/colbert/infra/config/base_config.py", line 94, in load_from_index
    loaded_config, _ = cls.from_path(metadata_path)
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/colbert/infra/config/base_config.py", line 44, in from_path
    with open(name) as f:
         ^^^^^^^^^^
FileNotFoundError: [Errno 2] No such file or directory: '.ragatouille/colbert/indexes/grt_ragatouille_colbertv20/metadata.json'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/chainlit/utils.py", line 39, in wrapper
    return await user_function(**params_values)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/app/app.py", line 143, in main
    res = await chain.acall(message.content, callbacks=[cb])
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/langchain/chains/base.py", line 413, in acall
    return await self.ainvoke(
           ^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/langchain/chains/base.py", line 209, in ainvoke
    raise e
  File "/usr/local/lib/python3.11/site-packages/langchain/chains/base.py", line 203, in ainvoke
    await self._acall(inputs, run_manager=run_manager)
  File "/usr/local/lib/python3.11/site-packages/langchain/chains/conversational_retrieval/base.py", line 207, in _acall
    docs = await self._aget_docs(new_question, inputs, run_manager=_run_manager)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/langchain/chains/conversational_retrieval/base.py", line 330, in _aget_docs
    docs = await self.retriever.aget_relevant_documents(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/langchain_core/retrievers.py", line 281, in aget_relevant_documents
    raise e
  File "/usr/local/lib/python3.11/site-packages/langchain_core/retrievers.py", line 274, in aget_relevant_documents
    result = await self._aget_relevant_documents(
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/langchain_core/retrievers.py", line 166, in _aget_relevant_documents
    return await run_in_executor(
           ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/langchain_core/runnables/config.py", line 490, in run_in_executor
    return await asyncio.get_running_loop().run_in_executor(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/asyncio/futures.py", line 287, in __await__
    yield self  # This tells Task to wait for completion.
    ^^^^^^^^^^
  File "/usr/local/lib/python3.11/asyncio/tasks.py", line 339, in __wakeup
    future.result()
  File "/usr/local/lib/python3.11/asyncio/futures.py", line 203, in result
    raise self._exception.with_traceback(self._exception_tb)
  File "/usr/local/lib/python3.11/concurrent/futures/thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/ragatouille/RAGPretrainedModel.py", line 206, in _get_relevant_documents
    docs = self.model.search(query, **self.kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/ragatouille/RAGPretrainedModel.py", line 184, in search
    return self.model.search(
           ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/ragatouille/models/colbert.py", line 240, in search
    self._load_searcher(index_name=index_name, force_fast=force_fast)
  File "/usr/local/lib/python3.11/site-packages/ragatouille/models/colbert.py", line 204, in _load_searcher
    self.searcher = Searcher(
                    ^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/colbert/searcher.py", line 33, in __init__
    self.index_config = ColBERTConfig.load_from_index(self.index)
                        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/colbert/infra/config/base_config.py", line 97, in load_from_index
    loaded_config, _ = cls.from_path(metadata_path)
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/colbert/infra/config/base_config.py", line 44, in from_path
    with open(name) as f:
         ^^^^^^^^^^
FileNotFoundError: [Errno 2] No such file or directory: '.ragatouille/colbert/indexes/grt_ragatouille_colbertv20/plan.json'```

Looks like `_load_searcher` in `colbert.py` does not pass an `index_root` and also no `config` when creating a `Searcher` but this was just a very quick assessment in the code.

Hey Lars! Nice catch, I think know exactly how this got introduced -- as a workaround for an issue in loading configs for Searcher upstream, we let it fetch the config from the checkpoint without overrides, but it means that it defaults to the generation-time "root"!
I've pushed a workaround in https://github.com/bclavie/RAGatouille/pull/45, should be good to go!
(Also, to convert to langchain, simply doing:
RAG = RAGPretrainedModel.from_index(f"/mnt/index/.ragatouille/colbert/indexes/{INDEX_NAME}/")
retriever = RAG.as_langchain_retriever()

should be enough, passing the index name again isn't needed as the main RAG object has already initiated itself against the index)

Thanks for confirmation and quick resolution - confirmed working.

@bclavie is there a way to using an existing index and pass a local model?


Uncaught Error: Call to undefined method React\EventLoop\Timer\Timer::setData()

Hi Team,
I am using this plugin into my project.
I am getting the following error in my project logs...Can someone plz help on this
My s/w specification:
Php 7.0
"predis/predis": "1.1.1",
"predis/predis-async": "dev-master"
PHP Fatal error:  Uncaught Error: Call to undefined method React\EventLoop\Timer\Timer::setData() in /var/www/html/vendor/predis/predis-async/src/Connection/AbstractConnection.php:179
Stack trace:
#0 /var/www/html/vendor/predis/predis-async/src/Connection/AbstractConnection.php(158): Predis\Async\Connection\AbstractConnection->armTimeoutMonitor(5, Object(Closure))
#1 /var/www/html/vendor/predis/predis-async/src/Connection/AbstractConnection.php(209): Predis\Async\Connection\AbstractConnection->createResource(Object(Closure))
#2 /var/www/html/vendor/predis/predis-async/src/Client.php(178): Predis\Async\Connection\AbstractConnection->connect(Object(Closure))
#3 /var/www/html/commands/Queue/QueueConnector.php(86): Predis\Async\Client->connect(Object(Closure))
#4 /var/www/html/commands/Queue/QueueConnector.php(43): CLI\Queue\QueueConnector->createRedisClient(Object(CLI\Configuration\Configuration), Object(CLI\Handler\s3UploadHandler))
#5 /var/www/html/commands/Jobs/S3Upload.php(13): CLI\Queue\QueueConnector->__construct(Object(CLI in /var/www/html/vendor/predis/predis-async/src/Connection/AbstractConnection.php on line 179
Thanks in advance

Fixed this by downgrading to react/event-loop. Seems this call was removed in 0.5
composer require react/event-loop ^0.4

Fixed this by downgrading to react/event-loop. Seems this call was removed in 0.5
composer require react/event-loop ^0.4

It is works for me!


Implement channel filter hideable UI

PR Checklist

Please check all that apply to this PR using "x":

[x] I have checked that this PR is not a duplicate of an existing PR (open, closed or merged)
[x] I have checked that this PR does not introduce a breaking change

PR Type
What kind of change does this PR introduce?

[x] Bugfix

Fixes
Issue Number: #1
What is the current behavior?
Channel filter UI occupies a lot of screen space
What is the new behavior?
Redundant string is no longer visible and channel items are hidden by default -the list can be shown by tapping the Filter string-
Other information
Text size has been increased and item selection color has been changed to match the Chip background color -it was green-

Saving the filter visibility state will be implemented on my next PR, after doing the notification thumbnail PR one


[Bug]: On enabling a column to be editable, the focus isn’t seen on the Save/Discard column on the property pane.

Is there an existing issue for this?

[X] I have searched the existing issues

Description
On enabling a column to be editable, the focus isn’t seen on the Save/Discard column on the property pane.
https://theappsmith.slack.com/archives/C02JV8G1MP0/p1679918691965989
https://www.loom.com/share/906213a61447448a82041a1cdb654f6f
Steps To Reproduce

D&D a table column
Ensure that the number of columns are large in number so that it introduces a scroll on the property pane
Enable any column to be editable
Notice that the scroll stops midway and the Save/Discard column isn’t in focus

Public Sample App
No response
Environment
Production
Issue video log
No response
Version
Cloud

Stats

Stat
Values

Reach
3000

Effort (months)
0.5


Add default cookie domain to Dismisser component

Adds a domain to our Dismisser component cookie to help lock things down a bit. Set when the x button is clicked below:

as well as the privacy policy.
Note that this is difficult to write tests for due to the inability to stub out window, via rewire, in our test environment. See https://github.com/jhnns/rewire/issues/58 for more info.

          1 Warning

:warning:
Please include a PR summary

  Generated by :no_entry_sign: Danger

On further investigation, it seems like the domain is being set, even though in the docs for cookie it says that the default domain property is undefined. Closing for now and will revisit if issues arise in the future.


ciao-launcher: Update test certificates

This commit fixes the issue reported in Github Issue #185.  The default test
certificates have now been updated to include a role.  The ciao-launcher-server
has also been updated to support dual role launchers.
Signed-off-by: Mark Ryan<EMAIL_ADDRESS>

Coverage increased (+0.008%) to 56.947% when pulling c3ddfb4d010c0deb2a11b4306a600d667bb838b2 on markdryan:master into ee7f384e0af418a4da3af38a6ac04aa5732b001b on 01org:master.


Update web/concrete/css/ccm.app.css

Add important to css button rulo to avoid override on theme style

you need to make the changes in the .less files in the ccm_app folder, then compile them using less.


openssh: Check the security of the sshd service

This is just an idea for now.
Recommended settings which broke tests:

CapabilityBoundingSet=~CAP_SETGID caused sshd-session to fail with "fatal: setgroups: Operation not permitted [preauth]"

CapabilityBoundingSet=~CAP_SETUID caused sshd-session to fail with "fatal: setresuid 997: Operation not permitted [preauth]"

CapabilityBoundingSet=~CAP_SYS_CHROOT caused sshd-session to fail with 'fatal: chroot("/var/empty"): Operation not permitted [preauth]'

SystemCallFilter=~@privileged caused sshd to dump core:
Module libaudit.so.1 without build-id.
Module libz.so.1 without build-id.
Module libldns.so.3 without build-id.
Module libpam.so.0 without build-id.
Module sshd without build-id.
Stack trace of thread 1209:
#0  0x00007f5ee13bbbc8 setgroups (libc.so.6 + 0xf6bc8)
#1  0x0000561ac714b8dd main (sshd + 0xa8dd)
#2  0x00007f5ee12ef27e __libc_start_call_main (libc.so.6 + 0x2a27e)
#3  0x00007f5ee12ef339 __libc_start_main@@GLIBC_2.34 (libc.so.6 + 0x2a339)
#4  0x0000561ac714eb55 _start (sshd + 0xdb55)
ELF object binary architecture: AMD x86-64

SystemCallFilter=~@resources caused sshd to dump core:
Module pam_warn.so without build-id.
Module pam_limits.so without build-id.
Module libcap.so.2 without build-id.
Module libpam_misc.so.0 without build-id.
Module pam_loginuid.so without build-id.
Module pam_env.so without build-id.
Module pam_deny.so without build-id.
Module libcrypt.so.2 without build-id.
Module pam_unix.so without build-id.
Module libaudit.so.1 without build-id.
Module libz.so.1 without build-id.
Module libldns.so.3 without build-id.
Module libpam.so.0 without build-id.
Module sshd-session without build-id.
Stack trace of thread 1148:
#0  0x00007f4d5fed448b setpriority (libc.so.6 + 0x10448b)
#1  0x00007f4d5fa8efc4 pam_sm_open_session (pam_limits.so + 0x3fc4)
#2  0x00007f4d605dce5b _pam_dispatch (libpam.so.0 + 0x3e5b)
#3  0x0000559f87974f5c do_pam_session (sshd-session + 0x3bf5c)
#4  0x0000559f87947ee4 main (sshd-session + 0xeee4)
#5  0x00007f4d5fdfa27e __libc_start_call_main (libc.so.6 + 0x2a27e)
#6  0x00007f4d5fdfa339 __libc_start_main@@GLIBC_2.34 (libc.so.6 + 0x2a339)
#7  0x0000559f87947f55 _start (sshd-session + 0xef55)
ELF object binary architecture: AMD x86-64

Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[x] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
24.11 Release Notes (or backporting 23.11 and 24.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[ ] Fits CONTRIBUTING.md.

Add a :+1: reaction to pull requests you find important.

Result of nixpkgs-review pr 348701 run on x86_64-linux 1

1 package blacklisted:

nixos-install-tools

(Sorry in advance if you're not keen on feedback yet, I'm just trying to save time/effort.)

No, this is really useful, as it might prevent lots of extra work.

However, I might be missing something, but I think systemd hardening of sshd.service will apply to both sshd-itself, and to sshd sessions (i.e. administrators doing a remote login).

Yes, that is an issue. I was expecting to get lots of valid pushback, and expected to have to put the changes behind a hardening flag or the like. This sounds like an excellent reason to do that, which might make the changes useful to people who want specific limitations in place.
In this case, maybe a separate flag for individual/groups of commits would be useful, as in services.openssh.hardening.allow* flags (all default true). (Using "allow" would avoid the double negative.)


Fix Presto aggregate function 'avg' bug when counts are zero

What
This PR fixes Presto aggregate function avg to return Null rather than 0 when count is 0.
Why
Currently avg return's Nan when the count of a group is 0. In Presto java , the avg function returns ‘Null’ if the count is 0 : https://github.com/prestodb/presto/blob/master/presto-main/src/main/java/com/facebook/presto/operator/aggregation/AverageAggregations.java#L58 .
This PR fixes this behavior to be equivalent to one in Presto. Typically we get zero counts when we run single aggregations on distinct values.
Fixes : https://github.com/facebookincubator/velox/issues/8573
Notes
N/A

Hi @kgpai, thank you for creating this fix! I looked at the test and here is what happens with the empty accumulator: the original error happens with distinct aggregation when there is a group that is completely masked out. TypedDistinctAggregations first adds inputs to its own SetAccumulators that keep a set of distinct input values for each group. When TypedDistinctAggregations::extractValues is called, it convert each SetAccumulator to the input vectors and pass them to the aggregation function's addSingleGroupRawInput. After the SetAccumulators of all groups are added, TypedDistinctAggregations::extractValues then calls the aggregation function's extractValues() to extract the result.
This workflow works fine. The problem here is that when AverageAggregateBase::addSingleGroupRawInput() is called, even if rows has no selection, the method still calls updateNonNullValue that marks the group to be non-null. Therefore, when AverageAggregateBase::extractValues is called later, it sees that this group is not null even though the accumulator has count == 0, and hence trying to calculate the average from the accumulator.
https://github.com/facebookincubator/velox/blob/080b7857139ca647e90a5cee81344f920a1be84d/velox/functions/lib/aggregates/AverageAggregateBase.h#L201-L204
I think it would be cleaner to simply let AverageAggregateBase::addSingleGroupRawInput() return upfront if !rows.hasSelection. With this early return, we don't need to handle the special case of empty accumulator in AverageAggregateBase::extractValues. What do you think?

@kagamiori Thanks, thats interesting ,I am curious then that why does TypedDistinctAggregations.cpp need to call addSingleGroupRawInput if rows has no selection - Are there cases for functions where we should still call this ? Your fix of chaning AverageAggregateBase addSingleGroupRawInput makes sense, but I was wondering if we can take it one level higher.

@kagamiori Thanks, thats interesting ,I am curious then that why does TypedDistinctAggregations.cpp need to call addSingleGroupRawInput if rows has no selection - Are there cases for functions where we should still call this ? Your fix of chaning AverageAggregateBase addSingleGroupRawInput makes sense, but I was wondering if we can take it one level higher.

I don't know whether not calling addSingleGroupRawInput when there is no selected rows would affect other functions, but I think it shouldn't. You can try making the fix by avoid calling addSingleGroupRawInput in that case in TypedDistinctAggregations::extractValues.

@kagamiori I made the change in TypedDistinctAggregations and am testing it out to see if it breaks in other places...


Blocking heads-up notifications of almost all apps is unpractical

I use this Xposed module to block all heads-up notifications except for the Dialer's. On my OS, as long as the Dialer's heads-up is set to be displayed, the Dialer won't come to the foreground; that way, being called doesn't immediately interrupt whatever I'm currently doing, but I couldn't care less for any of the other heads-up notifications.
Right now, that means I have all apps toggled to be filtered except for the Dialer. Whenever I install a new app, I have to toggle the filter on in HeadsOff. I also imagine that this huge list of filtered apps causes a lot of “Is this notification filtered?“ ifs, which gets less and less pretty the more apps I install.
That said, I'd love to see a toggle in the settings that allows for reverse filtering as in “while reverse filtering is enabled, only show notifications from apps toggled on with per-app RegEx blacklists for those apps“. This way, my use-case would be covered completely with what seems to be comparably easy modifications. Until then, I'll keep using this awesome module the way I am right now.
Cheers!

First of all, only heads-up notifications get to be checked, Android itself has several restrictions on heads-ups, so unless you get a lot of heads-ups, it should be in a reasonable cost.
And whether "reverse" or not, each heads-up notifications still needs to be checked to see if it's posted by the selected app(s).

I currently have around 200 apps installed, including system apps. Whether the module goes through a list of 199 to check whether

I currently have around 200 apps installed, including system apps. Whether the module goes through a list of 199 to check whether a heads-up notification is from one of them and thus to be blocked or checks for just one to see whether it should be let through probably won't make any perceivable difference in performance, that's true; the optimization approach would be more of a thing for perfectionists.
That said, this is a request for a quality of life feature. After all, while it wouldn't do much to improve performance, it does make a big difference to the user whether he has to toggle 199 apps to be blocked plus one for each app that will be installed later or to toggle one switch in the settings and one for the app he wants heads-up notifications to be allowed for.
Either way, your module works great and I'm happy that I found it. Thanks for creating it.

I currently have around 200 apps installed, including system apps. Whether the module goes through a list of 199 to check whether a heads-up notification is from one of them and thus to be blocked or checks for just one to see whether it should be let through probably won't make any perceivable difference in performance, that's true; the optimization approach would be more of a thing for perfectionists.
That said, this is a request for a quality of life feature. After all, while it wouldn't do much to improve performance, it does make a big difference to the user whether he has to toggle 199 apps to be blocked plus one for each app that will be installed later or to toggle one switch in the settings and one for the app he wants heads-up notifications to be allowed for.
Either way, your module works great and I'm happy that I found it. Thanks for creating it.

I currently have around 200 apps installed, including system apps. Whether the module goes through a list of 199 to check whether a heads-up notification is from one of them and thus to be blocked or checks for just one to see whether it should be let through probably won't make any perceivable difference in performance, that's true; the optimization approach would be more of a thing for perfectionists.
That said, this is a request for a quality of life feature. After all, while it wouldn't do much to improve performance, it does make a big difference to the user whether he has to toggle 199 apps to be blocked plus one for each app that will be installed later or to toggle one switch in the settings and one for the app he wants heads-up notifications to be allowed for.
Either way, your module works great and I'm happy that I found it. Thanks for creating it.

I currently have around 200 apps installed, including system apps. Whether the module goes through a list of 199 to check whether a heads-up notification is from one of them and thus to be blocked or checks for just one to see whether it should be let through probably won't make any perceivable difference in performance, that's true; the optimization approach would be more of a thing for perfectionists.
That said, this is a request for a quality of life feature. After all, while it wouldn't do much to improve performance, it does make a big difference to the user whether he has to toggle 199 apps to be blocked plus one for each app that will be installed later or to toggle one switch in the settings and one for the app he wants heads-up notifications to be allowed for.
Either way, your module works great and I'm happy that I found it. Thanks for creating it.

I think what you need is:
a toggle for all apps
auto check when new app installed


Reverse dns inconsistencies causes issues

Output of docker version:
Client:
 Version:      1.11.0-rc2
 API version:  1.23
 Go version:   go1.5.3
 Git commit:   388f544
 Built:        Fri Mar 25 19:58:22 2016
 OS/Arch:      linux/amd64

Server:
 Version:      1.11.0-rc2
 API version:  1.23
 Go version:   go1.5.3
 Git commit:   388f544
 Built:        Fri Mar 25 19:58:22 2016
 OS/Arch:      linux/amd64

Output of docker info:
Containers: 10
 Running: 0
 Paused: 0
 Stopped: 10
Images: 8
Server Version: 1.11.0-rc2
Storage Driver: aufs
 Root Dir: /var/lib/docker/aufs
 Backing Filesystem: extfs
 Dirs: 63
 Dirperm1 Supported: true
Logging Driver: json-file
Cgroup Driver: cgroupfs
Plugins:
 Volume: local
 Network: bridge null host
Kernel Version: 4.2.0-34-generic
Operating System: Ubuntu 15.10
OSType: linux
Architecture: x86_64
CPUs: 4
Total Memory: 19.61 GiB
Name: ubuntu
ID: B7GA:45KQ:KPGO:WK62:PRQ6:2DQU:6GP2:CRY6:W6IM:VGJY:3OS7:XOBM
Docker Root Dir: /var/lib/docker
Debug mode (client): false
Debug mode (server): false
Registry: https://index.docker.io/v1/
WARNING: No swap limit support

Additional environment details (AWS, VirtualBox, physical, etc.):
Docker runs in Ubuntu 15.10 64-bit which is a VirtualBox VM running on Windows 10 64-bit.

;; Query time: 0 msec
;; SERVER: <IP_ADDRESS>#53(<IP_ADDRESS>)
;; WHEN: Mon Mar 28 05:10:56 UTC 2016
;; MSG SIZE  rcvd: 102

Describe the results you expected:
It would be much more consistent if the reverse-dns' PTR record returned go1 which is the hostname or a net-alias rather than golang_1.testnet. which is the container_name.network_name.

@F21 this is the expected behavior and is as per design. Also returning container_name.network_name for reverse dns query is a consistent behavior if a conatiner_name is provided. Also, hostname is not considered for DNS resolution.
--net-alias is considered for the reverse-dns query only if the corresponding container-name is NOT specified.
Also as discussed in https://github.com/docker/docker/issues/20847#issuecomment-191850085, returning multiple PTR record isnt advised and hence when there is a Reverse lookup request, docker consistently go through the priority logic of container-name followed by alias-name (if container-name isnt specified).
If your request is to change the priority to use --net-alias above container-name, then we have to also answer which of the multiple --net-alias to give the top priority ?

Hey @mavenugo, thanks for the quick reply to my issue!
Here are my observations with 1.11.0-rc2.

;; Query time: 0 msec
;; SERVER: <IP_ADDRESS>#53(<IP_ADDRESS>)
;; WHEN: Mon Mar 28 05:39:54 UTC 2016
;; MSG SIZE  rcvd: 97

If I have 2 --net-aliases, docker run -it --net=testnet --hostname=go2 --net-alias=go2 --net-alias=two golang, it seems the first net-alias is prioritized, but the result contains a g= (not too sure what that means:
root@go2:/go# dig -x <IP_ADDRESS>

; <<>> DiG 9.9.5-9+deb8u6-Debian <<>> -x <IP_ADDRESS>
;; global options: +cmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 4026
;; flags: qr rd ra; QUERY: 1, ANSWER: 1, AUTHORITY: 0, ADDITIONAL: 0

;; QUESTION SECTION:
;<IP_ADDRESS>.in-addr.arpa.	IN	PTR

;; ANSWER SECTION:
<IP_ADDRESS>.in-addr.arpa. 600	IN	PTR	g=go2.testnet.

;; Query time: 0 msec
;; SERVER: <IP_ADDRESS>#53(<IP_ADDRESS>)
;; WHEN: Mon Mar 28 05:41:38 UTC 2016
;; MSG SIZE  rcvd: 91

It looks like if there are multiple net-aliases, the first one is prioritized, so if one were to give --net-alias priority over container-name, then the first net-alias should receive top priority.
I thought I would go into my use-case as well. I use docker and docker-compose heavily for building POC and small production clusters of containers with their own bridged networks. I am also building a tool to automate all of this.
I like to prefix my container names with a project name to avoid naming conflicts with other containers running in the daemon: myproject_someservice. However, within my containers, I set my hostname to someservice and would like to access other containers via someservice as well. All of this works correctly and the forward dns is also resolvable.
However, when it comes to reverse dns, I am receiving a result like container_name.network_name, which causes issues with things like hbase and hdfs which relies heavily on the reverse dns. Being able to use the net-alias and being able to drop the network name as the reverse dns would extremely useful for this use case.

@F21 service discovery in docker has always been  based on --name and the FQDN of a container is container_name.network_name. ie: for forward lookup you can either use the short form, just the container name or the full form.
DNS PTR records typically return the fqdn. Thats the reason you see container_name.network_name in reverse dns. But looks like this doesn't work for Hadoop/HDFS which expects the reverse lookup to be in a different format.
Can you please try the following work around
docker network create testnet
docker run -it --net=testnet --hostname=go1.testnet --name=go1 golang

This basically sets your hostname to be same as what reverse DNS returns.

@sanimej I tried using docker-compose to bring up the cluster, but it's failing:
Error response from daemon: Cannot start container 353dc194a5cf9b34d9653b9828aa101f8f598fd2b91c4f3633ac1b5d86f4a72d: [9] System error: invalid argument

This is the a docker-compose.yml that reproduces the issue:
app:
  image: golang
  hostname: f826338a441f2f8a4685630e4fd83ad3af78c0fc_app.f826338a441f2f8a4685630e4fd83ad3af78c0fc
  container_name: f826338a441f2f8a4685630e4fd83ad3af78c0fc_app
  tty: true
  stdin_open: true
zookeeper:
  image: f21global/zookeeper
  hostname: f826338a441f2f8a4685630e4fd83ad3af78c0fc_zookeeper.f826338a441f2f8a4685630e4fd83ad3af78c0fc
  container_name: f826338a441f2f8a4685630e4fd83ad3af78c0fc_zookeeper
  environment:
    CONFIGTYPE: file
  tty: true

@F21 Your hostname is too long; I think it has to be 64 characters or less. Try a shorter hostname..
for example, this works..
docker run -it --net=f826338a441f2f8a4685630e4fd83ad3af78c0fc --hostname=go1.f826338a441f2f8a4685630e4fd83ad3af78c0fc --name go1 busybox sh

@sanimej Thanks, that works! Also noticed that it's safer to have dashes rather than underscores in the hostname, otherwise hdfs complains.

Should we close this one?
Should we file an issue to make sure docker restricts the hostname to 64 characters?

Should we close this one?
Yes.
Should we file an issue to make sure docker restricts the hostname to 64 characters?
I think its better to error out (which we do already) rather than implicitly truncating the hostname to 64 characters.

It's pretty clear that something allows to submit a hostname of > 64 characters, or the user would not have received the System error: invalid argument error in return...
It seems to be a discrepancy between the API and the CLI, as the verification is done in runconfig/opts/parse.go. So yes, there's an issue to be filed here.


Plotting coastlines

Hi Pascal,
I try to plot coastlines along with project results. But I am getting problems.
I followed plateflex examples, where contours are extracted from within topo class:
xmint,` xmaxt, ymint, ymaxt, zmint, zmaxt, dxt, dyt, nxt, nyt =
pd.read_csv('~/Documents/WORK/CPD/Data/topo_TUR.xyz', sep='\t', nrows=0).columns[1:].values.astype(float)
nxt = int(nxt); nyt = int(nyt)
topodata = pd.read_csv('~/Documents/WORK/CPD/Data/topo_TUR.xyz', sep='\t',
skiprows=1, names=['x', 'y', 'z'])['z'].values.reshape(nyt,nxt)[::-1]
topo = TopoGrid(topodata, dxt, dyt)
contours = topo.make_contours(0.)
Plotting works fine. But when I use project.plot_results with contours=contours flag, for example:
project.plot_results(mean_A=True, mask=True, contours=contours, cmap='Spectral')
I get AttributeError: 'Project' object has no attribute 'nn'
contours is a list object, I suppose this makes the problem. But I don't know how to solve it. Could you provide some hints?
Thanks in advance,
Ali

Dear Ali,
The error arises because the method plot_results uses the Project object attribute nn to plot the contours (lines 799-800 of the module classes.py). The object obtains the attribute nn when the method estimate_grid is run (see line 498 of the module classes.py). Your error message would mean that the method estimate_grid has not yet been run on project, and therefore the attribute nn is not yet stored in project. When you run plot_results, you therefore get the AttributeError that Project has not attribute nn.
Solution: run estimate_grid on project first, then use plot_results.
I hope this helps
Pascal

Hi Pascal,
In fact, after reading and initializing the magnetic anomaly grid and then the topography grids I ran estimate_grid() on the project:
project = Project(grids=[mag]) # Tried Project(grids=[mag, topo])] too
project.init()
project.estimate_grid(10) # project.nn gives 10
project.plot_results(mean_dz=True, contours=contours, mask=True, cmap='Spectral')
/home/aozb/.conda/envs/pflex/lib/python3.7/site-packages/platecurie/classes.py:800: VisibleDeprecationWarning: Creating an ndarray from ragged nested sequences (which is a list-or-tuple of lists-or-tuples-or ndarrays with different lengths or shapes) is deprecated. If you meant to do this, you must specify 'dtype=object' when creating the ndarray
contours = np.array(contours)/self.nn
I tried ct=np.array(contours)/project.nn and used contours=ct, then there are no error messages but no contours either.
Do you think it is because estimate_grid() does not decimate topography contours?
Best,
Ali

Hi Ali,
This sounds like a different problem. Can you post a minimal script that reproduces this behaviour? Also, please post the result of conda list. It sounds like numpy has changed how ndarrays are created, which will require a change in the code.
Do you also get the same error message in PlateFlex?
Thanks
Pascal

#BEGIN
import numpy as np
import pandas as pd
from platecurie import MagGrid, Project
from plateflex import TopoGrid
xmin, xmax, ymin, ymax, zmin, zmax, dx, dy, nx, ny =
pd.read_csv('mag_TUR.xyz', sep='\t', nrows=0).columns[1:].values.astype(float)
nx = int(nx); ny = int(ny)
magdata = pd.read_csv('mag_TUR.xyz', sep='\t',
skiprows=1, names=['x', 'y', 'z'])['z'].values.reshape(ny,nx)[::-1]
magdata[magdata<-750] = np.nan
magdata[magdata>1000] = np.nan
mag = MagGrid(magdata, dx, dy)
mask = (magdata==0)
xmint, xmaxt, ymint, ymaxt, zmint, zmaxt, dxt, dyt, nxt, nyt =
pd.read_csv('topo_TUR.xyz', sep='\t', nrows=0).columns[1:].values.astype(float)
nxt = int(nxt); nyt = int(nyt)
topodata = pd.read_csv('topo_TUR.xyz', sep='\t',
skiprows=1, names=['x', 'y', 'z'])['z'].values.reshape(nyt,nxt)[::-1]
topo = TopoGrid(topodata, dx, dy)
contours = topo.make_contours(level=0.0)
project = Project(grids=[mag, topo])
project.init()
project.mask = mask
project.estimate_grid(1)
project.mean_dz_grid = project.mean_dz_grid + project.mean_zt_grid
contours = topo.make_contours(level=0.0)
project.plot_results(mean_dz=True, contours=ct, mask=True, cmap='Spectral')
#EOF
mag_TUR.xyz and topo_TUR.xyz are pixel registered grids generated  from EMAG2v3 and ETOPO1 data respectively with same sampling intervals:
grdproject EMAG2_V3_20170530.grd -R20/50/30/50 -JM10c -Gmag_TUR.grd -D20 -Fk grdproject ETOPO1_Ice_g_gmt4.grd -R20/50/30/50 -JM10c -Gtopo_TUR.grd -r -D20 -Fk
You can find the list of packages of pflex env attached below.
PlateFlex works just fine (fig: example.png

). In fact, I can plot the contours on the magnetic anomaly map with
topo.plot(contours=contours, cmap='Spectral') mag.plot(mask=mask, contours=contours, vmin=-300, vmax=300, cmap='Spectral')
But of course these plotting routines are different from plot_results()
conda_list.txt
Hope these information can help.
Best,
Ali

Dear Ali,
You had the right idea to plot the map using the PlateFlex function plot_real_grid since this is the function called in plot_results. There was a problem with plot_results where the contours were actually not used in the call to plot_real_grid, so the contours were never plotted. I have fixed the master branch on GitHub. If you cloned or forked the repository, make sure to fetch the latest version and merge those changes (git pull), and then re-installing using pip install .
And you are correct that the coastlines are not truncated for cell numbers that are not integer multiples, but the grid cells should be mapped to their correct location.
Thanks for your input that led to an improvement in PlateCurie!

Dear Pascal,
The issue is resolved after installing the newest version. I am very happy to be involved in an improvement.
Best


very minor table adjustments

Just added some missing brackets to the readme.
Thanks for getting the changes in so fast!

I cleaned up the table in my editor, I missed those. Thank you! once tests finish, I'll merge this.


Complete show-stopper due to net-http-persistent update v3.0

Complete stack trace:
ArgumentError: wrong number of arguments (1 for 0)
from /Users/mdchaney/.rvm/gems/ruby-2.2.4/gems/net-http-persistent-3.0.0/lib/net/http/persistent.rb:505:in initialize' 	from /Users/mdchaney/.rvm/gems/ruby-2.2.4/gems/right_cloud_api_base-0.2.3/lib/base/routines/connection_proxies/net_http_persistent_proxy.rb:92:in new'
from /Users/mdchaney/.rvm/gems/ruby-2.2.4/gems/right_cloud_api_base-0.2.3/lib/base/routines/connection_proxies/net_http_persistent_proxy.rb:92:in create_new_persistent_connection' 	from /Users/mdchaney/.rvm/gems/ruby-2.2.4/gems/right_cloud_api_base-0.2.3/lib/base/routines/connection_proxies/net_http_persistent_proxy.rb:61:in request'
from /Users/mdchaney/.rvm/gems/ruby-2.2.4/gems/right_cloud_api_base-0.2.3/lib/base/routines/connection_proxy.rb:58:in block in process' 	from /Users/mdchaney/.rvm/gems/ruby-2.2.4/gems/right_cloud_api_base-0.2.3/lib/base/routines/routine.rb:79:in call'
from /Users/mdchaney/.rvm/gems/ruby-2.2.4/gems/right_cloud_api_base-0.2.3/lib/base/routines/routine.rb:79:in with_timer' 	from /Users/mdchaney/.rvm/gems/ruby-2.2.4/gems/right_cloud_api_base-0.2.3/lib/base/routines/connection_proxy.rb:57:in process'
from /Users/mdchaney/.rvm/gems/ruby-2.2.4/gems/right_cloud_api_base-0.2.3/lib/base/api_manager.rb:346:in block (2 levels) in process_api_request' 	from /Users/mdchaney/.rvm/gems/ruby-2.2.4/gems/right_cloud_api_base-0.2.3/lib/base/api_manager.rb:333:in each'
from /Users/mdchaney/.rvm/gems/ruby-2.2.4/gems/right_cloud_api_base-0.2.3/lib/base/api_manager.rb:333:in block in process_api_request' 	from /Users/mdchaney/.rvm/gems/ruby-2.2.4/gems/right_cloud_api_base-0.2.3/lib/base/api_manager.rb:326:in loop'
from /Users/mdchaney/.rvm/gems/ruby-2.2.4/gems/right_cloud_api_base-0.2.3/lib/base/api_manager.rb:326:in process_api_request' 	from /Users/mdchaney/.rvm/gems/ruby-2.2.4/gems/right_aws_api-0.3.4/lib/cloud/aws/s3/manager.rb:403:in api'
from (eval):2:in head' 	from /Users/mdchaney/.rvm/gems/ruby-2.2.4/gems/right_cloud_api_base-0.2.3/lib/base/manager.rb:117:in method_missing'
from (irb):4
from /Users/mdchaney/.rvm/gems/ruby-2.2.4/gems/railties-4.2.7/lib/rails/commands/console.rb:110:in start' 	from /Users/mdchaney/.rvm/gems/ruby-2.2.4/gems/railties-4.2.7/lib/rails/commands/console.rb:9:in start'
from /Users/mdchaney/.rvm/gems/ruby-2.2.4/gems/railties-4.2.7/lib/rails/commands/commands_tasks.rb:68:in console' 	from /Users/mdchaney/.rvm/gems/ruby-2.2.4/gems/railties-4.2.7/lib/rails/commands/commands_tasks.rb:39:in run_command!'
from /Users/mdchaney/.rvm/gems/ruby-2.2.4/gems/railties-4.2.7/lib/rails/commands.rb:17:in <top (required)>' 	from bin/rails:4:in require'
from bin/rails:4:in `'2.2.4
Using Ruby 2.2.4 and right_aws_api 0.3.4 (or 0.2.3).  It looks like they made a change to the method defs from standard args to named args in this commit:
https://github.com/drbrain/net-http-persistent/commit/5d4b76c22dd38d29b6fbc1ed700a2a1c78c5abc4#diff-9da42550715aa09be7174a0babadcad3

Confirmed, they've changed contract for new method.
As a quick workaround, count you plz try
gem 'net-http-persistent', '2.9.4'

in your Gemfile?

Yes, sorry, meant to point that out before I left.
gem 'net-http-persistent', '~>2.9'
gem 'right_aws_api'

right_aws_api v 0.3.5 was released, give it a try plz
If everything works fine then we are closing the issue

Yes, that works - net-http-persistent is now parked officially at ~>2.9.


Using zoom in multiple stacked images for Chrome / Safari

Hi all,
I have added this great plugin in one of my projects. But It slows down when trying to zoom in multiple images that is stacked with one another using z-index in chrome and safari ( My project does have about 20 images stacked on the top of one another ). I already tried this on Firefox and even IE and it's working properly. I also tried to compress all the images but it still slows down.
Any Ideas? Thanks.

Hi @colknives!
Can you please share an example of this problem. It would make it easier to troubleshoot the problem. If you want, you can modify this demo.

Hi @Mottie
Sorry for the late reply.
Here is the link for the example of this problem.
http://jsfiddle.net/colknives/5j354atc/

Hmm, that is very odd!
When I comment out, or just add display:none to 2 images (so only 10 images are visible) in the large image block, the zoom window moves without any problems (demo); but add an 11th or 12th image and the delay becomes significant.
I think this might be an issue with webkit since it is only occuring in Chrome & Safari (which I couldn't test since I don't own a mac).
I reported this issue, and hopefully it will be reviewed soon and hopefully solved.
In the mean time, I think adding a check box to show/hide the images groups might be a better idea. Or combine all the images into one.

Actually that's the main functionality of that demo, I just don't include the buttons for showing / hiding the images.
Thank you @Mottie  and hopefully this problem will be solved.


Jekyll-assets ~> 3.0 does not support Jekyll 4.2.0

Request
Jekyll-assets ~> 3.0 does not support Jekyll 4.2.0
I am trying to resolve a Dependabot "Known high severity security vulnerability detected in rack < 2.1.4 defined in Gemfile.lock"
dependency: rack required by sprockets, sprockets required by jekyll-assets
Jekyll-assets requires jekyll <4.0 .. I have 4.2 in my project.
Examples
if I pin jekyll assets in my gemfile:
jekyll-assets (~> 3.0) x86_64-linux was resolved to 3.0.12, which depends on
      jekyll (>= 3.5, < 4.0)

right now I'm stuck on jekyll-assets 1.0.0, hence the dependabot vulnerability

The latest tag does not support this, but on master the gemspec file does support Jekyll 3 and 4. So this needs to be tagged and of course the maintainers need to be comfortable that and all other changes since the last tag are ready

Any update to this? Been over a year


Investigate NRS / Graphite support

Chris H. mentioned that support for Graphite was being added to Firefox OS 1.2. We should investigate whether it would be feasible to support non-Roman scripts via the Firefox OS port of PhoneGap, which is new to PhoneGap / Cordova 3.4.
Note: as of milestone 0.1, the most current version of Cordova supported by PG build is 3.3. This does not yet support the Firefox OS. This issue probably needs to be looked at once PG build starts supporting PG / Cordova version 3.4.

Marking this as closed / won't fix.
Mozilla has discontinued support for Firefox OS as of September 2016, so supporting firefox OS as a platform seems to be out of the question (the PhoneGap build service never supported it). Using the Firefox browser as an embedded webview is an experimental feature for Cordova, but is not as widely used / supported as the native webview (crosswalk is also considered EOL).
If another viable solution for both Android / iOS becomes available, this issue can be reopened.


[vscode.dev] add support for creating Jupyter notebooks

It would be nice if vscode.dev could create Jupyter notebooks via the command palette "Jupyter: Create Blank New Jupyter Notebook"
Existing notebooks can be opened and run interactively in vscode.dev with the extension pyolite, but I can't find a way to create them.

Thanks, you should be able to do this today using the command Create: New File ... and then selecting Jupyter Notebook
See below:

Thanks for the reply!
When i selects "Create: New File..." I see this instead of the option seen in your second screenshot:
[cid:540f7f7f-12e2-4675-8dc6-8e80ae1f2dc4]
Selecting a language gives me no "Jupyter Notebook":
[cid:f33682b5-316c-410f-ad61-28548907421c]
The language "Jupyter" does not make it a Python Jupyter Notebook. And saving the file ony saves it as a text file.
[cid:d080ec60-aeb8-44b4-94fb-c6f6d770ff44]
[cid:1ebe1d12-ac9a-495f-b17e-379aafade355]

Fra: Don Jayamanne @.>
Sendt: 15. november 2021 19:19
Til: microsoft/vscode-jupyter @.>
Cc: Magnus-Matias Isbrand Høirup @.>; Author @.>
Emne: Re: [microsoft/vscode-jupyter] [vscode.dev] add support for creating Jupyter notebooks (Issue #8266)
Thanks, you should be able to do this today using the command Create: New File ... and then selecting Jupyter Notebook
See below:
[image]https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fuser-images.githubusercontent.com%2F1948812%2F141833743-d22d9054-1769-47a9-b969-3f4bee17ef5f.png&data=04|01|mi%40cowi.com|1fa4493dd1e14227bebd08d9a86482f2|11be153879d8493982b8b767805d825b|0|0|637725971919681500|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|3000&sdata=5ZoLxvD5EUoru%2BBzA%2Bs66Sle8eBAhMcpp58xNwOQrL4%3D&reserved=0
[image]https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fuser-images.githubusercontent.com%2F1948812%2F141833830-4c4396fb-805c-4d7e-aefd-3cf351149f91.png&data=04|01|mi%40cowi.com|1fa4493dd1e14227bebd08d9a86482f2|11be153879d8493982b8b767805d825b|0|0|637725971919681500|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|3000&sdata=vyF38o2m1E5daG0C4S43JOw7%2BNhWdnc7HaH5gr9GvGs%3D&reserved=0
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fmicrosoft%2Fvscode-jupyter%2Fissues%2F8266%23issuecomment-969188703&data=04|01|mi%40cowi.com|1fa4493dd1e14227bebd08d9a86482f2|11be153879d8493982b8b767805d825b|0|0|637725971919691456|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|3000&sdata=KF1%2B10tz21RgvvpQeZcapt4iEfFnKR%2Bi5jNHQPgd%2BOU%3D&reserved=0, or unsubscribehttps://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAVO6VFC3PIJICASFEPWBIADUMFFMJANCNFSM5ICJUT4A&data=04|01|mi%40cowi.com|1fa4493dd1e14227bebd08d9a86482f2|11be153879d8493982b8b767805d825b|0|0|637725971919691456|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|3000&sdata=Fd8YPhz%2FSBnlT1wmCGpVXpcpwHHWEYWHWUcI4DDYPVQ%3D&reserved=0.
Triage notifications on the go with GitHub Mobile for iOShttps://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fapps.apple.com%2Fapp%2Fapple-store%2Fid1477376905%3Fct%3Dnotification-email%26mt%3D8%26pt%3D524675&data=04|01|mi%40cowi.com|1fa4493dd1e14227bebd08d9a86482f2|11be153879d8493982b8b767805d825b|0|0|637725971919701408|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|3000&sdata=PEcDLpT3wgYdxWXfdl7CCpINOvrjlwNgyoTbRxESXzU%3D&reserved=0 or Androidhttps://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fplay.google.com%2Fstore%2Fapps%2Fdetails%3Fid%3Dcom.github.android%26referrer%3Dutm_campaign%253Dnotification-email%2526utm_medium%253Demail%2526utm_source%253Dgithub&data=04|01|mi%40cowi.com|1fa4493dd1e14227bebd08d9a86482f2|11be153879d8493982b8b767805d825b|0|0|637725971919701408|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|3000&sdata=56%2BwP0qdMTcvu5iV427PWACJpHSkGtbJmSR3K%2FaOzMI%3D&reserved=0.
COWI handles personal data as stated in our Privacy Noticehttps://www.cowi.com/privacy.

When I selects "Create: New File..." I see this instead of the option seen in your second screenshot:

Selecting a language gives me no "Jupyter Notebook":

The language "Jupyter" does not make it a Python Jupyter Notebook. And saving the file ony saves it as a text file.

Yeah, if you do select language it doesn't actually start up the kernel interface in the same way as "Jupyter: Create Blank New Jupyter Notebook" does.


How to send Mig-21 for India as its listed in Russian air platforms?

Hi,
You people have done a commendable job and made people lives easier.
I am writing here because I couldn't find way to clarify ambiguity about usage of these enumerations. I am working on to integrate Open-DIS library in my project and want to transmit an Indian Mig-21 but couldn't find way to send it as its listed in Russian Air Platforms list. Kindly guide me how to achieve this while maintaining SISO enumerations compliance and also if I send country code 99 for India in place of 222 for Russia then third party DIS compliant applications using SISO enumerations would not recognize it.
Thanks in advance.
Regards,
Dev

@dev-dis here's what the 1278.1-2012 standard says about the country code field within the Entity Type record:

Country. This field shall specify the country to which the design of the entity or its design
specification is attributed. This field shall be represented by a 16-bit enumeration (see [UID 29]).

This is likely why the Mig-21 you're referring to has country code of 222 (Russia).
Note how this differs from how country code field within Aggregate Type record is defined:

Country. This field shall specify the country with which the aggregate is associated. This field shall
be represented by a 16-bit enumeration (see [UID 29]). If the aggregate is not associated with any
country, then the country field shall contain the number zero.

Hi Leif,
Thanks for the masterly guidance.
What I understood is that in order to achieve association of the entity like Mig-21 for India in my case, I have to send Aggregate State PDU, am I right? One thing I would like to mention, I have multiple entities to transmit from my application with their country association and if an entity left aggregate then how can I send Entity State PDU?
Oce again really thankful for your precious time and guidance.
Regards,
Dev

Hi Leif,
One thing I want to share is that as F-16 is made by General Dynamics which is listed in US platforms with subcategories F-16A, F-16B, F-16C etc. is also listed in Pakistan Plaforms as per SISO-REF-010-2022 is given below:
<IP_ADDRESS> .........................Fighter/Air Defense
<IP_ADDRESS>.3                               General Dynamics F-16 Fighting Falcon
<IP_ADDRESS>.3.1                                        F-16A
<IP_ADDRESS>.3.2                                        F-16B
<IP_ADDRESS>.3.3                                        F-16C
<IP_ADDRESS> .........................Fighter/Air Defense
<IP_ADDRESS>.1                               F-16 (variation of <IP_ADDRESS>.3)
<IP_ADDRESS>.1.1                                     F-16A
<IP_ADDRESS>.1.2                                     F-16B
<IP_ADDRESS>.1.3                                     F-16C
Where 225 is country code of US and 165 is country code of Pakistan.
I think we have to create enumerations on our own if we want to send country association. For example if we want to send Rafale for India then we have to create Rafale enumeration for India same as F-16 enumeration created by SISO for Pakistan.
I am looking forward to hear from you soon.
Regards,
Dev

@dev-dis Yes your approach should work, and is likely the simplest approach, so long as each party involved agrees to use the same enumerations.

@dev-dis Yes your approach should work, and is likely the simplest approach, so long as each party involved agrees to use the same enumerations.

Thanks Leif for your guidance and time.


Toast attaches to top view controller.

The view attaches to the top view controller which is obviously by design. But this means that if another controller comes into view modally, the view attaches to the top of it and can be pulled down with it. This isn't the behaviour of the native toast.
Sorry have no idea for a PR myself but I thought I'd mention it. Thanks!

This is indeed the case and I don't know if it's possible to resolve this issue. I will leave it open if someone has an idea on how to fix this issue.

This issue might be solved by having a dedicated UIWindow just for the toast.

Is this the reason why every time I take a screenshot I see the toast 'peaking' from the top of the screen or this is a different bug? :)

Hi this is definitely a bug and I will take a look at it as soon as I can

Thanks man, keep me updated, please

Okay the lastest version should fix the problems mentionned in this issue. Now the ToastView displays itself in its own UIWindow so this means that it is no longer attached to the top view controller. I didn't add a lot of code but it's kind of a big change so tell me if something is broken (please create a new issue).


Default enableMozillaOverlay to false

When following the tutorial's instructions for installing direnv from the overlay, I got this error:
$ nix-env -f ../nix/nixpkgs.nix -i -A direnv
error: cannot auto-call a function that has an argument without a default value ('enableMozillaOverlay')

I added a default value so that the command would work. If this is not preferred, I'd recommend updating the installation instructions.

Dupe of #11

We noticed that, thanks. There is an open PR in https://github.com/target/lorri/pull/11. Was stalling it to set up CI first, but I think we can merge it right now.


Strip debug symbols from kernel

This PR strips debug symbols from the kernel binary to speed up loading. This reduces the boot image size from 5MB to 270KB for blog_os.
(The code already works, I just want to clean it up a bit and improve the naming of the string/path variables before merging.)
cc @64

Could you please add an option to disable this. Gdb attached to qemu can load debuginfo too (havent tested, but people say it works)

If done properly, this shouldn't affect debugging with GDB. As I understand it, there'd be two copies of the binary - one with debug info and one without. The bootloader would simply load the one without debug info, but you could just point GDB to the one with debug info and it'd work properly. @bjorn3

Thanks @64 I thought the original was stripped in place.

Yeah, the original binary is not modified.

bors r+

Failed presumably because of https://status.chocolatey.org/issues/2019-06-24-chocolatey-org-not-available-from-aws/

bors r+

Published as version 0.6.1


Automated tagging of system-agent images based on K3s releases

Basically identical to what was done for: https://github.com/rancher/rke2/issues/1206
We need to dispatch on release to the rancher/system-agent-installer-k3s repository for every new K3s release.

Moving this to backlog v1.22 since it will never be closed

Closing due to age


Fix OS X bug when all tabs are closed

When all tabs are closed in OS X and min is not quitted (by hitting the X button). If you click on the application dock icon, nothing happens.
With this fix, min opens a new tab if you click on the application dock icon in OS X, by listening to the electron activate event.

I'm not sure calling sendIPCToWindow is actually necessary. Would something like this work?
if (!mainWindow) {
    createWindow();
}

I just followed the open-url action.
Worked as expected 😄! Just committed the change

Can you please squash this into one commit? Otherwise, looks good!

Done! Thanks!

Looks good!


(python3-streams) Fix copyright reading logic and zip URL generation in python3-streams

Description

As per CPython issue #2672, alpha and beta builds have no official docs built. Furthermore, as of CPython PR #124489, the archives we previously referenced are no longer built. The change applies from Python 3.12 onwards based on what I can see in the docs archive.
Motivation and Context

The more recent versions of Python do not get packages built, as per Issue #2555. The previous PR did not work for the 3.14 alpha releases and, based on the CPython issue, may continue to break for new releases.
How Has this Been Tested?

I tested the Python3 update script directly and saw the correct versions referenced. I then tested via test_all.ps1 and again saw the correct versions referenced. I then used the generated package files and ran a local test install. I'm running PowerShell 7.4.6 on Windows 11.
Screenshot (if appropriate, usually isn't needed):
Types of changes

[X] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)
[ ] Migrated package (a package has been migrated from another repository)

Checklist:

[X] My code follows the code style of this repository.
[ ] My change requires a change to documentation (this usually means the notes in the description of a package).
[ ] I have updated the documentation accordingly (this usually means the notes in the description of a package).
[ ] I have updated the package description and it is less than 4000 characters.
[X] All files are up to date with the latest Contributing Guidelines
[X] The added/modified package passed install/uninstall in the Chocolatey Test Environment(https://github.com/chocolatey-community/chocolatey-test-environment/). Note that we don't support the use of any other environment.
[X] The changes only affect a single package (not including meta package).

:x: Package verification failed, please review the Appveyor Logs and the provided Artifacts before requesting a human reviewer to take a look.

:white_check_mark: Package verification completed without issues. PR is now pending human review

@yan12125 Thanks for picking that up - that's fixed now, and I also removed a logging statement I shouldn't have committed. I believe this is good to go now, and I've learned some useful things along the way 😄

:white_check_mark: Package verification completed without issues. PR is now pending human review

Thanks for getting it working on v3.14.x
Still need a review from one of the people on the chocolatey-team-maintainers,


Re-selecting with the mouse in a textfield does not work as expected (desktop application).

Steps to Reproduce

Insert the following 2 words in a textfield: "hello selection".
Mark the second word "DEFG" with a double click
Now try to select the last two characters "lo" in the first word "hello" with the mouse. This does not work as desired.

Expected results:
The existing selection would have to be released and only the two characters would have to be marked again.

Actual results:
Strange behavior of the marker

Code sample

Logs

[flutter] flutter doctor -v
[√] Flutter (Channel stable, 3.0.4, on Microsoft Windows [Version 10.0.22000.739], locale de-CH)
• Flutter version 3.0.4 at C:\develop\flutter
• Upstream repository https://github.com/flutter/flutter.git
• Framework revision 85684f9300 (4 days ago), 2022-06-30 13:22:47 -0700
• Engine revision 6ba2af10bb
• Dart version 2.17.5
• DevTools version 2.12.2
[X] Android toolchain - develop for Android devices
X Unable to locate Android SDK.
Install Android Studio from: https://developer.android.com/studio/index.html
On first launch it will assist you in installing the Android SDK components.
(or visit https://flutter.dev/docs/get-started/install/windows#android-setup for detailed instructions).
If the Android SDK has been installed to a custom location, please use
flutter config --android-sdk to update to that location.
[√] Chrome - develop for the web
• Chrome at C:\Program Files\Google\Chrome\Application\chrome.exe
[√] Visual Studio - develop for Windows (Visual Studio Community 2022 17.2.4)
• Visual Studio at C:\Program Files\Microsoft Visual Studio\2022\Community
• Visual Studio Community 2022 version 17.2.32602.215
• Windows 10 SDK version 10.0.19041.0
[!] Android Studio (not installed)
• Android Studio not found; download from https://developer.android.com/studio/index.html
(or visit https://flutter.dev/docs/get-started/install/windows#android-setup for detailed instructions).
[√] VS Code (version 1.68.1)
• VS Code at C:\Users\st-ro\AppData\Local\Programs\Microsoft VS Code
• Flutter extension version 3.44.0
[√] Connected device (3 available)
• Windows (desktop) • windows • windows-x64    • Microsoft Windows [Version 10.0.22000.739]
• Chrome (web)      • chrome  • web-javascript • Google Chrome 103.0.5060.66
• Edge (web)        • edge    • web-javascript • Microsoft Edge 103.0.1264.44
[√] HTTP Host Availability
• All required HTTP hosts are available
! Doctor found issues in 2 categories.
exit code 0

1. Mark the second word first by a double click:

Try to select the last two characters of the first word:

Hi @2S-Software, thanks for filing the issue.
This issue is reproducible on the latest stable but it seems to have been fixed on master channel.

Demo (master channel)
https://user-images.githubusercontent.com/104349824/177296563-8bb08e69-9679-48f5-b60f-b2e9071c2df1.mp4

Sample code
import 'package:flutter/material.dart';

void main() {
  runApp(const MyApp());
}

class MyApp extends StatelessWidget {
  const MyApp({Key? key}) : super(key: key);

  @override
  Widget build(BuildContext context) {
    return MaterialApp(
      title: 'Flutter Demo',
      theme: ThemeData(
        primarySwatch: Colors.blue,
        visualDensity: VisualDensity.adaptivePlatformDensity,
      ),
      home: const MyHomePage(title: 'Flutter Demo Home Page'),
    );
  }
}

class MyHomePage extends StatefulWidget {
  const MyHomePage({Key? key, required this.title}) : super(key: key);

  final String title;

  @override
  _MyHomePageState createState() => _MyHomePageState();
}

class _MyHomePageState extends State<MyHomePage> {
  int _counter = 0;

  void _incrementCounter() {
    setState(() {
      _counter++;
    });
  }

  @override
  Widget build(BuildContext context) {
    return Scaffold(
      appBar: AppBar(
        title: Text(widget.title),
      ),
      body: Center(
        child: Column(
          mainAxisAlignment: MainAxisAlignment.center,
          mainAxisSize: MainAxisSize.min,
          children: <Widget>[
            const Text(
              'You have pushed the button this many times: ',
            ),
            Text(
              '$_counter',
              style: Theme.of(context).textTheme.headline4,
            ),
							const TextField(),
          ],
        ),
      ),
      floatingActionButton: FloatingActionButton(
        onPressed: _incrementCounter,
        tooltip: 'Increment',
        child: const Icon(Icons.add),
      ),
    );
  }
}

flutter doctor -v
[✓] Flutter (Channel stable, 3.0.4, on macOS 12.2.1 21D62 darwin-x64, locale en-VN)
    • Flutter version 3.0.4 at /Users/huynq/Documents/GitHub/flutter
    • Upstream repository https://github.com/flutter/flutter.git
    • Framework revision 85684f9300 (3 days ago), 2022-06-30 13:22:47 -0700
    • Engine revision 6ba2af10bb
    • Dart version 2.17.5
    • DevTools version 2.12.2

[✓] Android toolchain - develop for Android devices (Android SDK version 31.0.0)
    • Android SDK at /Users/huynq/Library/Android/sdk
    • Platform android-33, build-tools 31.0.0
    • ANDROID_HOME = /Users/huynq/Library/Android/sdk
    • Java binary at: /Applications/Android Studio.app/Contents/jre/Contents/Home/bin/java
    • Java version OpenJDK Runtime Environment (build 11.0.12+0-b1504.28-7817840)
    • All Android licenses accepted.

[✓] Xcode - develop for iOS and macOS (Xcode 13.3)
    • Xcode at /Applications/Xcode.app/Contents/Developer
    • CocoaPods version 1.11.3

[✓] Chrome - develop for the web
    • Chrome at /Applications/Google Chrome.app/Contents/MacOS/Google Chrome

[!] Android Studio
    • Android Studio at /Applications/Android Studio Preview.app/Contents
    • Flutter plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/6351-dart
    ✗ Unable to find bundled Java version.
    • Try updating or re-installing Android Studio.

[✓] Android Studio (version 2021.2)
    • Android Studio at /Applications/Android Studio.app/Contents
    • Flutter plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/6351-dart
    • Java version OpenJDK Runtime Environment (build 11.0.12+0-b1504.28-7817840)

[✓] IntelliJ IDEA Community Edition (version 2020.3.3)
    • IntelliJ at /Applications/IntelliJ IDEA CE.app
    • Flutter plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/6351-dart

[✓] IntelliJ IDEA Community Edition (version 2022.1.1)
    • IntelliJ at /Users/huynq/Library/Application Support/JetBrains/Toolbox/apps/IDEA-C/ch-0/221.5591.52/IntelliJ IDEA CE.app
    • Flutter plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/6351-dart

[✓] VS Code (version 1.68.1)
    • VS Code at /Applications/Visual Studio Code.app/Contents
    • Flutter extension version 3.42.0

[✓] Connected device (2 available)
    • macOS (desktop) • macos  • darwin-x64     • macOS 12.2.1 21D62 darwin-x64
    • Chrome (web)    • chrome • web-javascript • Google Chrome 103.0.5060.53

[✓] HTTP Host Availability
    • All required HTTP hosts are available

! Doctor found issues in 1 category.

[✓] Flutter (Channel master, 3.1.0-0.0.pre.1501, on macOS 12.2.1 21D62 darwin-x64, locale en-VN)
    • Flutter version 3.1.0-0.0.pre.1501 on channel master at /Users/huynq/Documents/GitHub/flutter_master
    • Upstream repository https://github.com/flutter/flutter.git
    • Framework revision 753fee42cf (89 minutes ago), 2022-07-04 22:09:02 -0400
    • Engine revision 94b47cc0eb
    • Dart version 2.18.0 (build 2.18.0-254.0.dev)
    • DevTools version 2.15.0

[✓] Android toolchain - develop for Android devices (Android SDK version 31.0.0)
    • Android SDK at /Users/huynq/Library/Android/sdk
    • Platform android-33, build-tools 31.0.0
    • ANDROID_HOME = /Users/huynq/Library/Android/sdk
    • Java binary at: /Applications/Android Studio.app/Contents/jre/Contents/Home/bin/java
    • Java version OpenJDK Runtime Environment (build 11.0.12+0-b1504.28-7817840)
    • All Android licenses accepted.

[✓] Xcode - develop for iOS and macOS (Xcode 13.3)
    • Xcode at /Applications/Xcode.app/Contents/Developer
    • Build 13E113
    • CocoaPods version 1.11.3

[✓] Chrome - develop for the web
    • Chrome at /Applications/Google Chrome.app/Contents/MacOS/Google Chrome

[!] Android Studio
    • Android Studio at /Applications/Android Studio Preview.app/Contents
    • Flutter plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/6351-dart
    ✗ Unable to find bundled Java version.
    • Try updating or re-installing Android Studio.

[✓] Android Studio (version 2021.2)
    • Android Studio at /Applications/Android Studio.app/Contents
    • Flutter plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/6351-dart
    • Java version OpenJDK Runtime Environment (build 11.0.12+0-b1504.28-7817840)

[✓] IntelliJ IDEA Community Edition (version 2020.3.3)
    • IntelliJ at /Applications/IntelliJ IDEA CE.app
    • Flutter plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/6351-dart

[✓] IntelliJ IDEA Community Edition (version 2022.1.1)
    • IntelliJ at /Users/huynq/Library/Application Support/JetBrains/Toolbox/apps/IDEA-C/ch-0/221.5591.52/IntelliJ IDEA CE.app
    • Flutter plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/6351-dart

[✓] VS Code (version 1.68.1)
    • VS Code at /Applications/Visual Studio Code.app/Contents
    • Flutter extension version 3.42.0

[✓] Connected device (2 available)
    • macOS (desktop) • macos  • darwin-x64     • macOS 12.2.1 21D62 darwin-x64
    • Chrome (web)    • chrome • web-javascript • Google Chrome 103.0.5060.114

[✓] HTTP Host Availability
    • All required HTTP hosts are available

! Doctor found issues in 1 category.

Please try the issue again on the latest master channel and confirm if this issue is fixed.

Sorry, I had not checked this beforehand by the master channel. I learned again.
I can confirm that this issue has already been fixed and the ticket can be closed. Thank you very much!


No feedback when the user doesn't select a folder

I'm trying to show the user an alert when they haven't selected a folder to let them know their file won't be downloaded, but in the case that no URI is returned from the document tree in openDocumentTree, nothing is sent back to flutter.
I don't know whether it makes sense to do something like pendingResult.second.success(null) (or even pass the uri regardless of whether it is null) or to return an error case that would need to be handled in flutter, such as an error saying that no folder was chosen.
If you have a preference I'm happy to open a PR against this.
I'm trying to make use of the latest version from master at the moment as I needed access to some of the code as-yet unreleased on pub.dev.
Thanks!

Thanks for the issue! As you described, seems like the native never returns when the user don't pick a folder, right?
I think the solution is to return null when it happens since it's not a error itself but a user choice
If you want, feel free to open the PR! If I could help to answer questions, let me know
Thanks again!


denom = ( denom ^ xormask ) - xormask;
#if ABORT_IF_HIT_IS_OUTSIDE_LINE_SEGMENTS
    __int128 beta_num;
    if( (unsigned __int128)alpha_num > denom )
      return 0;
    beta_num  = imul128( l1p0x - l0p0x, l0p1y - l0p0y ) - imul128( l1p0y - l0p0y, l0p1x - l0p0x );
    if( (unsigned __int128)beta_num > denom )
      return 0;
#endif
    denomhigh = MATH_INT128_GET_HIGH64( denom );
    if( denomhigh )
    {
      shift = 65 - __builtin_clzll( denomhigh );
      alpha_num >>= shift;
      denom >>= shift;
    }
    denomlow = (int64_t)denom;
    halfdenom = denomlow >> 1;
    hitx = imul128( alpha_num, l0p1x - l0p0x );
    signbit = MATH_INT128_GET_HIGH64( hitx ) >> 63;
    hitx += ( halfdenom ^ signbit ) - signbit;
    hitpt[0] = l0p0x + idiv128( hitx, denomlow );
    hity = imul128( alpha_num, l0p1y - l0p0y );
    signbit = MATH_INT128_GET_HIGH64( hity ) >> 63;
    hity += ( halfdenom ^ signbit ) - signbit;
    hitpt[1] = l0p0y + idiv128( hity, denomlow );
  }
  return 1;
}

The difference between the two is just rounding occurring after the division (PB5) or before (PB6).

@AngusJohnson @alexisnaveros
The PB5+ still has to be fixed: for the cases when denom or alpha_num are in range 2^63..2^64-1 the result will be wrong! I have one idea. I will check it tomorrow (I am too sleepy now)
@alexisnaveros, I tested your asm implementation and unfortunately, it performs much worse than PB5 (2.5 times) when point coordinates to be read from independent memory locations (well x and y of the same point are adjacent, but the points are not in the same cache lines). I remember that you did not expect it be a killer, just wanted to inform you.

@sergey-239 Oh, you mentioned that before and I finally see what you mean, sorry. A positive value between 2^63..2^64-1 will be interpreted as a negative for the imul/idiv. Yeah, we still need to right shift by one when the top 64 bits are all zeroes and the 64th bit is set.
The asm implementation isn't doing anything different with memory, cache misses should hit all paths equally... Unless you mean something happens when gcc tries to keep the 4 pointers to the 4 sets of XY in 4 registers (for the asm block's operands), and there's only 3 free registers because the asm block clobbers 12 of them. Interesting, now I'm curious. I didn't want to give pointers to the asm block because I figured some values could already be in registers (in the case of Clipper2 anyway).

@alexisnaveros
quick note:
- beta  = imul128( l1p0x - l0p0x, l0p1y - l0p0y ) - imul128( l1p0y - l0p0y, l0p1x - l0p0x );
+ beta  = (imul128( l1p0x - l0p0x, l0p1y - l0p0y ) - imul128( l1p0y - l0p0y, l0p1x - l0p0x ) ^ xormask) - xormask;

I will look more thoroughly a bit later

Right, sorry, version above was buggy. I think it's now okay though I'm not proud of:
    highmask = MATH_INT128_GET_HIGH64( denom );
    if( highmask )
      shift = 65 - __builtin_clzll( highmask );
    else
      shift = ( (int64_t)denom < 0 ) | ( ( MATH_INT128_GET_HIGH64( alpha ) ^ (int64_t)alpha ) & 0x8000000000000000 );

in case you have a better idea.


Added cache_block_outputs parameter to handle models with non-regular structure such as ChatGLM

cache_block_outputs enables the collection of the block output to speed up GPTQ process. However, it does not work for some models such as ChatGLM where the LayerNorm is the first layer in the block.
Just compare:

OPT structure:
model.decoder.layers.0.self_attn
model.decoder.layers.0.self_attn.k_proj
model.decoder.layers.0.self_attn.v_proj
model.decoder.layers.0.self_attn.q_proj
model.decoder.layers.0.self_attn.out_proj
model.decoder.layers.0.activation_fn
model.decoder.layers.0.self_attn_layer_norm
model.decoder.layers.0.fc1
model.decoder.layers.0.fc2
model.decoder.layers.0.final_layer_norm

ChatGLM structure:
transformer.encoder.layers.0
transformer.encoder.layers.0.input_layernorm
transformer.encoder.layers.0.self_attention
transformer.encoder.layers.0.self_attention.query_key_value
transformer.encoder.layers.0.self_attention.core_attention
transformer.encoder.layers.0.self_attention.core_attention.attention_dropout
transformer.encoder.layers.0.self_attention.dense
transformer.encoder.layers.0.post_attention_layernorm
transformer.encoder.layers.0.mlp
transformer.encoder.layers.0.mlp.dense_h_to_4h
transformer.encoder.layers.0.mlp.dense_4h_to_h

The solution is to disable SA block output caching and collect the quantizing block inputs starting from the beginning of the model. It slows down the optimization a bit but works more stable.
Related PR to Transformers: https://github.com/huggingface/transformers/pull/27032

Thanks for adding more flexibility to GPTQ @AlexKoff88 ! This PR looks good. I have some questions regarding cache_block_outputs :

Did you run some tests to see if we really use less memory ? Because it seems like we are recomputing the inputs from scratch to get the output of the previous block that we get here (L450):  layer_output = block(*layer_inputs[j], **layer_input_kwargs[j]). To me, we get the same input in both cases.
The issue with the chatglm is that the entire input was required for the forward of the attention block. This was solved by passing *layer_inputs[j] and keeping in the whole input previously. I was able to run chatgml model with cache_block_outputs=True and cache_block_outputs = False . Here the snippet:

from transformers import GPTQConfig, AutoTokenizer, AutoModelForCausalLM

model_id = "THUDM/chatglm2-6b"
dataset = ["auto-gptq is an easy-to-use model quantization library with user-friendly apis, based on GPTQ algorithm."]
tokenizer = AutoTokenizer.from_pretrained("THUDM/chatglm2-6b", trust_remote_code=True)
gptq_config = GPTQConfig(bits=4, dataset = dataset, tokenizer=tokenizer, block_name_to_quantize = "transformer.encoder.layers", cache_block_outputs=False)
model = AutoModelForCausalLM.from_pretrained(model_id, quantization_config = gptq_config)

Thanks @SunMarc for the prompt review. I get the following error with your code if I don't set cache_block_outputs=True:
TypeError: forward() missing 1 required positional argument: 'rotary_pos_emb'
This happens when the optimization process goes to the second block. The problem is that the block input is not just an output of the preceding block.

cache_block_outputs
@SunMarc, I've added a test

Awesome @AlexKoff88 ! This should be good to be merged once the conflits are resolved =)

Done


add a button to reset all filters

Has been added some time ago, top right corner of analyze page.


UN-391: [BE] Topic/Time Period page updates (follow-up)

Ticket URL: https://national-archives.atlassian.net/browse/UN-391
About these changes
Updates the related_page_pks cached properties as follows:

Add docstrings and type hints
Use 'page_id' instead of 'page__pk' (using the values already in the join table instead of table-hopping)
Apply some sensible/predictable ordering to the return value, which can hopefully be utilised in future

Before assigning to reviewer, please make sure you have

[ ] Checked things thoroughly before handing over to reviewer.
[ ] Checked PR title starts with ticket number as per project conventions to help us keep track of changes.
[ ] Ensured that PR includes only commits relevant to the ticket.
[ ] Waited for all CI jobs to pass before requesting a review.
[ ] Added/updated tests and documentation where relevant.

Merging PR guidance
Follow docs\developer-guide\contributing.md
Deployment guidance
Follow docs\infra\environments.md

Sorry Andy - approved it before I changed my mind. Could we change related_page_pks to related_page_ids if we're no longer using pk?

Hi @jamesbiggs. The function of the method hasn't really changed. The page_id values are still the page PKs.

Happy for the merge then!😎


s/trans/codegen

Trans has been renamed to codegen for a long time in rustc.

I'd like to take this issue!

Go ahead!


Simplify config handling

Switch to urfave/cli/v2
Add more environment variables

While I appreciate the work that has gone into replacing the parsing library, I believe we need to prioritize backwards compatibility in our decision making. It is important to consider the impact that changes will have on our users, and in this case, it seems that the changes would require unnecessary adjustments to their configurations. Can we explore alternative solutions or ways to seamlessly integrate the new library without disrupting our users' workflows?


repro zod error

why
what changed
test plan

this does not work. yet, sad
2024-11-21T21:40:07.221Z::[stagehand:undefined] error in extractPartners function
400 Invalid schema for response_format 'Extraction': In context=(), 'required' is required to be supplied and to be an
Error: 400 Invalid schema for response_format 'Extraction': In context=(), 'required' is required to be supplied and t
at APIError.generate (/Users/filipmichalsky/Odyssey/clients/browserbase/stagehand/node_modules/openai/error.js:45:2
at OpenAI.makeStatusError (/Users/filipmichalsky/Odyssey/clients/browserbase/stagehand/node_modules/openai/core.js:
at OpenAI.makeRequest (/Users/filipmichalsky/Odyssey/clients/browserbase/stagehand/node_modules/openai/core.js:337:
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async OpenAIClient.createChatCompletion (eval at  (/Users/filipmichalsky/Odyssey/clients/browserbase/
at async extract (eval at  (/Users/filipmichalsky/Odyssey/clients/browserbase/stagehand/node_modules/bra
at async Stagehand.extract (eval at  (/Users/filipmichalsky/Odyssey/clients/browserbase/stagehand/node
at async Object.extract_partners (eval at  (/Users/filipmichalsky/Odyssey/clients/browserbase/stagehand/
at async Object.task (eval at  (/Users/filipmichalsky/Odyssey/clients/browserbase/stagehand/node_modules
at async rootSpan.traced.name (/Users/filipmichalsky/Odyssey/clients/browserbase/stagehand/node_modules/braintrust/
✅ extract_partners: Passed

@filip-michalsky closing this for now until we get a fix


We should also talk about Edge Network Server API for Target here

Clients are getting misguided with the documentation and using the legacy Target server side SDKs for target server side implementation using this documentation and missing the Edge Network Server API even if they are using webSDK Client Side
We should update this documentation so that they get clear guidance that

if they are using AT.JS and app measurement in client side than delivery API and Adobe Target Server Side SDKs should be used
If they are using WebSDK in client side than Edge Network Server API for Target should be used

Issue in ./help/dev/implement/server-side/server-side-overview.md

Thanks for the information.
https://experienceleague.adobe.com/en/docs/target-dev/developer/server-side/server-side-overview


Add testfixtures wheel for galaxyproject/galaxy#2579.

New PR, new build?

xref #100

@jmchilton we need this one for the next stable release, aren't we?
The Jenkins output is not accessible, so I'm hesitate to merge it.
@galaxybot test this

These built and were copied by Jenkins to https://depot.galaxyproject.org/starforge/wheels/build-96/

These have been copied to wheels.galaxyproject.org

Though I couldn't do it directly from orval for some reason (host problems?):
sites@orval:…alaxyproject.org/root/packages$ wget https://depot.galaxyproject.org/starforge/wheels/build-96/testfixtures-4.10.0.tar.gz
--2016-08-04 02:43:45--  https://depot.galaxyproject.org/starforge/wheels/build-96/testfixtures-4.10.0.tar.gz
Resolving depot.galaxyproject.org (depot.galaxyproject.org)... <IP_ADDRESS>
Connecting to depot.galaxyproject.org (depot.galaxyproject.org)|<IP_ADDRESS>|:443... connected.
HTTP request sent, awaiting response... 404 Not Found
2016-08-04 02:43:45 ERROR 404: Not Found.

orval is resolving depot as delirium. Because its resolver was pointing to a very old Galaxy DNS server IP that should have been decommissioned. Weird, and nice catch. This has been fixed.


Converting Grafana JSON Format to OpenObserve

Mikrotik-snmp-prometheus.json
Dear Community,
I hope you're all doing well! I wanted to share my excitement about my recent switch to OpenObserve, and I must say, it’s been a fantastic experience so far. The features and capabilities it offers are truly impressive, and I believe it can greatly enhance our data visualization efforts.
As I dive deeper into using OpenObserve, I realize that transitioning our existing Grafana JSON files would significantly streamline our processes. I would love your help in converting these files to the OpenObserve format.
If anyone has experience with this conversion or is willing to assist, it would be greatly appreciated!
Thank you for your support.

I'm going to try this and keep you posted.

You should try this - https://github.com/openobserve/openobserve/discussions/2885

You should try this - openobserve/openobserve#2885

i had try this tools but it didn't work well for me.
this is converted file.
Mikrotik.json


URL dead

This url doesnt work anymore.
https://age-of-empires-2-api.herokuapp.com

Heroku has stopped the free tire

Is their a new URL for this I need to finish my project on Postman

Stale. I'm closing this issue.

.