What does "filter" mean in Data.read()?

I am trying to create a pyfocal.core.data.Data object manually, so I can unit test a function. But I cannot figure out what it wants in the "filter".
>>> d = Data.read(filename, filter=None)
---------------------------------------------------------------------------
IndexError                                Traceback (most recent call last)
<ipython-input-14-07a508ca516c> in <module>()
----> 1 d = Data.read(filename, filter=None)

.../Pyfocal-0.1a1-py2.7.egg/pyfocal/core/data.pyc in read(cls, *args, **kwargs)
     26         from ..interfaces.registries import io_registry
     27
---> 28         return io_registry.read(cls, *args, **kwargs)
     29
     30     @property

.../astropy-1.1.1-py2.7-linux-x86_64.egg/astropy/io/registry.pyc in read(cls, *args, **kwargs)
    342
    343         reader = get_reader(format, cls)
--> 344         data = reader(*args, **kwargs)
    345
    346         if not isinstance(data, cls):

.../Pyfocal-0.1a1-py2.7.egg/pyfocal/interfaces/loaders.pyc in fits_reader(filename, filter, **kwargs)
     27     name = os.path.basename(filename.name.rstrip(os.sep)).rsplit('.', 1)[0]
     28     hdulist = fits.open(filename, **kwargs)
---> 29     ref = loader_registry.get(filter)
     30
     31     meta = ref.meta

.../Pyfocal-0.1a1-py2.7.egg/pyfocal/interfaces/registries.pyc in get(self, filter)
     29
     30     def get(self, filter):
---> 31         return [x for x in self._members if x.filter == filter][0]
     32
     33     @property

IndexError: list index out of range

"filter" is the association of the file type to the loader functions. When you open a file, it's that string that is shown in the drop down box that allows you to select your extension filter. So, for instance, the generic.yaml file is loaded into the registry associated with a string composed of its name and extensions called "Generic Fits (*.fits *.mits)".
It is the identifier for that yaml file. So you query the LoaderRegistry with that string as an argument, and it will give you the python dictionary parsed from the yaml file, which is then used in the astropy io parsing functions.

This still does not work... So, how do I load your FITS spectrum into the Data object without having to go through the GUI?
d = Data('generic_spectra.fits', filter='*.fits')

Use filter='Generic Fits (*.fits *.mits)'

Ah, okay. So it's very picky to the words. Got it, thanks!


(possible issue) window.prerenderReady

Problem:
Using window.prerenderReady = false; doesn't force to wait for caching.
System-Logic:
I use two instances of express, one on port 80 and one on 3000
The 80 is what should be cached and delivers an index.html.
The mainController is using a factury what is asking the instance 3000 using a different route for a JSON response. Instance 3000 then is asking a CORS allowed webservice and get the value. The factury has a timeout of 5 sec. When this response is noticed I set the window.prerenderReady = true; (yes: I checked the value is false)
I would expect to get a cached version of the existing page after setting window.prerenderReady = true;
Also tried to put the window.prerenderReady = false; outside/inside the document.ready area.
Wrong behavior:
I got a plain  also with all angular controlled {{title}} {{description}} within  what works fine by calling the normal way by browser. I use prerender.io to cache.
other possibilities (mistakes because of learning phase):
I am using both: $locationProvider.hashPrefix('!'); and $locationProvider.html5Mode(true); within the app.config(...)
I wrote a comment to issue #30 because it seams similar. But now it looks for me like an issue (or wrong understanding - sorry if so)

I'm also having issues with this. Have emailed you @thoop


Unit tests for Airlock API

PR fixes #2016
What is being addressed

Adding unit tests for all new airlock api endpoints
Remove todos that were related to testing

/test-extended

/test-destroy-env

/test

/test

/help

/test-destroy-env

/test


API integration introduction content

Story
As a user
I want to quickly understand the Vega APIs available, how I might access them
So that I can decide whether to invest more time in using Vega and get started building
Acceptance Criteria

[x] I can understand how the API documentation is organised (using the REST endpoint)
[x] I can understand the methods for accessing our APIs - GraphQL and REST and GRPC
[x] There is an explanation of the pros and cons of each, and what they might be used for
[x] I can understand the available APIs available - Core node APIs, Data node APIs, Vega Wallet APIs, Tendermint API... and the sorts of endpoints within
[x] I can understand how pagination, transactions and versioning works?
[x] I can see that I need a wallet running to send / receive transactions
[x] There is an explanation of the primary elements and the end points used for:-

Assets
Parties
Accounts
Proposals
Markets
Orders

Tasks

[ ] Explore and sketch
[ ] Team and stakeholder review
[ ] Visual Design
[ ] Team review
[ ] Etc.

Sketch
Additional details / background info

This is now live. There have been lots of other changes to API docs done in other PRs as well, plus more to come, but I've called this ticket done as the content sketched out has now been added.


Bugfix/home page typo

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.:x: samikmitra sign nowYou have signed the CLA already but the status is still pending? Let us recheck it.


[HOLD #44582] Workspace - Distance rate enabled offline when creating the workspace online not grayed

If you haven’t already, check out our contributing guidelines for onboarding and email<EMAIL_ADDRESS>to request to join our Slack channel!

Version Number: v9.0.0-0
Reproducible in staging?: Y
Reproducible in production?: Y
Email or phone of affected tester (no customers<EMAIL_ADDRESS>Logs: https://stackoverflow.com/c/expensify/questions/4856
Issue reported by: Applause-Internal team
Action Performed:

Log in to staging.new.expensify.com
Create a new workspace
Navigate to more features
Go offline
Enable Distance rates
Navigate to Distance rates

Expected Result:
List of rates should be grayed out.
Actual Result:
List of rates is not grayed out.
Workaround:
Unknown
Platforms:

Which of our officially supported platforms is this issue occurring on?

[ ] Android: Native
[ ] Android: mWeb Chrome
[ ] iOS: Native
[ ] iOS: mWeb Safari
[x] MacOS: Chrome / Safari
[ ] MacOS: Desktop

Screenshots/Videos
https://github.com/Expensify/App/assets/115492554/9548f7c8-7688-4875-a5c9-f25255037f34

View all open jobs on GitHub

Proposal
Please re-state the problem that we are trying to solve in this issue.
The distance rates aren't grayed out when enabling the distance rate while offline.
What is the root cause of that problem?
When we create a new workspace, the distance rates are already added to the workspace. When the workspace creating is still pending, we also add it as the distance rate pending action.
https://github.com/Expensify/App/blob/7512346c2fd5c03882e3f9951b03530d8cbf7972/src/pages/workspace/distanceRates/PolicyDistanceRatesPage.tsx#L118
After the request is complete, there is no pending action anymore. When we enable the distance rate, the list won't be grayed out because the pending action is already done.
What changes do you think we should make in order to solve the problem?

If we still want to grayed it out when enabling it while offline, then we can add a
policy?.pendingFields?.areDistanceRatesEnabled,
condition so it's grayed out when the distance rate is enabled while offline.
https://github.com/Expensify/App/blob/7512346c2fd5c03882e3f9951b03530d8cbf7972/src/pages/workspace/distanceRates/PolicyDistanceRatesPage.tsx#L113-L118

Checking on in  #wave-collect

Noticing a lot of Offline Distance issues lately. Are these being addresses holistically anywhere?  (asking cuz I'm assigned to one and considering next steps)

This seems pretty similar

Yeah, please hold here, trying to figure out a holistic plan, since there are a lot of these

Sounds good Matt!

@paultsimura , please comment so I can assign to you

@paultsimura I think the vid is supposed to show that there's discrepancy when creating new workspaces and then going offline and adjusting the mileage rate. I'm assuming that when a new workspace is created, we're not carrying over any distance rate info from other workspaces, is that correct?

Stepping back, to make sure I'm understanding things.  From the vid it appears the user creates a new workspace, goes offline, does distance and the mileage rate is greyed out. They then do the same (or very similar) steps again and that time, the mileage rate isn't greyed out.  Is that correct? And, if so, do you know what that's happening?

Thx for the details @paultsimura , sounds like we should close this then, it's working as expected.  Right?


Redirect from www.simplereport.gov

Currently www.simplereport.gov has no DNS entry and results in a sad "this domain may be avaiable" notice. This is not great.

[ ] add DNS record for www.simplereport.gov
[ ] add 301 redirect from that address to https://simplereport.gov

Azure Front Door seems to have the ability to do this via button-press, but if we're trying to add a different CDN, then we probably should configure this through that.

This seems to have gotten done at some point, I'm not entirely sure when. 🤷♂
(Uses an A record instead of a CNAME or a 301, but that's not actually the point.)


Adjusting the width of the Band Page

The whole width of the Band page can be reduced to make it look more beautiful, appealing, and responsive.

Please assign me with this issue @nilisha-jais

Please attach the screenshots @utkarshgoel10

I'm asking to do something like this.
And furthermore, can I make this page responsive too, for the mobile devices.

Assigned @utkarshgoel10 , go ahead.


Doesn't Ask for SSH Password

Prerequisites

[X] Put an X between the brackets on this line if you have done all of the following:

Reproduced the problem in Safe Mode: https://flight-manual.atom.io/hacking-atom/sections/debugging/#using-safe-mode
Followed all applicable steps in the debugging guide: https://flight-manual.atom.io/hacking-atom/sections/debugging/
Checked the FAQs on the message board for common solutions: https://discuss.atom.io/c/faq
Checked that your issue isn't already filed: https://github.com/issues?utf8=✓&q=is%3Aissue+user%3Aatom
Checked that there is not already an Atom package that provides the described functionality: https://atom.io/packages

Description
Atom doesn't ask for ssh password when cloning from Github. Doesn't clone or throw errors - Dies silently.
Steps to Reproduce

Have ssh key with password
Attempt to clone from GitHub using ssh
Be sad

Expected behavior: It clones repo
Actual behavior: Dies silently
Reproduces how often: 100%
Versions
Atom    : 1.23.3
Electron: 1.6.15
Chrome  : 56.0.2924.87
Node    : 7.4.0
Additional Information
Any additional information, configuration or data that might be necessary to reproduce the issue.

I think this is an issue for https://github.com/atom/github instead

Whoops, thanks!


If inference requests fails to be processed via current handler endpoints the value of already_computed_units should not be updated

Ideally this can be solved through proper error handling and callbacks.

should be handled in #101


General-purpose mp3 support (without duplicating the main menu approach everywhere)

Once we have another mp3, general-purpose-ize our mp3 support.

Moving to Babylon as it's definitely not in Aztec.

De-assigning to Carthage as it doesn't match up with any of our proposed Carthage priorities.


Circles to bboxes conversion process doesn't seem right

The process circles_to_bboxes defined in octopipes.process doesn't convert to a conventional bbox format; it converts to [X_min, Y_max, X_max, Y_min] i assume that the intended format is [X_min, Y_min, X_max, Y_max] if so the function should change to this instead:
def circles_to_bboxes(circles) -> list:
    return [(int(x - r), int(y - r), int(x + r), int(y + r)) for x, y, r in circles]

I m also not sure where to handle this overflow nor why is it occurring
RuntimeWarning: overflow encountered in scalar subtract return [(int(x - r), int(y + r), int(x + r), int(y - r))

This would probably solve the error
def circles_to_bboxes(circles) -> list:
    return [(int(x) - int(r), int(y) - int(r), int(x) + int(r), int(y) + int(r)) for x, y, r in circles]

Yes, I agree that the format that is currently returned is not optimal nor intuitive. We should change it to return the bounding boxes in [xmin, ymin, xmax, ymax].
Concerning the overflow, could you provide some values to reproduce the warning?

before fixing the overflow error and after


Update HARViewer, add favicon

Unfortunately if the old harviewer.js file is cached by the browser if will now fail to load.

Current coverage is 85.62%

Merging #427 into master will decrease coverage by -0.09% as of 7355a3b

@@            master    #427   diff @@
======================================
  Files           39      39
  Stmts         4627    4627
  Branches       633     633
  Methods          0       0
======================================
- Hit           3966    3962     -4
- Partial        156     159     +3
- Missed         505     506     +1

Review entire Coverage Diff as of 7355a3b

Powered by Codecov. Updated on successful CI builds.

@Youwotma , one can add a note in the release notes about this and how to remove the cached one

@redapple I couldn't figure how to remove it from cache without whipping the whole cache, Ctrl+F5 didn't work, and disabling cache in devtools loaded the new version but didn't update the cache and didn't work again when re-enabling caching (tested in firefox only)

@Youwotma I think we can change the URL to prevent caching; maybe even adding ?version=2 will work. If not (e.g. because harviewer loads js files dynamically) we can change /_ui/harviewer path to something else.

@kmike I could not add an url parameter because the files are loaded dynamically by require.js, I have appended the version to the harviewer path


Start vscode too slowly

Issue Type: Performance Issue
I use vscode develop java and nodejs,  nodejs project has many files，when start vscode， java language server search nodejs project，Can I set a blanklist to tell java language server not checking?
VS Code version: Code 1.37.1 (f06011ac164ae4dc8e753a3fe7f9549844d15e35, 2019-08-15T16:17:55.855Z)
OS version: Windows_NT x64 10.0.18362

You can disable the Java extension for workspaces that don't use Java.

Please file issue against Java extension


saved_model README.md uses deprecated code

URL(s) with the issue:
https://github.com/tensorflow/tensorflow/blob/master/tensorflow/python/saved_model/README.md
Description of issue (what needs changing):
That documentation uses deprecated code like 'tf.Session()'
Submit a pull request?
No, because I don't really know how it should be used now.

The SavedModelBuilder function is only available through v1 compatibility.
So you should be using tf.compat.v1.saved_model.Builder function when using TF 2.X version.

The documentation still needs to be fixed

The saved_model md file is updated with commit 819eb34. Thanks!


Eager: Using tfe.gradients_function with the params keyword returns a function which cannot be called with lists of values

System information

Have I written custom code (as opposed to using a stock example script provided in TensorFlow): yes
OS Platform and Distribution (e.g., Linux Ubuntu 16.04): Linux Debian Stretch
TensorFlow installed from (source or binary): binary
TensorFlow version (use command below): 1.6.0
Python version: 3.6.2
CUDA/cuDNN version: N/A
GPU model and memory: N/A
Bazel version (if compiling from source): N/A
Exact command to reproduce:

import tensorflow as tf
import tensorflow.contrib.eager as tfe

tfe.enable_eager_execution()

def f(a, b):
    return a**2 + b**3

partial_grad = tfe.gradients_function(f, params=[0])
partial_grad([1., 2., 3.], [1., 2., 3.])

When I try to use tfe.gradients_function with the keyword params, it is not possible to call the resulting function partial_gradwith a list of values.
Workarounds:
Using np.array([1., 2., 3.]) as input for partial_grad works.
Traceback:
---------------------------------------------------------------------------
TypeError                                 Traceback (most recent call last)
<ipython-input-4-cb367c5f1046> in <module>()
      1 partial_grad = tfe.gradients_function(f, params=[0])
----> 2 partial_grad([1., 2., 3.], [1., 2., 3.])

~/programs/miniconda3/envs/gym/lib/python3.6/site-packages/tensorflow/python/eager/backprop.py in decorated(*args, **kwds)
    512     """Computes the gradient of the decorated function."""
    513
--> 514     _, grad = val_and_grad_function(f, params=params)(*args, **kwds)
    515     return grad
    516

~/programs/miniconda3/envs/gym/lib/python3.6/site-packages/tensorflow/python/eager/backprop.py in decorated(*args, **kwds)
    611       raise ValueError("Functions to be differentiated cannot "
    612                        "receive keyword arguments.")
--> 613     val, vjp = make_vjp(f, params)(*args, **kwds)
    614     return val, vjp(dy=dy)
    615

~/programs/miniconda3/envs/gym/lib/python3.6/site-packages/tensorflow/python/eager/backprop.py in decorated(*args, **kwds)
    665         sources.append(args[i])
    666         tape.watch(args[i])
--> 667       result = f(*args)
    668       if result is None:
    669         raise ValueError("Cannot differentiate a function that returns None; "

<ipython-input-2-159855d98f00> in f(a, b)
      1 def f(a, b):
----> 2     return a**2 + b**3

TypeError: unsupported operand type(s) for ** or pow(): 'list' and 'int'

Thank you for your post. We noticed you have not filled out the following field in the issue template. Could you update them if they are relevant in your case, or leave them as N/A? Thanks.
Bazel version

Nagging Awaiting Response: It has been 14 days with no activityand the awaiting response label was assigned. Is this still an issue?

It has been 14 days with no activity and the awaiting response label was assigned. Is this still an issue?

Note that this code doesn't work even without gradients_function, because the operator ** isn't defined for python lists. If you convert your arguments to tensors using tf.convert_to_tensor or tf.constant it should be ok.


feat: add toggleOnTap option to toggle tooltip

Implements the 'toggleOnTap' option. If the tooltip is open and 'toggleOnTap' is set to 'true', the tooltip will hide. If the tooltip is closed, it will be displayed.
I think it's a good feature for this package.

thank you


Question about "Solve" function

I have a general question about how OpenGoddard works. Why exactly in the "solve" function is optimize.minimize called repeatedly within a while loop? What changes in the inputs to optimize.minimize between each iteration of the while loop? Thanks.

self.p is changed within a while loop. self.p is inner variable that is aligned in a row for optimize. the function optimize.minimize is not enough to converge when it is called once.

So then what is the difference between what you are doing and just increasing the number of iterations on optimize.minimize? I get better convergence sometimes when I increase the number of optimize.minimize iterations and decrease the number of OpenGoddard iterations.

Also, when using OpenGoddard have you ever had issues with SLSQP optimizing successfully, but not actually satisfying the constraints. I am running a fairly complex problem and for some reason the SLSQP solver wont adhere to the constraints.


ARROW-1932: [Website] Update arrow site for 0.8.0 release

I saw two formatting issues but nothing relating to underscore. Updated based on those. Am I missing something?


Album view Problem when getting back form a single image that got reloaded via F5

Go into Album, click on Image, in Image view do a Browser reload, go back to Album view.

Check here too for screencast: https://drive.google.com/file/d/1bJfnfdn7eZNj5LNvgm6jEi-U662kTErZ/view?usp=drivesdk

Yikes, that's ugly! It's even worse with the unjustified layout, where the pictures disappear completely. I'm not sure if I'm responsible for this bug but since I've been messing around that part of the code lately, I'll have a look this weekend.
Thanks for the report!


error contacting cluster when changing subnets

When changing the cluster subnets, there is an error when contacting the cluster. It tries to access localhost instead of using the proper endpoint. As a result we get errors like so:
Error: Get "http://localhost/apis/rbac.authorization.k8s.io/v1/clusterrolebindings/view-binding": dial tcp <IP_ADDRESS>:80: connect: connection refused

The reason why is unclear, as we are not changing the endpoint or other attributes used to connect to the cluster.

It turns out that the AWS provider was dropping and recreating the cluster, causing the endpoint to change, causing the cluster to be unreachable. For some reason this was not shown in the plan, maybe because of a bug in the AWS provider causing it to try to reach the cluster before the cluster was recreated.
Upgrading the AWS provider fixed it, as new AWS providers allow you to change the subnets without recreating the cluster.


subsys: ipc: icmsg: Align to NO MULTITHREADING

Adapting icmsg to work without the MULTITHREADING functionality.
Dependencies for kernel work_queue, mutexes and other functions related to running multi-threaded applications have been 'ifdefed'.

@masz-nordic IPC is (supposedly) maintained, please don't just unassiign PRs, at least try to reach out to the maintainers first.


GGD recipe error during data upgrade for v1.1.8

I'm hitting a CloudBioLinux / GGD recipe error when attempting to upgrade the data for my install:
bcbio_nextgen.py upgrade --upgrade="stable" --data

Here's the log:
Upgrading bcbio-nextgen data files
[...]
Running GGD recipe: hg38 hapmap_snps 20160105
Traceback (most recent call last):
  File "/n/app/bcbio/stable/tools/bin/bcbio_nextgen.py", line 228, in <module>
    install.upgrade_bcbio(kwargs["args"])
  File "/data00/bcbio/v1.1.8/install/anaconda/lib/python3.6/site-packages/bcbio/install.py", line 106, in upgrade$bcbio
    upgrade_bcbio_data(args, REMOTES)
  File "/data00/bcbio/v1.1.8/install/anaconda/lib/python3.6/site-packages/bcbio/install.py", line 369, in upgrade_bcbio_data
    args.cores, ["ggd", "s3", "raw"])
  File "/home/mike/tmpbcbio-install/cloudbiolinux/cloudbio/biodata/genomes.py", line 354, in install_data_local
    _prep_genomes(env, genomes, genome_indexes, ready_approaches, data_filedir)
  File "/home/mike/tmpbcbio-install/cloudbiolinux/cloudbio/biodata/genomes.py", line 480, in _prep_genomes
    retrieve_fn(env, manager, gid, idx)
  File "/home/mike/tmpbcbio-install/cloudbiolinux/cloudbio/biodata/genomes.py", line 868, in _install_with_ggd
    ggd.install_recipe(os.getcwd(), env.system_install, recipe_file, gid)
  File "/home/mike/tmpbcbio-install/cloudbiolinux/cloudbio/biodata/ggd.py", line 30, in install_recipe
    recipe["recipe"]["full"]["recipe_type"], system_install)
  File "/home/mike/tmpbcbio-install/cloudbiolinux/cloudbio/biodata/ggd.py", line 62, in _run_recipe
    subprocess.check_output(["bash", run_file])
  File "/data00/bcbio/v1.1.8/install/anaconda/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/data00/bcbio/v1.1.8/install/anaconda/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['bash', '/data00/n/app/bcbio/v1.1.8/install/genomes/Hsapiens/hg38/txtmp/g
gd-run.sh']' returned non-zero exit status 6.

Ah OK re-running I got a more verbose error. Here's what's up:
Running GGD recipe: hg38 hapmap_snps 20160105
Running GGD recipe: hg38 1000g_omni_snps 20160105
--2019-11-22 15:41:24--<EMAIL_ADDRESS>gz
           => ‘variation/1000G_omni2.5.vcf.gz’
Resolving ftp.broadinstitute.org (ftp.broadinstitute.org)... <IP_ADDRESS>
Connecting to ftp.broadinstitute.org (ftp.broadinstitute.org)|<IP_ADDRESS>|:21... connected.
Logging in as gsapubftp-anonymous ...
Login incorrect.
Traceback (most recent call last):
  File "/n/app/bcbio/stable/tools/bin/bcbio_nextgen.py", line 228, in <module>
    install.upgrade_bcbio(kwargs["args"])
  File "/data00/bcbio/v1.1.8/install/anaconda/lib/python3.6/site-packages/bcbio/install.py", line 106, in upgrade_bcbio
    upgrade_bcbio_data(args, REMOTES)
  File "/data00/bcbio/v1.1.8/install/anaconda/lib/python3.6/site-packages/bcbio/install.py", line 369, in upgrade_bcbio_d
ata
    args.cores, ["ggd", "s3", "raw"])
  File "/tmp/bcbio/tmpbcbio-install/cloudbiolinux/cloudbio/biodata/genomes.py", line 354, in install_data_local
    _prep_genomes(env, genomes, genome_indexes, ready_approaches, data_filedir)
  File "/tmp/bcbio/tmpbcbio-install/cloudbiolinux/cloudbio/biodata/genomes.py", line 480, in _prep_genomes
    retrieve_fn(env, manager, gid, idx)
  File "/tmp/bcbio/tmpbcbio-install/cloudbiolinux/cloudbio/biodata/genomes.py", line 868, in _install_with_ggd
    ggd.install_recipe(os.getcwd(), env.system_install, recipe_file, gid)
  File "/tmp/bcbio/tmpbcbio-install/cloudbiolinux/cloudbio/biodata/ggd.py", line 30, in install_recipe
    recipe["recipe"]["full"]["recipe_type"], system_install)
  File "/tmp/bcbio/tmpbcbio-install/cloudbiolinux/cloudbio/biodata/ggd.py", line 62, in _run_recipe
    subprocess.check_output(["bash", run_file])
  File "/data00/bcbio/v1.1.8/install/anaconda/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/data00/bcbio/v1.1.8/install/anaconda/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['bash', '/data00/n/app/bcbio/v1.1.8/install/genomes/Hsapiens/hg38/txtmp/ggd-run.
sh']' returned non-zero exit status 6.

Seems like the login at ftp.broadinstitute.org is no longer working.

Mike;
Tackled this one over in the cloudbiolinux report, but unfortunately this is a confusing error message from the Broad FTP server when it's overloaded. Hopefully retrying at a later point will get it working cleanly for you.

In case anybody else hits this error, I'm still seeing this problem with a clean install of bcbio-nextgen 1.1.9 (see related cloudbiolinux issue https://github.com/chapmanb/cloudbiolinux/issues/329)


Quantize values "higher up" in the chain

Both the axes and the data container view quantize the same values after a scroll event. If that's the case, I may as well quantize them earlier on and pass them in just to save some computation.
This is likely a micro-optimization, but reducing any computation on a scroll event will be good. I gotta maximize the time available for painting!

Done


[WIP] Make node-geolite2 a redistribution of MaxMind's databases

This is a work-in-progress PR following the discussion in #17.
Roadmap before mergeable:

[x] Track databases on GitHub
[x] Rewrite postinstall script
[x] Write new lib License
[x] Setup automatic updates, "backend-side" (see this comment) either with Travis or GitHub Actions, and a maintainer's MaxMind license
[X] Setup automatic updates, "client-side" - make the library keep the downloaded databases up to date (I added checksum validation which could be useful for this)
[ ] Send an email to MaxMind's legal to make sure they're OK with what we're doing (should be, but won't hurt to ask)
[ ] Change the download URL to point to this repo instead of my fork
[x] Update README
[x] Write new tests

I'll keep working on this but I wanted to share my progress so far and get @runk's suggestions if any.

Close #17

So I implemented a self-updating mechanism to automatically update the local databases copies from the git repo. It uses SHA-384 checksums to determine whether a newer version is available. It's capable of keeping database copies up to date transparently, even when the library is used in a long-running script like a server or something, which should help ensure that nobody keeps using old versions of the databases past the allowed upgrade period of 30 days (see Do Not Sell requests and relevant sections in MaxMind's EULA).
I had to make a major API change however: the maxmind module is now incorporated in geolite2.
Old API:
var geolite2 = require('geolite2');
var maxmind = require('maxmind');

var lookup = maxmind.openSync(geolite2.paths.city); // or geolite2.paths.country or geolite2.paths.asn
var city = lookup.get('<IP_ADDRESS>');

Proposed API (this PR):
var geolite2 = require('geolite2');

var lookup = geolite2.openSync('GeoLite2-City'); // or -Country or -ASN
// an asynchronous geolite2.open() method is also available and returns a Promise
var city = lookup.get('<IP_ADDRESS>');

Implementation details
geolite2 returns a Proxy wrapper around a maxmind Reader instance. When a property of the reader is accessed, a background routine starts (either once every 48 hours or the first time the reader is accessed) to fetch the latest databases checksums from the git mirror.
If any of the checksums differ from the local copy, the databases are fetched again, and their checksums matched again. Normally they should now be correct, so new maxmind Reader instances are spun up and replace the old ones.
If the checksums don't match after a fresh download, or for any reason anything fucks up, a warning is printed to stdout and the whole self-update shebang will run again with the usual trigger (48 hours or program restart).

CI is broken again because the tests are now irrelevant and need to be rewritten.

Setup automatic updates, "backend-side" (see this comment) either with Travis or GitHub Actions, and a maintainer's MaxMind license

@runk I'm going to need your guidance/help for this part; as this involves maintainer secrets and CI configuration that I cannot change within the scope of a PR.
Once this is done we just have to verify the redistribution terms with MaxMind and, assuming all parties involved are OK, this will be mergeable.

Thanks for taking the time to review this - lots of new code indeed.
Regarding the CI/backend stuff, I'm assuming we'd rather go with Travis since it's already set up - is that okay?
I'll write a bash script to be run as a cron job. Need to look into how to push from CI.

Update script written. Ci-independent for now, I'll add that part later on.
❯ env MAXMIND_LICENSE_KEY=[key] ./update-databases

Downloading checksum for latest version of GeoLite2-ASN...
Downloading GeoLite2-ASN...
Verifying checksum...
Extracting database...
Calculating database checksum for redistribution...
Database GeoLite2-ASN successfully updated

Downloading checksum for latest version of GeoLite2-Country...
Downloading GeoLite2-Country...
Verifying checksum...
Extracting database...
Calculating database checksum for redistribution...
Database GeoLite2-Country successfully updated

Downloading checksum for latest version of GeoLite2-City...
Downloading GeoLite2-City...
Verifying checksum...
Extracting database...
Calculating database checksum for redistribution...
Database GeoLite2-City successfully updated

All databases processed

FYI there's MAXMIND_LICENSE_KEY env var already setup on travis ci. Probably you already figured it :)

Indeed, which is why I reused that env var in the bash script.
By the way, it checks current versions against the remote checksums before pulling updates, to ensure your license key isn't over-used and flagged as spam or whatever.
In other news, I have written a draft mail for MM's legal, if you're OK with that I'd like to send it to you first so you can review it.

Sure 👍 My email is on the profile

The Travis cron job script is up.
@runk Once this merges, you'll need to setup a cron job on master and a $GITHUB_PUSH_TOKEN secret env var on Travis with a GitHub personal access token.

Readme has been updated.

Readme documentation and tests have been written.

I'm the maintainer of an open source project that also used to directly download these databases on install (directly from Maxmind, not via this repo). I would love to hear what the response from the legal team is as this is something my project will also have to deal with.
Cheers

@d1str0 We have not contacted them yet. Runk and I are working in opposite timezones so things are going a bit slow.
You can subscribe to this thread for further updates.

@runk Have you received my email?

Hey @GitSquared, it was in trash - just found it.
After reading and looking at all the code I still feel a little uncomfortable redistributing databases like that. I really appreciate all the work you've done, however I don't think I'm feeling like accepting this change in the current repository. Whole legal deal makes me feel too uncomfortable.
That said, would you mind cloning/copying this repo and doing exactly what you want? I'm more than happy to add a reference to your repo from this one - no questions at all.

it was in trash - just found it.

GMail hates personal mailservers. I'd appreciate if you could report it as "not spam". Thanks.
I understand your decision, thanks for reviewing this PR either way.
I will contact MaxMind myself and detach my fork is they give me a positive answer - I'll update this thread.
I know you're not a stranger to them - they reuse your reader lib in their official APIs - so I had wished that with you as a maintainer they would be more likely to try and find a way for the license to work. Guess it's time to test my street cred.


[ZEPPELIN-1575] Notebook Repo settings UI

What is this PR for?
The idea behind this feature is to bring flexibility to the user to let him configure his repo via UI without restarting Apache Zeppelin.
This is flexible enough to handle most of the basic needs, but more complex case can be added in the future. I will not implement all NotebookRepo, this should be done in different PR since it will depend on special needs. I will just provide a simple example with VFS notebook repo.
NB: this scope of the PR doesn't include save change in the configuration file of zeppelin as well as implementation of every notebook repo, git, s3 etcetc, this will be added later if needed.
What type of PR is it?

Improvement

Todos

[x] - Implement backend.
[x] - Implement frontend.
[x] - Implement LocalVFS directory change as exemple.

What is the Jira issue?

ZEPPELIN-1575

How should this be tested?
Go to notebook repo setting page, edit the notebook path and save.
Screenshots (if appropriate)

Questions:

Does the licenses files need update? NO
Is there breaking changes for older versions? NO
Does this needs documentation? YES

@anthonycorbacho thanks for suggesting to change repo settings via UI. before testing, do you think we need some unit tests for repo settings feature?

@khalidhuseynov added some tests

Please review this PR

If no more discussion i am going to merge it.

@anthonycorbacho thanks for tests! tested and LGTM.


spring-cloud-stream-binder-rocketmq not support batch consume.

add function: setConsumeMessageBatchMaxSize(),and support batch consume please

Thanks for your suggestions , will  enhance it as soon as possible .


Put back in redcal_known_good in H4C RTP Stage 1

Once the a priori antenna status table is more settled, revert this commit: https://github.com/HERA-Team/hera_pipelines/commit/cd5548015df88b66581a2bcb66eef99f50618429

This was done here: 7cd594a66af2114c83e2f88dd1506990f16e38cd
This is now the only redcal in RTP stage 1


DiscoveryClient watch for service catalog change and update not working

Hi, I am using Spring Cloud 2021.0.1, and I am developing a Spring Gateway application for a k8s cluster.
In this one, I already deployed the Spring Cloud Kuberneted DiscoveryServer using the yaml published in the documentation page (and using 2.1.1 version).
In the discovery client documentation is told that:

Spring Cloud Kubernetes can also watch the Kubernetes service catalog for changes and update the DiscoveryClient implementation accordingly. In order to enable this functionality you need to add @EnableScheduling on a configuration class in your application.

I did that:
@SpringBootApplication
@EnableDiscoveryClient
@EnableScheduling
public class GatewayApplication {

But when a new microservice is published in the cluster, it not catched in the routing tables.
We managed to inspect what is read by the discovery client in the gateway by developing an additional RestController that inquiries the server through the ReactiveDiscoveryClient, like this:
@RestController
public class GatewayController {

    @Autowired
    private ReactiveDiscoveryClient client;

    @GetMapping("/services")
    public ResponseEntity<Mono<List<String>>> getServices() {
        try {
            return ResponseEntity.ok(this.client.getServices().collectList());
        } catch (Exception ex) {
            return ResponseEntity.internalServerError().build();
        }
    }
}

Opening the browser on localhost:8080/services, the whole list is given, even the "new" services (the ones that has been started AFTER the gateway).
Restarting the gateway application (i.e. kubectl delete and apply) all the cluster services are reachable, meaning that che routing tables is fully populated.
I saw that in the old version (1.1.x) there was a KubernetesCatalogWatch, triggered by KubernetesCatalogWatchAutoConfiguration (and the relative yaml property, spring.cloud.kubernetes.discovery.catalog-services-watch.enabled, true by default), that had a @Scheduled method for catalg update. In the current version there is nothing similar: is the documentation still valid or there is another way to activate the automatic service discovery update?
Thanks in advance

So is the problem that the service names are listed via the ReactiveDiscoveryClient but you cannot route requests to them via the gateway?

Yes; using this yaml configuration for the Spring Boot Gateway application:
spring:
  main:
    banner-mode: off
  application:
    name: "myapp-gateway"
  cloud:
    discovery:
      client:
        health-indicator:
          enabled: true
      enabled: true
    gateway:
      discovery:
        locator:
          enabled: true
          url-expression: "'http://'+serviceId+':8080'"
          lower-case-service-id: true
    kubernetes:
      discovery:
        enabled: true
        all-namespaces: false
        primary-port-name: "default-http"
        discovery-server-url: "http://myapp-discoveryserver"
        include-not-ready-addresses: true
      reload:
        enabled: true
        mode: polling
        period: 5000

And deploying the discovery server with a myapp-discoveryserver service id on the k8s cluster, I am able to contact the services using localhost:8080/service-name/service-apis after the gateway is started.
But only the ones that are already "ready" on the cluster work with this logic; for the ones deployed after, I can check that are correctly extracted by the injected discovery client, using the additional rest controller, but the routing table is not updated.
It's not a matter of update period - I waited hours for "something" to start and check out the new routing, but nothing occurred.
I really don't understand if this process relies still on some scheduled tasks, as written in the documentation, or there is some other (new) way to accomplish this.

Can your try clearing the route cache and seeing that works after new services are added?
https://cloud.spring.io/spring-cloud-gateway/reference/html/#refreshing-the-route-cache

Enabling the actuator endpoint for refresh in the application.yml file like this:
management:
  endpoint:
    gateway:
      enabled: true
    health:
      probes:
        enabled: true
      show-details: always
    info:
      enabled: true
    prometheus:
      enabled: true
  endpoints:
    web:
      exposure:
        include:
        - gateway
        - health
        - info
        - prometheus

And doina a POST on the localhost:8080/actuator/gateway/refresh url, the routes are correctly updated and requests are forwarded also to the new services.
This means that the update process works, if there is an event that triggers the action.
This endpoint has been designed to be inquired manually, or there is the way to put this into some automatic process managed by the discovery server?

There is a bit of confusion here....
@EnableScheduling is for the K8S API based discovery clients.
You are using the Spring Cloud Kubernetes Discovery Server, it makes a request to the server and the server is fetching the service info (much like Eureka).  The @EnableScheduling annotation does not apply here.
The problem you are experiencing is that the routes in the Gateway are cached and nothing is telling the Gateway the services have changed.
One solution might be to implement some kind of heartbeat event
https://github.com/spring-cloud/spring-cloud-gateway/blob/71014d10bfa040a08d3479b161b79b3c8cd0d4a8/spring-cloud-gateway-server/src/main/java/org/springframework/cloud/gateway/route/RouteRefreshListener.java
I am also wondering if the discovery server itself could publish a message to this effect and apps may react to that which are interested.

There are some suggested workaround here https://github.com/spring-cloud/spring-cloud-gateway/issues/1514


Question about training VQKD

Hey,
Thank you for publishing the code for BEiT2.
I am trying to train VQKD, but I found that the total loss did not decrease and remained around 0.999.
Here is part of the training log:

Epoch: [0]  [ 720/5004]  eta: 0:56:49  lr: 0.000003  bad_img: 0.0000 (0.0000)  loss: 0.9992 (0.9990)  quant_loss: 0.0038 (0.0043)  rec_loss: 0.9955 (0.9947)  total_loss: 0.9992 (0.9990)  weight_decay: 0.0001 (0.0001)  grad_norm: 4.0652 (4.0872)  time: 0.8124  data: 0.0011  max mem: 7845
Epoch: [0]  [ 730/5004]  eta: 0:56:40  lr: 0.000003  bad_img: 0.0000 (0.0000)  loss: 0.9984 (0.9990)  quant_loss: 0.0037 (0.0043)  rec_loss: 0.9948 (0.9947)  total_loss: 0.9984 (0.9990)  weight_decay: 0.0001 (0.0001)  grad_norm: 4.0666 (4.0869)  time: 0.8347  data: 0.0006  max mem: 7845
Epoch: [0]  [ 740/5004]  eta: 0:56:26  lr: 0.000003  bad_img: 0.0000 (0.0000)  loss: 0.9984 (0.9990)  quant_loss: 0.0039 (0.0043)  rec_loss: 0.9948 (0.9947)  total_loss: 0.9984 (0.9990)  weight_decay: 0.0001 (0.0001)  grad_norm: 4.0639 (4.0866)  time: 0.7400  data: 0.0007  max mem: 7845

Any help to this is much appreciated.
Thank you.

Thank you for your attention~
Could you provide more details?

Thank you for your response.
I found an error in my code that the gradient is clipped to zero. After fixing the bug, the loss decreased normally.


Error after Undo/Redo actions when User has edited S-Group

Affected Version: Remote, Standalone
Steps to Reproduce:

Launch Ketcher.
Create chain structure.
Create, for example, Generic S-Group.
Change Generic S-Group to Multiple/SRU-polymer S-Group.
Click 'Undo' button.
Click 'Redo' button.

Expected Result:
User can undo/redo all actions with S-Groups. Undo/Redo works correctly for each step.
Actual Result:
After Undo action part of Structure with S-Group disappears from canvas. When User clicks 'Redo' - part of structure appears without S-Group brackets.

Issue is closed as fixed.


chore(deps): update docker docker tag to v25.0.4

This PR contains the following updates:

Package
Type
Update
Change

docker
service-image
patch
25.0.3-dind -> 25.0.4-dind

docker
image
patch
25.0.3 -> 25.0.4

Configuration
📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).
🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
🔕 Ignore: Close this PR and you won't be reminded about these updates again.

[ ] If you want to rebase/retry this PR, check this box

This PR has been generated by Renovate Bot.

⚠ Artifact update problem
Renovate failed to update artifacts related to this branch. You probably do not want to merge this PR as-is.
♻ Renovate will retry this branch, including artifacts, only when one of the following happens:

any of the package files in this branch needs updating, or
the branch becomes conflicted, or
you click the rebase/retry checkbox if found above, or
you rename this PR's title to start with "rebase!" to trigger it manually

The artifact failure details are included below:
File name: .gitlab/workflows/devcontainer.yml
Post-upgrade command 'find template -type f -exec sed -i 's|{{{depName}}}:{{{currentValue}}}@{{{currentDigest}}}|{{{depName}}}:{{{newValue}}}@{{{newDigest}}}|g' {} +' has not been added to the allowed list in allowedPostUpgradeCommands

File name: .gitlab/workflows/devcontainer.yml
Post-upgrade command 'find template -type f -exec sed -i 's|{{{depName}}}:{{{currentValue}}}@{{{currentDigest}}}|{{{depName}}}:{{{newValue}}}@{{{newDigest}}}|g' {} +' has not been added to the allowed list in allowedPostUpgradeCommands

File name: .gitlab/workflows/release.yml
Post-upgrade command 'find template -type f -exec sed -i 's|{{{depName}}}:{{{currentValue}}}@{{{currentDigest}}}|{{{depName}}}:{{{newValue}}}@{{{newDigest}}}|g' {} +' has not been added to the allowed list in allowedPostUpgradeCommands

File name: .gitlab/workflows/release.yml
Post-upgrade command 'find template -type f -exec sed -i 's|{{{depName}}}:{{{currentValue}}}@{{{currentDigest}}}|{{{depName}}}:{{{newValue}}}@{{{newDigest}}}|g' {} +' has not been added to the allowed list in allowedPostUpgradeCommands


Fixed how errors from getSessionFromUrl are caught in the constructor of the client

@Andarist thanks a ton for the fix! 🥳  A note for future, we use semantic commit messages so that changes are automatically rolled up into commits. So prepending your commit message with fix: will force a new patch version


Field with 0 value

I have fields that have a value of 0 -- not null -- I think they should be displayed as $0.00

@irt-msummers  Are you referring to the field Minimum in your screenshot?
And you were expecting it to say $0.00 (not as a placeholder).
Same as in #55, can you post the props you are passing to the component so I can replicate the issue?

When the value is 0 you should get a placeholder that says $0.00, unless you pass the component placeholder: null.
You can see an example of it in the Amount field on this page where the default value is 0: https://demo.canutin.com/transaction/add

<CurrencyInput name={id} bind:value={value} locale="en-US" currency="USD" placeholder={null}/>
My fault -- I didn't capture the screen correctly.  Sell Price is the one I am referring to.
And I understand your logic, but -- 0 is a valid number just like 1 or 2 or whatever should it not be displayed the same way?  If Sell Price were null or '' -- nor something non-numeric then yes it should have a place holder if you want placeholders.  Yes/no?

I see what you mean, let me think about this a bit more.

I looked at other similar components (for React) and the described behavior in this issue is the default, which means that this should also be the default here.
Unfortunately changing this default might imply a breaking change which will need the library to be bumped a whole version. I have a much more ambitious plan for a potential full version bump so for now I'm supporting this behavior with an flag.
I just put out a WIP PR #59  that adds a isZeroNullish option to the component that solves the issue.

I appreciate you looking into it and this fix.  I understand.  Thanks again


Add v1.2 Release

Seems like it might be a good idea to do a v1.2 release now. I can update the package managers as soon as this is done. Thanks!

v1.2.0 should be ready to go if I didn't miss anything. I'll tag the release this weekend if no showstoppers turn up.

v1.2.0 is out now.


Define a relative-uris for base-uris in place of file://

First, check if we can use base-uri property in CSV-W to generate URIs for relative URIs, if not...
If we can, proceed by creating a Jenkins pipeline issue to allow for the configuration of the base-uri property.
If we can't, chuck this over the fence for csv2rdf as a feature request.
Basic test case is whether does csv2rdf break with the base-uri with a URL in it, if it tries to find a remote CSV then it breaks. If it uses the local CSV then it works.
Investigate whether csv2rdf and csvlint follow the csvw spec.

TODO: Raise issue with Swirrl to discuss csv2rdf incorrectly using @base property as the baseURi to RDF defined terms. TODO: Insert link to relevant part of the CSV-W spec.

So I did some testing on this and I'll describe my findings below:
Given the following CSV:
Period
year/2020
month/2020-01

And the following metadata JSON document:
{
    "@context": ["http://www.w3.org/ns/csvw", {"@base": "https://example.org/"}],
    "@id": "#dataset",
    "tables": [
        {
            "url": "problem.csv",
            "tableSchema": {
                "columns": [
                    {
                        "titles": "Period",
                        "name": "period",
                        "propertyUrl": "#dimension/period",
                        "valueUrl": "http://reference.data.gov.uk/id/{+period}"
                    }
                ],
                "aboutUrl": "http://some/observation/{+period}"
            }
        }
    ]
}

I get the following output from csv2rdf:
csv2rdf -u problem.csv-metadata.json -m annotated
13:23:14.328 [main] ERROR csv2rdf.main - #error {
 :cause clj-http: status 404
 :data {:request-time 993, :repeatable? false, :protocol-version {:name HTTP, :major 1, :minor 1}, :streaming? true, :chunked? false, :type :clj-http.client/unexceptional-status, :reason-phrase Not Found, :headers {Cache-Control max-age=604800, Content-Type text/html; charset=UTF-8, Date Tue, 13 Jul 2021 13:23:14 GMT, Expires Tue, 20 Jul 2021 13:23:14 GMT, Server EOS (vny/044F), Vary Accept-Encoding, Connection close}, :orig-content-encoding nil, :status 404, :length -1, :body <!doctype html>
<html>
<head>
    <title>Example Domain</title>

    ... html continues - removed by robons for brevity ...

, :trace-redirects []}
 :via
 [{:type clojure.lang.ExceptionInfo
   :message clj-http: status 404
   :data {:request-time 993, :repeatable? false, :protocol-version {:name HTTP, :major 1, :minor 1}, :streaming? true, :chunked? false, :type :clj-http.client/unexceptional-status, :reason-phrase Not Found, :headers {Cache-Control max-age=604800, Content-Type text/html; charset=UTF-8, Date Tue, 13 Jul 2021 13:23:14 GMT, Expires Tue, 20 Jul 2021 13:23:14 GMT, Server EOS (vny/044F), Vary Accept-Encoding, Connection close}, :orig-content-encoding nil, :status 404, :length -1, :body <!doctype html>
<html>
<head>
    <title>Example Domain</title>

    ... html continues - removed by robons for brevity ...

, :trace-redirects []}
   :at [slingshot.support$stack_trace invoke support.clj 201]}]
 :trace
 [[slingshot.support$stack_trace invoke support.clj 201]
  [clj_http.client$exceptions_response invokeStatic client.clj 239]

  ... again, edited for brevity ...

  [csv2rdf.main main nil -1]]}

What the CSV-W Spec Says
The CSV-W spec confims that this is the expected behaviour

A table description might contain:
Example 5

"url": "example-2014-01-03.csv"

in which case the url property on the table would have a single value, a link to example-2014-01-03.csv, resolved against the base URL of the metadata document in which this was located. For example if the metadata document contained:
Example 6

"@context": [ "http://www.w3.org/ns/csvw", { "@base": "http://example.org/" }]

this is equivalent to specifying:
Example 7

"url": "http://example.org/example-2014-01-03.csv"

The CSV-W spec also confirms that the base URL is not used as a base for relative URIs defined in json-ld metadata:

Note that the @base property of the @context object provides the base URL used for URLs within the metadata document, not the URLs that appear as data within the group of tables or table it describes. URI template properties are not resolved against this base URL: they are resolved against the URL of the table.

Thanks @robons for the writeup! The @base + url + relative_uri is in line with what I'd thought so that's good.
So in theory, if we hosted a CSV file at http://gss-data.org.uk/data/ + some-dataset-name, then some #relative JSON-LD would resolve to http://gss-data.org.uk/data/some-dataset-name#relative.
Something comes to mind about how when running tests you can spoof urls to make it seem like resources exist when really they're held locally - though that might be a bit of a stretch here and it might be easier to ask Swirrl if csv2rdf might be able to do that for us.

So in theory, if we hosted a CSV file at http://gss-data.org.uk/data/ + some-dataset-name, then some #relative JSON-LD would resolve to http://gss-data.org.uk/data/some-dataset-name#relative.

If we hosted a CSV file at http://gss-data.org.uk/data/some-dataset-name.csv then the RDF statements generated by columns would be like: http://gss-data.org.uk/data/some-dataset-name.csv#relative and the JSON-LD metadata URLs would point at http://gss-data.org.uk/data/some-dataset-name.csv-metadata.json#relative.
We can add some more consistency though, I've done some work in #97 which ensures that the JSON-LD & columns URIs both point to the CSV instead of the metadata JSON file.

Something comes to mind about how when running tests you can spoof urls to make it seem like resources exist when really they're held locally - though that might be a bit of a stretch here and it might be easier to ask Swirrl if csv2rdf might be able to do that for us.

Yes, we could make a proxy which resolved these URIs with the local files, however it'd be simpler to implement that inside csv2rdf than do that on our end.
Given that you can have multiple tables defined inside a given CSV-W, I do wonder whether it'd be simpler for us to  write a tool that did the mappings we wanted instead of asking Swirrl to alter CSV2RDF to take the mappings we want to perform.
So shall I create a task to create a python tool to do this mapping? I already have the aptly defined PMD project for tools like this?

If we hosted a CSV file at http://gss-data.org.uk/data/some-dataset-name.csv then the RDF statements generated by columns would be like: http://gss-data.org.uk/data/some-dataset-name.csv#relative and the JSON-LD metadata URLs would point at http://gss-data.org.uk/data/some-dataset-name.csv-metadata.json#relative.

Ah sure - so what I'm unsure of at this point is, if we could place the CSV and the metadata in the right locations whether we can make the URIs look how we want running the normal csv2rdf algorithm. We could place the CSV file at http://gss-data.org.uk/data/some-dataset-name and then the relative URIs defined in the CSVW columns would look how we liked, but other JSON-LD wouldn't because it would still have .csv-metadata.json in the URI.
I don't support any sort of find-and-replace style post processing for changing URIs in the turtle output - I think it would be better to write absolute URIs in the CSVW than do that.

We could place the CSV file at http://gss-data.org.uk/data/some-dataset-name and then the relative URIs defined in the CSVW columns would look how we liked, but other JSON-LD wouldn't because it would still have .csv-metadata.json in the URI.

I can make both the column and JSON-LD URIs point to the CSV for consistency.

I don't support any sort of find-and-replace style post processing for changing URIs in the turtle output - I think it would be better to write absolute URIs in the CSVW than do that.

So taking this as our direction, we'll need to provide some ability for the user to specify the base URI they want to use for all new URIs generated. I just want to check we're happy with this direction @ajtucker?

The URI resolution algo should help us here, e.g. http://example.com/data/set/obs.csv-metadata.json resolved with codelists/local-area#abc ends up looking like http://example.com/data/set/codelists/local-area#abc.

See https://datatracker.ietf.org/doc/html/rfc3986#section-5.2.3

The URI resolution algo should help us here, e.g. http://example.com/data/set/obs.csv-metadata.json resolved with codelists/local-area#abc ends up looking like http://example.com/data/set/codelists/local-area#abc.

@ajtucker, given that we're going to be loading CSV-Ws that haven't necessarily been published, we're trying to make the decision as to whether we do a find-and-replace style operation on the local file:/some/csv-w.csv-metadata.json URI to convert it to the absolute http://example.com/... URI or whether we just drop relative URIs and put the http://example.com/... URI directly into the CSV-W.
Do you have any thoughts on this?

I'd recommend we test out the assumptions above with how csv2rdf works with remote resources using a simple python3 -m http.server 8080 to serve the files locally from the filesystem, use relative URIs in the -metadata.json and run csv2rdf -t http://localhost:8080/codelists/blah.csv -u http://localhost:8080/codelists/blah.csv-metadata.json -m annotated
Then, yes, just pipe the output through something like sed 's|file:///blah/blah/|http://gss-data.org.uk/blah/blah/|' to achieve the result we want. I don't think csv2rdfdoes anything too clever wrt. namespace prefixes in the Turtle output, but if it does, we can always pipe through a Turtle to NTriples converter and runsed` on that output.

Thinking out loud, downsides to me are:

Atm seeing file://whatever is a way of QAing whether the transformation process has gone correctly or not - I've definitely used the fact I've spotted those in output ttl to know something's gone wrong. I wouldn't get those if we pipe via sed. Something to consider.
Then also I wouldn't be able to run csv2rdf locally and get to what the output will look like without piping through sed.

The other thing I wouldn't mind a second pair of eyes on, would be if by piping through to sed we don't get an equivalent output to what we would have gotten if we placed the CSV and the metadata files at the right location. Consider from Rob's example above:
{
    "@context": "http://www.w3.org/ns/csvw",
    "@id": "#dataset",
    "tables": [
        {
            "url": "this-should-be-where-uris-are-relative-to.csv",
            "tableSchema": {
                "columns": [
                    {
                        "titles": "Period",
                        "name": "period",
                        "propertyUrl": "#dimension/period",
                        "valueUrl": "http://reference.data.gov.uk/id/{+period}"
                    }
                ],
                "aboutUrl": "http://some/observation/{+period}"
            }
        }
    ]
}

<http://some/observation/year/2020> <file:/workspace/this-should-be-where-uris-are-relative-to.csv#dimension/period>
    <http://reference.data.gov.uk/id/year/2020> .

<http://some/observation/month/2020-01> <file:/workspace/this-should-be-where-uris-are-relative-to.csv#dimension/period>
    <http://reference.data.gov.uk/id/month/2020-01> .

If we use sed 's|file:/workspace/this-should-be-where-uris-are-relative-to.csv|http://gss-data.org.uk/data/some-dataset-name|' we get the output:
<http://some/observation/year/2020> <http://gss-data.org.uk/data/some-dataset-name#dimension/period>
    <http://reference.data.gov.uk/id/year/2020> .

<http://some/observation/month/2020-01> <http://gss-data.org.uk/data/some-dataset-name#dimension/period>
    <http://reference.data.gov.uk/id/month/2020-01> .

Which is the output we're after. But what I'm not sure of yet is whether we could get that from the same CSVW, without use of sed, if you placed the exact same identical CSVW metadata and CSV file at the right locations on the web.
@robons I'm looking at the issue you've linked here but it looks to me like _doc_rel_uri() will put the file extension .csv into URIs because self.csv_file_name has .csv in it.

Re: QA -- agreed. It's a shame that the RDF output has to use absolute URIs.
I still reckon that a good first step would be to serve the files locally http://localhost:8080/blah to check that the URI resolution process does what you expect with both file:///some/dir/structure/ and http://localhost:8080/some/path/.
I was going to propose firing up something like WireMock and setting that as a web proxy for csv2rdf, but then remembered that getting JVM apps to use a web proxy can be tricky. You can set system properties http.proxyHost and http.proxyPort, but really you'd want it to take into account the de-facto standard of setting the environment variable http_proxy.
I reckon that the proof wouldn't be any stronger with "real" URIs as opposed to "http://localhost" ones, but that it might make you feel better :)

@ajtucker, you say you have to use absolute urls in RDF. Can we not just use a prefix for the QA it'll be assigned to the local resources, but when we move to publish that prefix gets updated to where it ultimately ends up? This might make @rossbowen's QA easier as well.

I've not got too far in figuring out how to get csv2rdf to use an HTTP proxy. The following should work, but doesn't seem to:
docker run -v $PWD:/workspace -w /workspace -it gsscogs/csv2rdf java -Dlog4j2.configurationFile=/usr/local/share/log4j2.xml -Dhttp.proxyHost=localhost -Dhttp.proxyPort=8080 -jar /usr/local/share/java/csv2rdf.jar

At least according to the Java docs and what I'm guessing the Clojure HTTP library should do.
However, when I try it with a @base pointing to http://example.com, it still goes off and fetches the resource from Example Domain.

Right, so i just started a local webserver on my macbook and ran the following command:
csv2rdf -u 'http://<IP_ADDRESS>/some-qube.csv-metadata.json' -m annotated -o output.ttl
With a document using URIs like some-qube.csv#dimension/d-code-list, I get output like the following:
<http://<IP_ADDRESS>/some-qube.csv#component/d-code-list> a <http://purl.org/linked-data/cube#ComponentSet>,
    <http://purl.org/linked-data/cube#ComponentSpecification>;
  <http://purl.org/linked-data/cube#componentProperty> <http://<IP_ADDRESS>/some-qube.csv#dimension/d-code-list>;
  <http://purl.org/linked-data/cube#dimension> <http://<IP_ADDRESS>/some-qube.csv#dimension/d-code-list> .

See attached for all files concerned.
output.ttl is the result of the stated command above.
https://app.zenhub.com/files/374709947/70f81a88-3027-4b29-830b-5c6c8309cfa2/download
N.B. with URIs like .#dimension/d-code-list we end up with DSD URIs like http://<IP_ADDRESS>/#dimension/a-code-list, but we end up with CSV-derived URIs looking like http://<IP_ADDRESS>/some-qube.csv#dimension/d-code-list. So as long as we consistently point URIs at the CSV file, we shouldn't have any real problems (unless the user renames the file).

Summary:

Relative URIs using fragments get expanded with .csv or .csv-metadata.json in them. Need to try a bit harder in getting an example with content negotiation working.
We can do some stuff with docker to mimic files on a webserver which feels like a more comfortable way of doing the csv2rdf transformation as opposed to a find and replace.

Finally got a bit of a reprex working (which works from within a docker env too so I can use vscode's devcontainer stuff). Here I can host files and set some config through /etc/hosts to mimic the files being available at http://data.gov.uk/.
LOCAL_WORKSPACE_FOLDER=$PWD

docker run \
-v $LOCAL_WORKSPACE_FOLDER:/workspace \
-w /workspace \
--name http-server \
--add-host=data.gov.uk:<IP_ADDRESS> \
-d python:latest \
python3 -m http.server 80

docker run \
-v $LOCAL_WORKSPACE_FOLDER:/workspace \
-w /workspace \
--network container:http-server \
--rm -it gsscogs/csv2rdf \
csv2rdf -u http://data.gov.uk/statistics/df.csv-metadata.json -m annotated -o output.ttl

docker stop http-server
docker rm http-server

So, say we had our CSV and CSVW metadata inside a folder named statistics.
./
├─ statistics/
│  ├─ df.csv
│  ├─ df.csv-metadata.json

Then with a trivial CSV:
one, two, three, four
1,2,3,4

...and CSVW metadata:

{
  "@context": "http://www.w3.org/ns/csvw",
  "url": "df.csv",
  "@id": "example-data",
  "http://ex.org": [
      {"@id": "a"},
      {"@id": "/b"},
      {"@id": "../c"},
      {"@id": "#d"}
  ],
  "tableSchema": {
    "columns": [
      {
        "name": "one",
        "datatype": "integer",
        "propertyUrl": "w"
      },
      {
        "name": "two",
        "datatype": "integer",
        "propertyUrl": "/x"
      },
      {
        "name": "three",
        "datatype": "integer",
        "propertyUrl": "../y"
      },
      {
        "name": "four",
        "datatype": "integer",
        "propertyUrl": "#z"
      }
    ]
  }
}

Then we get the following output:
# jsonld stuff
<http://data.gov.uk/statistics/example-data> <http://ex.org> <http://data.gov.uk/b>,
    <http://data.gov.uk/c>, <http://data.gov.uk/statistics/a>, <http://data.gov.uk/statistics/df.csv-metadata.json#d> .

# csvw stuff
_:bnode__1 <http://data.gov.uk/statistics/df.csv#z> 4;
  <http://data.gov.uk/statistics/w> 1;
  <http://data.gov.uk/x> 2;
  <http://data.gov.uk/y> 3 .

@rossbowen to do a final test to ensure that ../path works inside a 2-deep directory structure (making it more portable than the domain.com/path approach.

Summary is, it's behaving how we may expect any file system to behave.
Folder structure:
./
├─ one/
│  ├─ two/
│  │  ├─ three/
│  │  │  ├─ df.csv
│  │  │  ├─ df.csv-metadata.json

JSON-LD in CSVW:
  "http://ex.org": [
      {"@id": "../a"},
      {"@id": "../../b"}
      {"@id": "../../../c"}
  ],

Columns spec in CSVW:
    "columns": [
      {
        "name": "one",
        "datatype": "integer",
        "propertyUrl": "../x"
      },
      {
        "name": "two",
        "datatype": "integer",
        "propertyUrl": "../../y"
      },
      {
        "name": "three",
        "datatype": "integer",
        "propertyUrl": "../../../z"
      }
    ]

With the following docker command:
docker run \
-v $LOCAL_WORKSPACE_FOLDER:/workspace \
-w /workspace \
--network container:http-server \
--rm -it gsscogs/csv2rdf \
csv2rdf -u http://data.gov.uk/statistics/one/two/three/df.csv-metadata.json -m annotated -o output.ttl

Returns turtle looking like,
<http://data.gov.uk/statistics/one/two/three/example-data> <http://ex.org> <http://data.gov.uk/statistics/c>,
    <http://data.gov.uk/statistics/one/b>, <http://data.gov.uk/statistics/one/two/a> .

_:bnode__1 <http://data.gov.uk/statistics/one/two/x> 1;
  <http://data.gov.uk/statistics/one/y> 2;
  <http://data.gov.uk/statistics/z> 3 .

I'm still prepping an example using content negotiation to see whether it's possible to craft fragment (#) URIs without the .csv in them.

@rossbowen We now have RDF uploaded to PMD. I've left it as-is with the .csv bits still inplace. It would be good to have a firm idea where we're going with these URIs now that we can start uploading real data to PMD.

We've decided that the URIs we're currently using are good enough for now since they allow users to independently publish CSV-Ws with URIs which successfully dereference to a sensible document (the CSV). The RDF definitions of said terms can be generated by locating the conventionally named  JSON-LD metadata file and converting the whole CSV-W to RDF.
We'll look to add support for users being able to request that we define URIs which don't make use of hash fragments so that where they have a suitable server in place, it can return information at the most granular level when the user dereferences a URI.


LP-934

Added link for support, Ticket addressed:
https://philanthropyu.atlassian.net/browse/LP-934

@arslanashraf7 can you please review the latest changes?


Null Safety SDK Stable release

Tracks work associated with achieving feature and performance parity running migrated code against the Null Safe SDK.
This is the release which follows the Beta release ( https://github.com/dart-lang/sdk/issues/41611 )
For issues that is intended for stable release but non-blocking, please see #43928

will support dart mirrors lib?

This is retired as the team has decided not to use Zenhub
Null Safety Stable release replace this epic


[TIR] Add a new intrinsic count leading zeros for LLVM and SPIR-V

This adds a new intrinsic clz to LLVM and SPIRV per discussion in https://github.com/apache/tvm/pull/7669#issuecomment-800465668.
The motivation is to compute integer ceil(log2(x)) without using log2, since SPIR-V doesn't support log2 on fp64. Using this new intrinsic, we can compute integer ceil(log2(x)) as follows:
def ceil_log2(x):
    clz = tvm.tir.clz(x)
    bits = int(x.dtype[-2:])
    ceil_log2 = tvm.tir.if_then_else(x & (x - 1) == 0, bits - clz - 1, bits - clz)
    return ceil_log2

LLVM has ctlz intrinsic which we can use directly. SPIRV doesn't have clz intrin but it does have FindUMsb.
https://llvm.org/docs/LangRef.html#llvm-ctlz-intrinsic
https://www.khronos.org/registry/spir-v/specs/1.0/GLSL.std.450.html
Some discussion points:

The result is defined only for positive integers.
For now I didn't support clz on zero, because the LLVM doc above suggests clz(0) is not well supported by backends. See is_zero_undef argument in the llvm doc for more details.
Do we want to support clz on negative integers?
What about floating point?

@tqchen @junrushao1994 @vinx13 @zxybazh

Good to go? Or any comments on the discussion points above @tqchen @junrushao1994 @vinx13 @zxybazh


Add RAK4631 Custom BLE example

Signed-off-by: Marcio Montenegro<EMAIL_ADDRESS>

@mtuxpe
Thank you.


Issue with @catppuccin_pane_{left,right}_separator background

I have set the following:
set -g @catppuccin_pane_status_enabled "yes"
set -g @catppuccin_pane_border_status "top"
set -g @catppuccin_pane_left_separator ""
set -g @catppuccin_pane_right_separator ""
set -g @catppuccin_pane_middle_separator " █"
set -g @catppuccin_pane_number_position "right"
set -g @catppuccin_pane_default_fill "number"
set -g @catppuccin_pane_border_style "fg=#24273a"
set -g @catppuccin_pane_active_border_style "fg=#24273a"

Looking closely at the picture, you can see a background behind the separator where there should be none.

@onaforeignshore I made a fork and create a tag that works for me...
Install:
set -g @plugin 'guedesfelipe/catppuccin_tmux#1.0.0'
Tag 1.0.0 rollback to commit e80cb735bbcd264ff971fdf7e58b219b60286c81
@vdbe @89iuv Maybe we need to use tags at each changes to not break our envs xD

@guedesfelipe This works for me. Thanks!
before:

after:

I flipped to your fork, and then back to
set -g @plugin 'catppuccin/tmux'
set -g @catppuccin_flavour 'mocha'

and it went from odd background colors back to normal (sorry, neglected to take a screenshot). Thanks for the help!

@vn7n24fzkq If you make an issue with your config I can try to find the problem.
From you screenshots it seems like config 3 with a custom background color and top status bar which works fine.


python3Packages.uptime-kuma-api: 0.13.0 -> 1.0.1

Description of changes

Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
23.05 Release Notes (or backporting 22.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

Result of nixpkgs-review pr 234164 run on x86_64-linux 1

4 packages built:

python310Packages.uptime-kuma-api
python310Packages.uptime-kuma-api.dist
python311Packages.uptime-kuma-api
python311Packages.uptime-kuma-api.dist


Finished home page (kinda)

The home page feels like it still lacks some stuff like photos or descriptions, but the design is pretty much done. One issue I ran into was the footer. The user can scroll past the footer, which is odd (only in specific screen sizes, like my Mac, for example. This issue is not visible on smaller devices)

no cap all im seeing is flames


Draynor floor

Adds a wooden floor to the only house that doesn't have a wooden floor in the town
Master:

PR:

Cleaned up the commits for you. Feel free to do any post-sRGB correction if that was intended btw. I like the change, but let's wait to hear from some more people.


findOne() return type is not consistent

I haven't extensively tested this, but it appears that findOne() returns different types based on the query.
collection.findOne({'attr1': attr1}); returns the document object.
collection.findOne({'$and': [{'attr1': attr1}, {'attr2': attr2}]}); returns an array containing the single document object.
The expected behavior is findOne() returning either an array containing the document or the document object itself, but not both.

Hey Mike, thanks for flagging this. @obeliskos worked a lot on findOne so he might have a good idea of how to resolve this straight away.

I think what's happening is unrelated to the query and instead has to do with indexed/unindexed fields. These are the offending lines, where findOne returns a Resultset array and findOneUnindexed returns a document:
findOne
findOneUnindexed
I'd submit a pull request but I haven't had a chance to dig through the Resultset internals and it seems wrong to just wrap the returned findOneUnindexed doc in an array.

Yea could be the new $and and $or paths which I just added didn't consider findone.  I'll take a look at that tonight.

Thanks for letting me know about this, I think I have fixed it.  Feel free to try out and let me know your results.
I will try to add some test cases for this over the next week so I don't forget about these paths (findOne with $and $or ops).

I have added test cases which verify this code path works (and will continue to work)

Thanks!


desktop app cannot start after installation

Search before asking

[X] I had searched in the issues and found no similar issues.

Operating System

[ ] macOS
[X] Windows
[ ] Linux

Operating System Version
windows11 23h2
It happens on the web browser too?
No, it just happens on the Desktop app
Rocket.Chat Desktop App Version
3.9.15
Rocket.Chat Server Version
6.9.3
Describe the bug
desktop app cannot start after installation
use 4.0.1 3.9.15 Replace the version and install it with the same effect
Currently, only one computer has been found to have this phenomenon
This computer can use Rocket.chat normally through a web browser
How to Reproduce
1, install app
2,open app
3,You can see the process running in the task manager
4，Unable to see any interface display
Describe your Expected behavior
No response
Anything else
No response
Are you willing to submit a code contribution?

[ ] Yes, I am willing to submit a Pull Request!

Does it help to say I have the same issue?  windows 11 pro 23H2; was using rocket 4.0.0 then tried updating to 4.1.1 still same. I WFH and go in to office often and it started one day while in the office was fine in the morning, then after leaving and coming back (had to sign-on after screen lock) no rocket window anymore and tried many things to revive (restart, reinstall, not shown in alt-tab list of apps, not in lower right tray, shows up in task mgr., etc. etc.)

I just tried removing the cache and reinstalling it...

Uninstalled Rocket (using Windows add/remove apps)
cleaned up: (removed):
C:\Users%user%\AppData\Local\Programs\rocketchat
C:\Users%user%\AppData\Roaming\Rocket.Chat
reinstalling with <IP_ADDRESS> msi...

I have a GUI and lost all settings, but I have a GUI... logged in; it is there......
So, during installation, when asked to remove/save profile info, would that have done the same thing?


Firefox 92 on Sway - Menus are invisible and freeze the whole UI

Describe the bug
After upgrading to Firefox 92 on NixOS unstable, anything that requires a menu or a tooltip in the browser (hamburger menu, right click context menus, tooltips on tabs, etc.) stopped working. The menu itself isn't rendered, the whole UI freezes and sometimes the cursor changes to a hand, indicating a clickable button, but nothing happens when clicking where the button should be. Clicking outside the area where the menu should appear restores Firefox to a usable state, until another menu button is pressed.
Steps To Reproduce
Steps to reproduce the behavior:

Open Firefox
Click the hamburger menu button on the top right corner

Expected behavior
The main settings menu for Firefox should appear.
Screenshots
The hamburger button remains in a "clicked" state and the entire UI freezes, the mouse cursor might change to a hand, but no menu is rendered.
Additional context
Running Firefox on Sway with MOZ_ENABLE_WAYLAND=1 and "gfx.webrender.all" = true;
Notify maintainers
@lovesegfault @mweinelt @edolstra @NeQuissimus @vcunat
Metadata
[user@system:~]$ nix-shell -p nix-info --run "nix-info -m"
this path will be fetched (0.05 MiB download, 0.28 MiB unpacked):
  /nix/store/xq77wmzk8d306anyk9rsvl4i4h7ihchw-bash-interactive-4.4-p23-dev
copying path '/nix/store/xq77wmzk8d306anyk9rsvl4i4h7ihchw-bash-interactive-4.4-p23-dev' from 'https://cache.nixos.org'...
 - system: `"x86_64-linux"`
 - host os: `Linux 5.14.2, NixOS, 21.11 (Porcupine)`
 - multi-user?: `yes`
 - sandbox: `yes`
 - version: `nix-env (Nix) 2.4pre20210908_3c56f62`
 - channels(root): `"nixos-21.11pre314199.f6e9e908ccb, home-manager"`
 - nixpkgs: `/nix/var/nix/profiles/per-user/root/channels/nixos`

Maintainer information:
# a list of nixpkgs attributes affected by the problem
attribute:
- firefox
# a list of nixos modules affected by the problem
module:

I can reproduce this too, but I don't think it's NixOS' fault; we ought to report this upstream to sway and Firefox.

https://github.com/swaywm/sway/issues/6426
https://github.com/swaywm/sway/issues/6147

https://bugzilla.mozilla.org/show_bug.cgi?id=1730476

You can manually apply this patch to firefox to fix the issue: https://hg.mozilla.org/integration/autoland/rev/3b856ecc00e4
I'm testing that now.

You should be able to use this overlay to work around the issue for now:
self: super: {
  firefox-unwrapped = super.firefox-unwrapped.overrideAttrs (old: {
    patches = (old.patches or [ ]) ++ [
      (self.fetchpatch {
        url = "https://hg.mozilla.org/integration/autoland/raw-rev/3b856ecc00e4";
        sha256 = "sha256-d8IRJD6ELC3ZgEs1ES/gy2kTNu/ivoUkUNGMEUoq8r8=";
      })
    ];
  });
}

Alright, this overlay fully fixes the issues while we wait on a new release:
self: super: {
  firefox-unwrapped = super.firefox-unwrapped.overrideAttrs (old: {
    patches = (old.patches or [ ]) ++ [
      (self.fetchpatch {
        url = "https://hg.mozilla.org/integration/autoland/raw-rev/3b856ecc00e4";
        sha256 = "sha256-d8IRJD6ELC3ZgEs1ES/gy2kTNu/ivoUkUNGMEUoq8r8=";
      })
      (self.fetchpatch {
        url = "https://hg.mozilla.org/mozilla-central/raw-rev/51c13987d1b8";
        sha256 = "sha256-C2jcoWLuxW0Ic+Mbh3UpEzxTKZInljqVdcuA9WjspoA=";
      })
    ];
  });
}

I'm going to make a PR adding this to our pkg for now.

The two patches applied, menus and form overlays are visible again and the freezing is gone. Thank you @lovesegfault

Unfortunately, it seems the fix has not worked for me. It may be due to using the home-manager module; however, I have overriden its firefox.package to use the patched version and the only noticeable difference is that now a tiny vertical line appears where the context menus should be. The freezing caused by it and the fact that the menu itself is still unusable are still present, though.

There were multiple similar bugs, perhaps?

As a data point: I'm running Firefox 92.0 with the above mentioned patches on Sway on NixOS unstable and everything works great.

 That may be a differentiating factor and may point towards an issue with my home-manager configuration instead.

I have tried to add your method of explicitly wrapping the package and yet, the same behavior remains, unfortunately:
firefox = {
  enable = true;

  package = pkgs.wrapFirefox pkgs.firefox-unwrapped {
    forceWayland = true;
  };

  extensions = with pkgs.nur.repos.rycee.firefox-addons; [
    ublock-origin
    reddit-enhancement-suite
    facebook-container
    multi-account-containers
  ];
  profiles = {
    jmc-figueira = {
      settings = {
        "browser.disableResetPrompt" = true;
        "browser.search.region" = "PT";
        "browser.download.useDownloadDir" = false;
        "browser.download.panel.shown" = true;
        "browser.newtabpage.activity-stream.topSitesRows" = 2;
        "browser.startup.page" = 3;
        "browser.toolbars.bookmarks.visibility" = "never";
        "browser.urlbar.matchBuckets" = "general:5,suggestion:infinity";
        "browser.uidensity" = 0;
        "browser.contentblocking.category" = "custom";
        "devtools.theme" = "dark";
        "dom.security.https_only_mode" = true;
        "dom.security.https_only_mode_ever_enabled" = true;
        "extensions.activeThemeID" =<EMAIL_ADDRESS>        "font.default.x-western" = "sans-serif";
        "fission.autostart" = true;
        "intl.accept_languages" = "pt-pt,pt,eo,en,en-us";
        "intl.locale.requested" = "pt-PT";
        "network.IDN_show_punycode" = true;
        "network.dns.disablePrefetch" = true;
        "network.http.speculative-parallel-limit" = 0;
        "network.http.http3.enabled" = true;
        "network.predictor.enabled" = false;
        "network.prefetch-next" = false;
        "network.trr.mode" = 3;
        "privacy.trackingprotection.enabled" = true;
        "privacy.trackingprotection.socialtracking.enabled" = true;
        "privacy.webrtc.legacyGlobalIndicator" = false;
        "signon.rememberSignons" = false;
        "gfx.webrender.all" = true;
        "media.ffmpeg.vaapi.enabled" = true;
        "media.ffvpx.enabled" = false;
        "media.rdd-vpx.enabled" = false;
      };
    };
  };
};

I wonder if this could differ based on GPU model.  (different rendering code paths on driver side)

Interesting. It is working for me on amdgpu, but I saw the issue yesterday on an i915 gpu, didn't investigate much, whether the patch already made it onto the unstable channel.

Yes, it is in nixos-unstable already but not in nixos-21.05 yet.

I have tested this on amdgpu, nouveau, and i915 without problems.
I'm wondering whether @jmc-figueira  is actually using the patched version? Try to clone the nixpkgs repo, do nix-build -A firefox and see if it works correctly.
Alternatively, this should give you a firefox with the patch so you can make sure:
nix build /nix/store/by39zm9i4vhwd0i5pjnf4apf7lhqmpv9-firefox-unwrapped-92.0 --option binary-caches https://cache.nixos.org

Ah, I managed to reproduce it on i915 now. It's not immediate for me, after a bit the menus seem to break. Amazing.

Maybe we also need this GTK patch: https://gitlab.gnome.org/GNOME/gtk/-/merge_requests/3941

Also worth trying: https://github.com/swaywm/sway/pull/6479

Interestingly, the firefox-unwrapped package in my system has a different hash, namely 9lnp260dpxxpw8vl6psx57adv20i10km-firefox-unwrapped-92.0. Compiling from the nixpkgs repo as you suggested does give me the version with the hash by39zm9i4vhwd0i5pjnf4apf7lhqmpv9-firefox-unwrapped-92.0 as you stated, and this version does behave correctly in regards to the menus. Something really strange is happening with my system updates then. Adding to this, I only got the version with the "black vertical line" as I described above (I attached a screenshot for reference) after I garbage collected a few generations of testing, which really shouldn't happen if I'm understanding the way nix works correctly. In any case, this is not an issue related to the Firefox package itself.

Also worth trying: swaywm/sway#6479

I successfully have this working with firefox from mozilla's pkgs.

So I was able to fix this by removing the firefox-wayland package from my home-manager config and adding it to my nixos-config.
Not sure if this helps anyone here debug the issue, but it's worth a look.

I've been running Firefox out of a local nixpkgs build but I haven't tried messing around with the system config yet since then, I'll try your suggestion.
One thing of note is that some sites' dropdown boxes are still broken, even with the patches, while everything else has been working fine.

I don't know what exactly is wrong but I am getting the random flickers on Firefox 93 as well. Has anybody found a solution?

I still get this issue sometimes. It's odd because it's very hit-or-miss for me; restarting Firefox often fixes it, and restarting it again results in it being "broken" again. The same thing happened for a long time with the screenshot tool in Firefox: sometimes it works, sometimes it doesn't, and restarting Firefox sometimes "toggles" if it does or doesn't work. I haven't been able to debug any further, though.

I think this can be closed as it has been fixed for me since 94 or something.


Add type (warrior/ranger/wizard)  to hero selector modal (Issue #2307)

(Issue #2307)
Now you can also see the type of a hero in the hero selector modal

Ah, very nice! We might have to come up with a slightly tweaked design to gain a little bit more bottom margin on the heroes that also have skill lines, but this is a definite improvement. Thanks!


react-addons: UpdateSpec properties should be optional

Hi. ^_^
According to the documentation: https://facebook.github.io/react/docs/update.html,
UpdateSpec should not require all three options to be set.
E.g. this should be valid:
update(obj, {$merge: {b: 6, c: 7}});

@tugend please send a PR. I'll review it.


Add .gitignore to the generated project

At the moment, when running on windows, there is a problem - the temporary file gitignor is not deleted. There is a bug on the problem https://github.com/foundweekends/giter8/issues/477


Jump Search.cpp

Time Complexity : O(√n)
Auxiliary Space : O(1)
Works only sorted arrays.
The optimal size of a block to be jumped is (√ n). This makes the time complexity of Jump Search O(√ n).
The time complexity of Jump Search is between Linear Search ( ( O(n) ) and Binary Search ( O (Log n) ).
Binary Search is better than Jump Search, but Jump search has an advantage that we traverse back only once (Binary Search may require up to O(Log n) jumps, consider a situation where the element to be searched is the smallest element or smaller than the smallest). So in a system where binary search is costly, we use Jump Search.

Just add the comment here, as a comment in the file. Thanks!

okay


[Fabric] - IOS - Sign in - Unable to log in to sms account via the sms link

If you haven’t already, check out our contributing guidelines for onboarding and email<EMAIL_ADDRESS>to request to join our Slack channel!

Action Performed:

Enter phone number for sign in
Got link in sms message to sign in
Click on link

Expected Result:
Able to add a password and sign in to an SMS account.
Actual Result:
Unable to add a password and sign in to an SMS account.
Workaround:
Unknown
Platforms:

Which of our officially supported platforms is this issue occurring on?

[ ] Android / native
[ ] Android / Chrome
[x] iOS / native
[ ] iOS / Safari
[ ] MacOS / Chrome / Safari
[ ] MacOS / Desktop

Version Number: <IP_ADDRESS>
Reproducible in staging?: NO
Reproducible in production?:
If this was caught during regression testing, add the test name, ID and link from TestRail:
Email or phone of affected tester (no customers):
Logs: https://stackoverflow.com/c/expensify/questions/4856
Notes/Photos/Videos: Any additional supporting documentation
https://user-images.githubusercontent.com/93399543/229158361-638850d8-e44a-4d50-9dc0-4daf82a804c8.mp4
Expensify/Expensify Issue URL:
Issue reported by: Applause - Internal Team
Slack conversation:
View all open jobs on GitHub

Hi! I'll be working on this issue.

Hi! I'll be working on this issue.


[1897] Add course level new page

Context
Allow providers to select the level of a new course.
Changes proposed in this pull request
Adds a ontroller action for continue, view, page object, and feature spec.
Guidance to review
Depends on https://github.com/DFE-Digital/manage-courses-frontend/pull/547, ignore first commit in this.

 [M] Select 'Level' (MCFE)


Use HTTPS to serve the pages

Even if uLogMe runs only locally, it could be nice to have an optional support to HTTPS, with an (untrusted) SSL certificate.

Demo of the HTTPS server

New: the ulogme_serve.sh script is now opening a HTTPS server by default, to port 8443 (looks like 443, the default https:// port),
But everything else works the same.

Additional details?
In this screenshot, we see that firefox tells us a few things:

The page is not truly secure: normal, as the server certificate is generating locally, and so is not automatically trusted by your browser,
But the SSLeuth extension rate 8/10 the quality of the SSL connection: in fact, the SSL is perfect, except for the first issue.

One more trick?
The demo shows the https://ulogme:8443/ page, but it's just a trick:

First, edit your /etc/hosts file to add ulogme as an alias for localhost:

$ sudo nano /etc/hosts
<IP_ADDRESS> localhost  # should already be there
<IP_ADDRESS> ulogme    # added for https://github.com/Naereen/uLogMe/

Then, open the page https://ulogme:8443/ instead of https://localhost:8443/. That's it.


Add license to vivo.owl metadata

What is the motivation for your change request?
The VIVO Ontology needs more metadata to be FAIR, machine-readable and -actionable. This is especially important for the license.
This issue was previously contained in https://github.com/vivo-ontologies/vivo-ontology/issues/22
Describe the solution you'd like
<terms:license rdf:resource="https://spdx.org/licenses/Unlicense.html"/>
The solution has to express the license used in this repository.
Additional context

https://wiki.lyrasis.org/display/VIVO/2024-11-20+Ontology+Interest+Group+Call
https://github.com/vivo-project/VIVO/issues/2875
https://github.com/openrif/community/issues/43

Already there:
https://github.com/vivo-ontologies/vivo-ontology/blob/9d7b75b00d8aa8e94c94f9c8566d65de45347962/vivo.owl#L21