nvcomp LZ4 compression Issue

Hi,
I'm trying to compress a file using the nvcomp LZ4Compressor but ended up gettting file more than the actual size.
Kindly advise what i'm doing wrong.
import os
import cupy as cp
import numpy as np
import kvikio.nvcomp as nvc
import humanize

DTYPE = cp.int32
dtype = cp.dtype(DTYPE)

filename = '/home/arul/Downloads/kjv10.txt'
print('File :', filename, ' Size: ', humanize.naturalsize(os.path.getsize(filename)))
testfile = open(filename).read()
data = np.frombuffer(bytes(testfile, 'utf-8'), dtype=np.int8)

data_gpu = cp.array(data, dtype=DTYPE)
compressor = nvc.LZ4Compressor(data_gpu.dtype)
compressed = compressor.compress(data_gpu)
gpu_comp_file = open('/home/arul/Downloads/kjv10-gpu-compressed.txt.lz4', 'wb')
gpu_comp_file.write(compressed.tobytes())
gpu_comp_file.close()

print('Compressed Size: ', humanize.naturalsize(compressed.size))
del compressor
del compressed

Result:
File : /home/arul/Downloads/kjv10.txt  Size:  4.4 MB
Compressed Size:  17.4 MB

cc @thomcom

Dear guys,
Any help / advise will be greatly appreciated.

and also, when i use CascadedCompressor on the same program, the result is different.
compressor = nvc.CascadedCompressor(data_gpu.dtype)
File : /home/arul/Downloads/kjv10.txt  Size:  4.4 MB
Compressed Size:  5.8 MB

What is the size of the uncompressed memory?
print('Uncompressed Size: ', humanize.naturalsize(data_gpu.nbytes))

Also, is /home/arul/Downloads/kjv10.txt available somewhere?

Hi @madsbk,
I used the same file from the notebook example,
https://github.com/rapidsai/kvikio/blob/branch-22.08/notebooks/nvcomp_vs_zarr_lz4.ipynb
http://textfiles.com/etext/NONFICTION/kjv10.txt
As mentioned above when i use the LZ4Compressor the compressed size is Compressed Size: 17.4 MB & when i use the CascadedCompressor the compressed size is Compressed Size: 5.8 MB. But Actual file size is 4.4MB.
kindly advise if my answer is not clear.
Thanks,

4.4MB is the actual file size on disk, I am wondering what the size of the data (on device) is before compression?

4.4MB is the actual file size on disk, I am wondering what the size of the data (on device) is before compression?

[arul@arul-desktop-01 Downloads]$ md5sum kjv10.txt
582b1be7059586fb01ce75ff51e8e0a3  kjv10.txt

In the following, I set DTYPE = cp.int8 to avoid up-scaling from 8 to 32 bits.
import os
import cupy as cp
import numpy as np
import kvikio.nvcomp as nvc
import humanize

DTYPE = cp.int8
dtype = cp.dtype(DTYPE)

filename = 'kjv10.txt'
print('File :', filename, ' Size: ', humanize.naturalsize(os.path.getsize(filename)))
testfile = open(filename).read()
data = np.frombuffer(bytes(testfile, 'utf-8'), dtype=np.int8)

data_gpu = cp.array(data, dtype=DTYPE)
print('Uncompressed Size: ', humanize.naturalsize(data_gpu.nbytes))

compressor = nvc.LZ4Compressor(data_gpu.dtype)
compressed = compressor.compress(data_gpu)
gpu_comp_file = open('kjv10-gpu-compressed.txt.lz4', 'wb')
gpu_comp_file.write(compressed.tobytes())
gpu_comp_file.close()

print('Compressed Size: ', humanize.naturalsize(compressed.size))
del compressor
del compressed

Which give:
File : kjv10.txt  Size:  4.4 MB
Uncompressed Size:  4.3 MB
Compressed Size:  4.4 MB

However, I don't know enough about the LZ4 compression algorithm to say why it fails compressing the data :/
@thomcom do you know?

I even tried to validate the file encoding right but still compressed file size is of no difference and its corrupted. :(
`import os
import cupy as cp
import numpy as np
import kvikio.nvcomp as nvc
import humanize
import chardet
DTYPE = cp.int8
dtype = cp.dtype(DTYPE)
filename = '/home/arul/Downloads/kjv10.txt'
detector = chardet.UniversalDetector()
for line in open(filename, 'rb'):
detector.feed(line)
if detector.done:
break
detector.close()
print(detector.result)
file_encoding = detector.result['encoding']
print('File :', filename, ' Size: ', humanize.naturalsize(os.path.getsize(filename)))
testfile = open(filename).read()
data = np.frombuffer(bytes(testfile, file_encoding), dtype=np.int8)
data_gpu = cp.array(data, dtype=dtype)
compressor = nvc.LZ4Compressor(data_gpu.dtype)
#compressor = nvc.CascadedCompressor(data_gpu.dtype)
compressed = compressor.compress(data_gpu)
gpu_comp_file = open('/home/arul/Downloads/kjv10-gpu-compressed.txt.lz4', 'wb')
gpu_comp_file.write(compressed.tobytes())
gpu_comp_file.close()
print('Compressed File Size: ', humanize.naturalsize(compressed.size))
print('Compressed data_gpu.nbytes Size: ', humanize.naturalsize(data_gpu.nbytes))
del compressor
del compressed
`

I don't know why the compressor is not reducing the file size of something like the kjv. I'm going to ask around to see who in the C++ group on nvcomp can comment.

Hi @thomcom and @madsbk ,
I tried the C++ example from https://github.com/NVIDIA/nvcomp
With this examples, the results are
$ ./benchmark_lz4_chunked -f /home/arul/Downloads/kjv10.txt
files: 1
uncompressed (B): 4432803
comp_size: 2591439, compressed ratio: 1.7106
compression throughput (GB/s): 0.4120
decompression throughput (GB/s): 1.0734

Thanks @ajs-88, it sure looks like a bug in the nvcomp bindings.

I'm looking at the issue based on the example you shared now @ajs-88

It looks like kvikio is using an older version of nvcomp that isn't compatible with the binaries and examples at NVIDIA/nvcomp. They recently changed their whole distribution scheme. I'll spend some time looking at what updating our version and bindings will take.

It looks like our version of nvcomp has fallen significantly behind the one available at github.com/NVIDIA/nvcomp now. I'll spend some time looking at what updating it will take.

I'm confused as to why our nvcomp bindings work at all, as the current version of nvcomp from github.com/NVIDIA/nvcomp doesn't have the same classes in include/nvcomp/lz4.hpp as the one's that kvikio expects. I also don't see how nvcomp is installed in the kvikio environment. @ajs-88, how did you install nvcomp and kvikio?

@thomcom first of all thanks for looking into it. I downloaded the latest nvcomp library from https://developer.nvidia.com/nvcomp. Then i copied them to /usr/local/cuda [inculde, lib64] respectively.
On https://github.com/NVIDIA/nvcomp examples i followed their building instructions,
https://github.com/NVIDIA/nvcomp#building-cpu-and-gpu-examples-gpu-benchmarks-provided-on-github
On kvikio installation, i followed https://github.com/rapidsai/kvikio#conda .

By chance, what is your CUDA version exactly?

I ask because I'm trying to figure out why the current nvcomp bindings work at all. They are out of date. I found the old versions in cuda-11.0, and for some reason my environment is able to find them (I don't know why, yet).

@thomcom kindly find the details below.
$ nvcc --version
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2022 NVIDIA Corporation
Built on Tue_May__3_18:49:52_PDT_2022
Cuda compilation tools, release 11.7, V11.7.64
Build cuda_11.7.r11.7/compiler.31294372_0

@thomcom Its a RHEL 8.6 fresh installation. All i have is the latest nvcomp library.

Drive-by comment: https://github.com/rapidsai/kvikio/blob/branch-22.08/python/cmake/thirdparty/get_nvcomp.cmake should be updated to use rapids_cpm_nvcomp from rapids-cmake. That will keep kvikio from getting out of sync with the rest of RAPIDS and better ensure that it stays up to date. I believe that there have been a lot of relevant bugfixes/improvements (for cudf) to nvcomp in the last couple of releases.

@vyasr could you please file that as a new issue?

Yup, #106

The good news is that it looks like, at core, the issue is that kvikio installs nvcomp version 2.1.0, which I think has a bug with the LZ4Compressor class and family. In version 2.3.0 LZ4Compressor has been dropped by nvcomp in favor of LZ4Manager. The less good news I think is that the bindings will have to be updated to version 2.3.0 to get rid of the issue.

We'd hoped that the nvcomp team would improve the APIs in 2.1.0, but instead they dropped them.

@thomcom May I request, When can I expect a fix / release on this? Kindly advise

It will take a week or two. I'm starting work on it today or tomorrow. :)

It will take a week or two. I'm starting work on it today or tomorrow. :)

Many Thanks @thomcom

Updated and improved bindings are up for review at https://github.com/rapidsai/kvikio/pull/120


[FLINK-1682] Ported optimizer unit tests from Record API to Java API

This is a step towards removing the deprecated Record API.

Wow, very nice :-) Looks correct from a first glance (I did not thoroughly check everything).
One remark: Since print() may become an eagerly evaluated command in the future, the tests become more robust when using .output(new DiscardingOutputFormat()) as the sink.

Yes, very good point.
I replaced the .print() statements by .output(new DiscardingOutputFormat() as suggested (not only in the ported tests but also some more on the way).

Any objections against merging this PR?
Otherwise, I'll do that tomorrow.


Issue with late uses on fileds

Thank you for taking the time to file an issue!
This tracker is for issues related to:

Dart analyzer and linter

This Issue is in the repository :

Dart language: https://github.com/dart-lang/language

Issue :
The Dart analyzer is not detecting errors for initializing fields by late in the declaration with the value of itself, making Stack Overflow condition. so it needs to disallow the fileds to late initialize by themselves.
example code :
void main() {
MyClass myClass = MyClass();
print(myClass.i);
}
class MyClass {
late int i = this.i;
}

Also this example :
void main() {
MyClass myClass = MyClass();
print(myClass.i);
print(myClass.j);
}
class MyClass {
//Should not allow to initialize by themselves.
late int i = this.i;
// And also should not allow to initialize by others who are dependent on it.
late int j = this.k;
late int k = this.j;
}

An initializer not being self referential is probably a good warning.
I can write a successfull program with a self reference, so it's not necessarily a bug, but I can't find up with any reasonable reason for writing a program like that, so giving a warning unconditionally seems appropriate.

thank you sir for updating the correct title for me :)

Stack overflow is a runtime error. There are lots of ways to write programs with runtime errors, that the analyzer cannot recognize at compiler time.
The analyzer doesn't generally introduce civile time errors, it only reports errors that are specified in the language specification.
And I don't see us trying to catch this error in the specification.
For "this is probably an error"-cases, the analyzer reports a warning. You can always change the diagnostic to an error if you want to.

ok sir, thanks for replying to my issue 😊.

But, the analyzer needs to give a compile time error, not a warning. because the program is crashing due to a stack overflow situation.

According to the late fields specification

If a variable or field is read from during the process of evaluating its own initializer expression, and no write to the variable has occurred, the read is treated as a first read and the initializer expression is evaluated again.

So, StackOverflow in this case is an expected outcome.


[BUG] Bloxstrap broken after being banned

Acknowledgement of preliminary instructions

[X] I have read the preliminary instructions, and I am certain that my problem has not already been addressed.

What problem did you encounter?
So, my brother got banned for a few days from roblox. After logging into a different account, trying to load bloxstrap shows this error.

The issue here is that the roblox desktop app is still logged in using the banned account, so you have to open it, and manually log out. Doing this fixes the issue.
However, this creates another problem. All your roblox settings reset and now, one of the bloxstrap settings doesnt seem to work and I'm not sure how to fix it.

As you can see, the UI is unchanged despite having the setting there and saved correctly.

So, my brother got banned for a few days from roblox. After logging into a different account, trying to load bloxstrap shows this error.

This is an issue with Roblox itself.

As you can see, the UI is unchanged despite having the setting there and saved correctly.

https://github.com/pizzaboxer/bloxstrap/wiki/A-guide-to-FastFlags#escape-menu-version


Missing --webassembly-interpret-all v8 flag

Hello,
Reading the instructions in the README.md file, it says:

In case you need to generate Wasm instruction execution traces for analysis, you can run MineThrottle with the following command.
./chrome --no-sandbox --js-flags="--webassembly-interpret-all" URL
The above command will force Chromium to interpret the Wasm code and generate the log named wasm_dump_*.log.

However, there's no such flag in the code fetched by the ./build_minethrottle.sh script. I could find it neither in the code nor in online searches, and looked into the patches to see if it was implemented there, but found nothing.
Is the VERION variable properly set in the build_minethrottle.sh? Or something wrong in the flag, maybe?
Sincerely,
Bruno Moreira-Guedes

Hi, Bruno,
These JS flags are implemented internally by V8 in chromium/src/v8/src/flag-definitions.h. You may check all available flags for the current version with the command. ./chrome --js-flags="--help"
I hope the above information will help you.


Image Preview not showing

We have followed all the mentioned steps and the example.
After dragging and dropping - the files are added into the <ul class="files"> section.
The preview image is there as background and src in base54 encoded value. But the browser cannot show the image preview. In chrome it gives a warning saying:
Resource interpreted as Image but transferred with MIME type text/html:
I have tested with the src base64 codes into separate html file both as src and background:url(). They works fine.
Can you please shed some light on this - which we are missing?
Thanks in advance.

Everything works in the example using exactly the same image?

Yes :-( it works there.
I have made a copy of the example code in my local and it works there too.

Hmm, it's difficult to diagnose without being able to replicate the issue.
Is there any chance you can share your code, or let me see where you're using it? I'll be able to debug better, and hopefully find the issue... :+1:

Thanks for such prompt reply.
We are using this within a modal (I forgot to mention previously). And we are using angular in twig within symfony framework.
So cannot really upload the whole piece of code as this will be large thing to share.
But still I am trying to share the related piece of code.
Any sort of help will be greatly appreciated.
Thanks.
http://jsfiddle.net/aubks4ka/

It started working after assigning the css class provided in the example:
section.droplet ul.files > li > img.droplet-preview {
    max-width: 5em;
    background-size: cover;
    background-repeat: no-repeat;
    height: 5em;
    width: 5em;
    background-color: white;
    box-shadow: 0 0 10px rgba(0, 0, 0, .25);
    border: 1px solid white;
    display: block;
}

Ah! Simple solution. I'm glad you fixed it! :-1:

Thanks :+1:


Can't download mutliple rows

Hi, I've been using this with no functional problems, but it seems very slow for downloading lots of rows from an external server, I didn't see a way to download mulitiple rows at once, I tried getting the elements from ResultRange by chunks of 100, but that only seems to save ram (compared to using .array), which makes sense if it has to wait before downloading the next row, if there's another way please let me know.

The data is transmitted via TCP, so it moves as fast as the network can go. I have not had any problems downloading tens of thousands of rows. Can you compare to another client with the same query and let me know what the difference is?

Sorry, you're right ,  I forgot to test a few things, I'm using a VPN and l had measured the network speed of the vpn server and mine, but not between both through the VPN and it's a huge difference, the time it takes mysql-native and the mysql command line client is pretty much the same.

Great, thanks for checking!


Use css font loading if It can.

https://github.com/rpgtkoolmv/corescript/issues/19

Reviewed. Nice! :heart:


Simplify Dockerfiles by using the same base image

We have several Dockerfiles in docker directory, but all of them just duplicate the main one (./Dockerfile) and add something small to it.
The idea is to make one base image and use it for all the additional images.
It'll help to keep all Dockerfiles in sync, and will make the process of updating them much easier.

cc @tczekajlo I don't know if it's relevant to your work on dockerfiles 🤷

I can adopt this issue, one issue less to create :D


remove eval

https://github.com/PumPum7/Tatsumaki.py/blob/master/wrapper.py#L22v
There's an eval on this line which is a pretty damn big security issue because it evals anything and everything that cannot be interpreted as json

Fixed with the new version


fatal error: 'malloc.h' file not found

Nice little tool, I received the error: fatal error: 'malloc.h' file not found when i first tried to make the file on my Mac (10.10).  I changed the line from #include <malloc.h> to #include <malloc/malloc.h>
Figured this might help someone

Not quite sure what the change was.

oops, looks like I didn't properly escape the characters:
line4 was:
#include <malloc.h>
changed line 4 to:
#include <malloc/malloc.h>
I thought this might be Mac OS specific so i didn't do a pull request

Excellent, many thanks!

Since you're already including stdlib.h, I think you can just remove the malloc.h include without any problem.
http://stackoverflow.com/questions/12973311/difference-between-stdlib-h-and-malloc-h

how do you make the file malloc.h before make the said changes?

THANK YOU


Scala version used with latest sparklyr (spark version 2.4.0)

Hi,
This is a brief question: The ecosystem I work with has spark 2.4.0 built against Scala 2.12. Does the latest sparklyr (which supports spark 2.4.0) support Scala 2.12? I know it used to support Scala 2.11 but I couldn't find any documentation for that on the newest version.
Many thanks,
Iyar

We don't currently build 2.12 jars (since 2.12 support is experimental in 2.4.) Could you give it a shot to see if it works?

Sure, will do. Thanks!


A11y: Make PDF documents accessible

In order to be accessible, PDF documents need to be navigatable with a screen reader. This requires the existence of a logical structure. Keywords for this are PDF/UA, tagged PDF etc.
See:

[https://pdfua.foundation/de/warum-pdf-ua/|https://pdfua.foundation/de/warum-pdf-ua/|smart-link]
[https://www.w3.org/TR/WCAG20-TECHS/pdf|https://www.w3.org/TR/WCAG20-TECHS/pdf|smart-link]
[^MatterhornProtokoll_1-02-2016-06-29.pdf]

[public] Shopware automated response: This issue is linked to the internal issue: MIG-1076
[created from MIG-1076, comment 503848]


Badly rendered Times New Roman PS

Attach (recommended) or Link to PDF file here:
EMG8 -Cambridge Essentail Gold Maths 8-B 117.pdf
Configuration:

Web browser and its version: Chrome 73
Operating system and its version: ** Macos  10.14.1 **
PDF.js version: 2.2.91
Is a browser extension: No

Steps to reproduce the problem:
1.
Open the PDF (its a single page extracted from a book) and see the badly rendered fonts

What is the expected behavior? (add screenshot)
On any other PDF reader it renders fine:

Link to a viewer (if hosted on a site other than mozilla.github.io/pdf.js or as Firefox/Chrome extension):
Current github pages viewer: https://mozilla.github.io/pdf.js/web/viewer.html
Notes:
We've managed make it work by editing the fonts within the PDF. It is currently "Times New Roman PS", re-rendering it with just "Times New Roman" seems to fix it.
There are no console errors, or any other visible signs of solutions such as missing CMaps.
Unfortunately we are not allowed to alter PDFs, so re-rendering each one is not a viable solution.
If anyone can give any insight into this and a possible solution, that would be massively appreciated 🤠

The PDF defines the same fonts many times. For example, font LULQLP+TimesLTStd-Roman is defined nine times. Each one refers to the same FontDescriptor and the same embedded CFF data stream.
There is a font hash computation in PartialEvaluator.prototype.preEvaluateFont() in core/evaluator.js. It adds entries Encoding, ToUnicode, and Widths in the hash. Some fonts in the PDF get identical hash codes because all the mentioned entries are identical, even Widths. Only entries FirstChar and LastChar differ. If fonts get identical hash codes, could it cause a font to be skipped so that it won't be converted to OpenType?
Here is a reduced PDF that contains two fonts from the original PDF
issue10665_reduced.pdf

There is a font hash computation in PartialEvaluator.prototype.preEvaluateFont() in core/evaluator.js. It adds entries Encoding, ToUnicode, and Widths in the hash. Some fonts in the PDF get identical hash codes because all the mentioned entries are identical, even Widths. Only entries FirstChar and LastChar differ.

Really excellent analysis, thank you; this made the bug easy to fix!

If fonts get identical hash codes, could it cause a font to be skipped so that it won't be converted to OpenType?

In some badly generated PDF files there can be huge amounts of identical fonts, and the purpose of preEvaluateFont was simply to avoid having to load/parse duplicate ones. Hence loadFont will compare hashes, and if possible use an already loaded/parsed font.
Obviously this all hinges on the fact that the hashes are actually correct/unique, but fortunately there's been relatively few bugs in that code over the years.

This is awesome thanks so much for the help!


Improved subversion support for powerline

SVN prompt also when in subdirectories that don't contain .svn
Show correct SVN status for powerline

Great - thanks!
(Sorry for the long delay - I was on vacation for a couple of weeks...)


Fix boolean subsetting with plain list

This fixes the issue that a plain boolean list indexer was always converted to integers and thus selected no more than the first two rows with many duplicates. This was caused by fix #1243 handling only the special case of string list, not boolean list.

[x] Closes #1331
[x] Tests added
[ ] Release note added (or unnecessary)

Seems like @ivirshup was faster:  #1332
Anything in here that wasn’t addressed in that PR?

Thanks for opening a PR here! I have already merged a fix for this however.
I do want to keep the fix I've gone with, as it's closer to the pre-bug code which is more battle tested.

So

Thanks! You're right, your fix is much simpler code. Funny we did the exactly same changes in the tests!

I think copilot may have suggested those lines for me 😅


Armor Piercing attack option

Attacks should have the Armor Piercing advantage as an option.

added in v2.0.4-alpha


fix field inheritance

Fixes #4909
Not sure whether my changes fixes the problem completely or not but at least some more tests are passing now. Let me know what you think and if i should change something.

please review

please update.

please review

awesome, thank so much.


Add multi-package support to homebrew

Signed-off-by: Dan Webb<EMAIL_ADDRESS>Description
Add multi-package support to homebrew
Issues Resolved
#4441
Check List

[x] New functionality includes tests
[x] All tests pass
[ ] RELEASE_NOTES.md has been updated if required (not required for bugfixes, required for API changes)
[x] All commits have been signed-off for the Developer Certificate of Origin. See https://github.com/chef/chef/blob/master/CONTRIBUTING.md#developer-certification-of-origin-dco

This is missing a few things, so it probably isn't worth reviewing just yet 👍

Closing in favor of https://github.com/chef/chef/pull/7982


Code conventions

What
Add code conventions and linters for it.
Why
In case to keep code style protected from new contributors and to keep project code quality at some level.
Todo

[ ] Write down Code conventions into CONTRIBUTING.md file

Consider to use one or few of:

[x] pycodestyle (see #264) (merged PR #267)
[x] pylint (see #261) (see PR #269)
[ ] we-make-python-code-style-guide with flake8 in case it's a plugin for flake8.
[ ] black excludes darker
[ ] darker excludes black

They all can be implemented together as CI-checkers, except black and darker.

"Darker" is much better than "Black". Not too ultimative and prefers single quote string instead of double quotes. As i know @yashaka you like single quotes more than double quotes.


Docker image for Oracle Database <IP_ADDRESS> EE fails to build Step 7/16

Hello,
just run the cmd :
oracle@builder dockerfiles]$ sudo ./buildDockerImage.sh -s -i

i get error in Step 7/16
Step 7/16 : RUN chmod ug+x $INSTALL_DIR/*.sh &&     sync &&     $INSTALL_DIR/$CHECK_SPACE_FILE &&     $INSTALL_DIR/$SETUP_LINUX_FILE
 ---> Running in 8d5fb436b2af
Loaded plugins: ovl
http://yum.oracle.com/repo/OracleLinux/OL7/UEKR4/x86_64/repodata/repomd.xml: [Errno 14] curl#7 - "Failed connect to yum.oracle.com:80; Operation now in progress"
Trying other mirror.
http://yum.oracle.com/repo/OracleLinux/OL7/UEKR4/x86_64/repodata/repomd.xml: [Errno 14] curl#7 - "Failed connect to yum.oracle.com:80; Operation now in progress"
Trying other mirror.
http://yum.oracle.com/repo/OracleLinux/OL7/UEKR4/x86_64/repodata/repomd.xml: [Errno 14] curl#7 - "Failed connect to yum.oracle.com:80; Operation now in progress"
Trying other mirror.
http://yum.oracle.com/repo/OracleLinux/OL7/UEKR4/x86_64/repodata/repomd.xml: [Errno 14] curl#7 - "Failed connect to yum.oracle.com:80; Operation now in progress"
Trying other mirror.
http://yum.oracle.com/repo/OracleLinux/OL7/UEKR4/x86_64/repodata/repomd.xml: [Errno 14] curl#7 - "Failed connect to yum.oracle.com:80; Operation now in progress"
Trying other mirror.
http://yum.oracle.com/repo/OracleLinux/OL7/UEKR4/x86_64/repodata/repomd.xml: [Errno 14] curl#7 - "Failed connect to yum.oracle.com:80; Operation now in progress"
Trying other mirror.
http://yum.oracle.com/repo/OracleLinux/OL7/UEKR4/x86_64/repodata/repomd.xml: [Errno 14] curl#7 - "Failed connect to yum.oracle.com:80; Operation now in progress"
Trying other mirror.
http://yum.oracle.com/repo/OracleLinux/OL7/UEKR4/x86_64/repodata/repomd.xml: [Errno 14] curl#7 - "Failed connect to yum.oracle.com:80; Operation now in progress"
Trying other mirror.
http://yum.oracle.com/repo/OracleLinux/OL7/UEKR4/x86_64/repodata/repomd.xml: [Errno 14] curl#7 - "Failed connect to yum.oracle.com:80; Operation now in progress"
Trying other mirror.
http://yum.oracle.com/repo/OracleLinux/OL7/UEKR4/x86_64/repodata/repomd.xml: [Errno 14] curl#7 - "Failed connect to yum.oracle.com:80; Operation now in progress"
Trying other mirror.

 One of the configured repositories failed (Latest Unbreakable Enterprise Kernel Release 4 for Oracle Linux 7Server (x86_64)),
 and yum doesn't have enough cached data to continue. At this point the only
 safe thing yum can do is fail. There are a few ways to work "fix" this:

     1. Contact the upstream for the repository and get them to fix the problem.

     2. Reconfigure the baseurl/etc. for the repository, to point to a working
        upstream. This is most often useful if you are using a newer
        distribution release than is supported by the repository (and the
        packages for the previous distribution release still work).

     3. Run the command with the repository temporarily disabled
            yum --disablerepo=ol7_UEKR4 ...

     4. Disable the repository permanently, so yum won't use it by default. Yum
        will then just ignore the repository until you permanently enable it
        again or use --enablerepo for temporary usage:

            yum-config-manager --disable ol7_UEKR4
        or
            subscription-manager repos --disable=ol7_UEKR4

     5. Configure the failing repository to be skipped, if it is unavailable.
        Note that yum will try to contact the repo. when it runs most commands,
        so will have to try and fail each time (and thus. yum will be be much
        slower). If it is a very temporary problem though, this is often a nice
        compromise:

            yum-config-manager --save --setopt=ol7_UEKR4.skip_if_unavailable=true

failure: repodata/repomd.xml from ol7_UEKR4: [Errno 256] No more mirrors to try.
http://yum.oracle.com/repo/OracleLinux/OL7/UEKR4/x86_64/repodata/repomd.xml: [Errno 14] curl#7 - "Failed connect to yum.oracle.com:80; Operation now in progress"
http://yum.oracle.com/repo/OracleLinux/OL7/UEKR4/x86_64/repodata/repomd.xml: [Errno 14] curl#7 - "Failed connect to yum.oracle.com:80; Operation now in progress"
http://yum.oracle.com/repo/OracleLinux/OL7/UEKR4/x86_64/repodata/repomd.xml: [Errno 14] curl#7 - "Failed connect to yum.oracle.com:80; Operation now in progress"
http://yum.oracle.com/repo/OracleLinux/OL7/UEKR4/x86_64/repodata/repomd.xml: [Errno 14] curl#7 - "Failed connect to yum.oracle.com:80; Operation now in progress"
http://yum.oracle.com/repo/OracleLinux/OL7/UEKR4/x86_64/repodata/repomd.xml: [Errno 14] curl#7 - "Failed connect to yum.oracle.com:80; Operation now in progress"
http://yum.oracle.com/repo/OracleLinux/OL7/UEKR4/x86_64/repodata/repomd.xml: [Errno 14] curl#7 - "Failed connect to yum.oracle.com:80; Operation now in progress"
http://yum.oracle.com/repo/OracleLinux/OL7/UEKR4/x86_64/repodata/repomd.xml: [Errno 14] curl#7 - "Failed connect to yum.oracle.com:80; Operation now in progress"
http://yum.oracle.com/repo/OracleLinux/OL7/UEKR4/x86_64/repodata/repomd.xml: [Errno 14] curl#7 - "Failed connect to yum.oracle.com:80; Operation now in progress"
http://yum.oracle.com/repo/OracleLinux/OL7/UEKR4/x86_64/repodata/repomd.xml: [Errno 14] curl#7 - "Failed connect to yum.oracle.com:80; Operation now in progress"
http://yum.oracle.com/repo/OracleLinux/OL7/UEKR4/x86_64/repodata/repomd.xml: [Errno 14] curl#7 - "Failed connect to yum.oracle.com:80; Operation now in progress"
Removing intermediate container 8d5fb436b2af
The command '/bin/sh -c chmod ug+x $INSTALL_DIR/*.sh &&     sync &&     $INSTALL_DIR/$CHECK_SPACE_FILE &&     $INSTALL_DIR/$SETUP_LINUX_FILE' returned a non-zero code: 1
There was an error building the image.
[oracle@builder dockerfiles]$

Yum cannot reach the yum server. This is most likely because of a corporate firewall, etc. If you have an internet proxy, make sure to use that one. It is as simple as setting export http_proxy=<your proxy inclusive port> and then kick off the build script. You can also test by just typing yum list and see what yum tells you, before kicking off the build.

Hello,
the problem is due to misconfiguration of docker env proxy setting
the docker build command accept proxy setting using this format :
ENV http_proxy=<IP_ADDRESS>:3128
ENV https_proxy=<IP_ADDRESS>:3128
the error was because i have used the docker service env
/etc/systemd/system/docker.service.d/http-proxy.conf
[Service]
Environment="HTTP_PROXY=http://<IP_ADDRESS>:3128"
Environment="HTTPS_PROXY=https://<IP_ADDRESS>:3128"
i think that docker build don't accept proxy with http://
thanks

Thanks @DevITILOps, does that mean that your problem is now solved? If so, please close the issue.
Thx,

I am see the same issue however i can do a wget and it works so the issue does not appear to be with the proxy settings


wandb.Image() doesn't accept 3d array

The generator in the Keras MNIST GAN example outputs numpy arrays with shape (, 28, 28, 1). If you try to log them in the most convenient way the wandb.Image constructor fails:
    wandb.log({'examples': [wandb.Image(i) for i in gen_imgs]})

Traceback (most recent call last):
  File "./train.py", line 245, in <module>
    main()
  File "./train.py", line 236, in main
    sample_images(generator)
  File "./train.py", line 187, in sample_images
    wandb.log({'examples': [wandb.Image(i) for i in gen_imgs]})
  File "./train.py", line 187, in <listcomp>
    wandb.log({'examples': [wandb.Image(i) for i in gen_imgs]})
  File "/Users/adrian/src/wandb-core/frontends/client/wandb/media.py", line 31, in __init__
    self.to_uint8(data), mode=mode or self.guess_mode(data))
  File "/Users/adrian/.pyenv/versions/3.6.0/envs/wandb-3.6/lib/python3.6/site-packages/PIL/Image.py", line 2436, in fromarray
    raise ValueError("Too many dimensions: %d > %d." % (ndim, ndmax))
ValueError: Too many dimensions: 3 > 2.

hi, i met the same issue. do you know how to solve it?
thanks!


using a post callback route as shown in the readme doesn't work

The Readme gives the example of how to configure your rails app by adding
post '/auth/:provider/callback', to: 'sessions#create'

But this is the route that is called back to after you've been authenticated with the provider. This will be a GET method from Google (and I assume most others).
Configuration

Provider Gem: omniauth-2.0.1
Ruby Version: 2.6.6
Framework: rails
Platform: macOS

Expected Behavior
When following the documentation in the README on how to configure your routes.rb, omniauth should work as expected.
Actual Behavior
Auth requests fail with No route matches [GET] "/auth/google_oauth2/callback"
Steps to Reproduce
Configure a new rails app with omniauth, omniauth-rails_csrf_protection, and omniauth-google-oauth2
add the following route: post '/auth/:provider/callback', to: 'sessions#create
attempt to auth via Google

Have you registered the callback on the provider?

Yes, this was a previously working provider. Google doesn't offer any option (that I can see) to set the method that should be used during callback in the redirect_uri. There is also nothing specified in their documentation.

If your provider issues a GET callback, then use the GET callback route.
get '/auth/:provider/callback', to: 'sessions#create
The POST changes in OmniAuth 2.0 are for the request phase, and should not affect the callback phase.

If your provider issues a GET callback, then use the GET callback route.
get '/auth/:provider/callback', to: 'sessions#create
The POST changes in OmniAuth 2.0 are for the request phase, and should not affect the callback phase.

Are there providers that have a POST callback? Google certainly doesn’t and unless Facebook has recently changed, that is a GET as well. My suggestion is that the readme should be updated to reflect the most common use cases.

Are there providers that have a POST callback? Google certainly doesn’t and unless Facebook has recently changed, that is a GET as well. My suggestion is that the readme should be updated to reflect the most common use cases.

Either that, or try this:
match '/auth/:provider/callback', :to => 'sessions#create', :via => [:get, :post]

Worth noting as well that mock callback requests, as generated in integration tests when running in test mode, also use GET with no obvious way of changing to POST, so such tests fail when specifying a POST-only callback route. Is there a way to get POST callbacks in test mode?

 Where do I see which route is available?

There are several options to see what routes are available for a rails application. But in summary

visit http://localhost:3000/rails/info/routes
execute bin/rails routes on the terminal in your project's root directory

Maybe I should have asked in a more descriptive way. rails routes shows me routes, but does not show me the routes for omniauth. When I plugin in omniauth-steam I am able to POST to /auth/steam but this route is not show when I am using rails route.
And the question is, how do I get the list of available routes?

Got it, hopefully this explains it a bit better
See the Integrating omniauth into your application. The route you're adding to your routes.rb is
post '/auth/:provider/callback', to: 'sessions#create'

In this case the :provider is a dynamic segment that makes whatever appears after the /auth/ and before the /callback available as a parameter to omniauth. Omniauth uses this parameter to lookup the provider you're trying to auth with.
This typically appears in an initializer with a line like
provider :steam, "app-id", "secret"

but you can customize it by adding an additional entry to the hash like
provider :steam, "app-id", "secret" , name: gamer

Which would then create an auth route for auth/gamer/callback. This comes in handy when you want to use the same provider in multiple ways.

This issue was addressed in commit 898be28

That commit didn't actually change the problem — the README instructs us to put a post route into our routes file but the actual callback workflow yields a GET 🤔


Microsoft 365 Business, E3 ou E5

Activation impossible de Windows 10 sur une nouvelle machine (free DOS).

Détails du document
⚠ Ne pas modifier cette section. C’est obligatoire pour docs.microsoft.com ➟ Liaison des problèmes GitHub.

ID: dd18b4c7-1c71-916d-cb5c-8322903e8ed5
Version Independent ID: 7b4c1663-1b1a-2952-7bf8-b0cb724013af
Content: Activation d’abonnement Windows10
Content Source: windows/deployment/windows-10-subscription-activation.md
Product: w10
Technology: windows
GitHub Login: @greg-lindsay
Microsoft Alias: greglin

@officedocsbot assign @jvsam

Online translation:

Windows 10 cannot be activated on a new machine (free DOS).

Hi @aymenkalboussi thanks for bringing this to our attention. From the information you have provided, I   understand that you are on E3/E5 and is trying to use the Subscription Activation feature but it doesn't work? If that's the case and your issue doesn't have anything to do about the content of this documentation, I suggest that you please open a service/support ticket in your tenant to get immediate assistance.
This site is intended to help improve the quality of the technical documentation of Microsoft Docs through user contributions and feedback. If you have suggestions related to this documentation or ideas to make it better for users, please let us know here and we will submit them for review.

Hi again @aymenkalboussi, I just want to follow-up if you were able to contact Windows 10 Support regarding your concern? Let us know if the resolution is something that can be called out in the docs. If your issue is related to the content of this documentation, please provide more information. We always strive to give users the best Windows 10 experience by ensuring that contents of the Microsoft Docs are useful, accurate and up-to-date. Thank you.

Hi again @aymenkalboussi, we haven't heard or received any updates from you. We are hoping that the information we shared helped point you to the right direction to get assistance. We will now close this issue, however, feel free to re-open if you have suggestions or ideas to improve the quality of this documentation.
Thanks for being part of the Microsoft Docs community!

@officedocsbot close


Failed to patch object

Which project are you reporting a bug for?
kr8s
What happened?
Hello, I am having an issue patching a new_class object I created. I have this Gateway:
$ k get gw app-gw -oyaml
apiVersion: networking.istio.io/v1beta1
kind: Gateway
metadata:
  annotations:
    meta.helm.sh/release-name: app
    meta.helm.sh/release-namespace: app
  creationTimestamp: "2024-02-28T17:28:58Z"
  generation: 2
  labels:
    app.kubernetes.io/managed-by: Helm
  name: app-gw
  namespace: app
  resourceVersion: "9079973"
  uid: a69eacd7-8ee1-4e29-9d96-1a2a9c18a4f4
spec:
  selector:
    istio: ingressgateway
  servers:
  - hosts:
    - test.com
    port:
      name: tls-passthrough
      number: 443
      protocol: TLS
    tls:
      mode: PASSTHROUGH

Using kr8s I want to patch it to edit its host from test[.]com to new-host[.]com
>>> import kr8s; from kr8s.objects import new_class;
>>> new_class(kind="Gateway", version="networking.istio.io/v1beta1", namespaced=True, asyncio=False)
>>> gw = kr8s.get("gw")[0]
>>> gw.raw['spec']['servers'][0]['hosts'][0]
[{'hosts': [['test.com']], 'port': {'name': 'tls-passthrough', 'number': 8443, 'protocol': 'TLS'}, 'tls': {'mode': 'PASSTHROUGH'}}]
>>> patch = gw.raw
>>> patch['spec']['servers'][0]['hosts'][0] = 'new-host.com'
>>> gw.patch([{"op": "replace", "path": "/", "value": patch}], type="json")
>>> gw.raw['spec']['servers'][0]
{'hosts': ['new-host.com'], 'port': {'name': 'tls-passthrough', 'number': 8443, 'protocol': 'TLS'}, 'tls': {'mode': 'PASSTHROUGH'}}

But when I run again k get gw app-gw -oyaml, the hostname hasn't changed in the object. Am I missing something ?
Anything else?
No response

Sorry for the late reply, I kept trying to patch my Gateway, and it seems like the problem is the "path" param in the patch command.
Using path: "/" it does not work, but doing something like this gw.patch([{"op": "replace", "path": "/spec", "value": patch['spec']}], type="json")
Something weird, is that it does not work when running it as a python script (but does patch correctly when I run the commands from python prompt), with a runtime warning :
/home/mathieu/run.py:171: RuntimeWarning: coroutine 'APIObject.patch' was never awaited
  collector_gw.patch([{"op": "replace", "path": "/spec", "value": gw_spec}], type="json")

Update : i found this PR https://github.com/kr8s-org/kr8s/pull/340 that seems to fix my issue, updating to latest version fixed the bug, closing, the issue.
Thanks

Ah yup that makes total sense. Glad things are working for you now.


[release/v1.17] listener: match rebalancer to listener IP family type

Commit Message:
Cherry-pick of 19e7879ddacebea93ad54217406f2b9263bbc03c into release/v1.17. It is not enabled by default, but instead the user must choose to opt-in.
Additional Description:
When getting a rebalancer by address and a wild card match is being
used, the first match in the list is returned. However, if there are
listeners with addresses "<IP_ADDRESS>" and "::" then the first active
listener found will be used, irrespective of the IP family type. Change
the behavior to always return the listener of the same IP family type as
the rebalancer.
Risk Level: Low
Testing: Unit tests added to demonstrate that code path is unchanged unless option is enabled
Docs Changes: Added
Release Notes: Added
Platform Specific Features: N/A
[Optional Runtime guard:] envoy.reloadable_features.listener_wildcard_match_ip_family (not turned on by default)
Fixes: #16804
Co-authored-by<EMAIL_ADDRESS>Signed-off-by: Jacob Delgado<EMAIL_ADDRESS>

cc @ycai-aspen @nrjpoddar @ggreenway @lambdai
I'm not sure about Envoy's policy regarding cherry-picks. Hopefully this is able to be merged into 1.17. Let me know what I can do to get this merged in.

looks like The build failure is due to pip import failing to retrieve kafka's network filter dependency MarkupSafe-1.1.1: it gets an unexpected checksum. I verified it manually and I'm getting the same checksum too.

I opened a PR to resolve the build failure: https://github.com/envoyproxy/envoy/pull/17263

Please merge in 1.17 to pick up the build fix

Not sure what the current build failure is, seems like an issue running a qemu command?  cc @phlax @dmitri-d if either of you know what's going on

/retest

...if either of you know what's going on

its hard to tell from the logs - im guessing a transient failure - i think the qemu part is just the prefix to the running command - so im thinking its not qemu related in any way
hopefully it will pass retest

cc @dmitri-d @snowp Anything else I need to do to get this merged?


When caching adapters, cache the adapter ID + the API token pair

Feature request
When we cache adapters, we should cache the adapter ID + the API token pair. Even if the adapter is already on GPU memory, we should ensure that the caller has access to it by maintaining a cache of adapter ID + api token pairs.
Motivation
Otherwise, we could get situations where one users calls prompt w/ a private HF hub adapter and HF key, it works and is cached, then another user could call prompt w/ the same adapter without setting a HF api token in the request. Since the adapter is cached, the request works.
Your contribution
I can try to implement it, but I am quite busy so not sure when I can get to it.

hello, I would like to work on this.

Hey @safimuhammad - wanna chat on discord for next steps on this?

@magdyksaleh  Sure, here's discord user name msafi38

hey @magdyksaleh , reaching you out on discord, lets discuss next steps on this.


The Readme link on the latest release goes to a 404 page

https://github.com/Ryan-DowlingSoka/RedTechArtTools/releases/tag/v1.1.3
Is https://github.com/Ryan-DowlingSoka/RedTechArtTools/blob/v1.1.3/github.com/Ryan-DowlingSoka/RedTechArtTools/readme.md
Should probably be https://github.com/Ryan-DowlingSoka/RedTechArtTools/blob/main/README.md

Thanks! Good find.
Close, but the actual desired address is: https://github.com/Ryan-DowlingSoka/RedTechArtTools/blob/v1.1.3/README.md because it is best if the releases are linked to the readme from that same release.


community[fix] - in FAISS vector store, support passing custom DocStore implementation when using from_xxx methods

Description: The from__xx methods of FAISS class have hardcoded InMemoryStore implementation and thereby not let users pass a custom DocStore implementation,
Issue: no referenced issue,
Dependencies: none,
Twitter handle: ksachdeva

thank you @ksachdeva!


Added documentaion about load balancer using docker and nginx

Description
Please describe your contribution:

Checklist

[x] I have added proper documentation for my contribution.
[x] I have added myself in contributors.json.
[x] My contribution isn't already present in the repository.
[x] My contribution is working.
[x] My changes don't generate any new warnings.
[ ] My changes don't affect any work done by other developers.

To tick a box, replace [ ] with [x].

it should be good now? @ashutoshkrris


passthrough probe-rs features to parent crates

I was trying to dynamically link libusb, but currently the parent crates of probe-rs, such as probe-rs-rtt, do not pass-through these features.  I thought resolver version 2 was supposed to fix this, but with this in Cargo.toml libusb will still end up statically linked; there is still some sort of feature unification going on.
[package]
name = "testing"
version = "0.1.0"
edition = "2021"
resolver = "2"

[dependencies]
probe-rs = { version = "0.13", default-features = false }
probe-rs-rtt = "0.13"

I also added this to the binary packages because probe-rs based binaries are being distributed in Linux package managers where dynamic linking is preferred.

Thanks for this! I think if you rebase the CI should pass. Also I think libusb will now automatically chose the vendored version if it cannot find any systems libraries, which is why it is not enabled by default anymore on master.

CI was failing because of this issue, because it was vendoring by default: https://github.com/a1ien/rusb/issues/141
I'll repush it to retrigger CI.

Also I think libusb will now automatically chose the vendored version if it cannot find any systems libraries.

It will, but probe-rs overrides that with a default "vendored-libusb" feature, and because of feature unification crates that do not re-expose this feature will vendor libusb.

"which is why it is not enabled by default anymore on master."

I missed this part reading on my phone, sorry :sweat_smile:
Thanks for the fix!


Supply helm release names when helm installing

Would be more beneficial to use an example release name that's clear devs should replace so when they copy i don't create a generated random release name called something like "dozing-greyhound", etc.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 12009c1f-282d-2632-fac0-64b09c432833
Version Independent ID: 6052d3d4-d295-9340-b16d-4c200e34cd73
Content: Create an HTTP ingress controller with a static IP address in Azure Kubernetes Service (AKS)
Content Source: articles/aks/ingress-static-ip.md
Service: container-service
GitHub Login: @iainfoulds
Microsoft Alias: iainfou

@cmeyertons that's valid feedback. We generally work on these quick starts to allow customers to try the product with as few steps/ commands as possible. That being said, I understand if you are working with it you might not want a weird random release name :)
@iainfoulds maybe we should add a note on how to set a specific release name if desired?

Thanks for the feedback. That does make sense, but it's also not the default behavior that ensures there shouldn't be overlap with any existing resources deployed. That's why there's a random naming convention, and we don't clash with existing resources.
For others referencing this and like the named approach, you can add the --name parameter to the helm install commands and specify a preferred name.
When these docs come up for freshness updates, I'll review updating this, and others, to use named release names if we can be sure it won't cause additional problems.
@MicahMcKittrick-MSFT For now, #please-close

Okay, although I would argue using good practices in the docs (such as naming your releases for maintainability) outweighs brevity.
To newbies, it could encourage bad practice. To intermediate/experts, it lowers trust in the docs that they are written with best practices in mind. Just food for thought.
Thanks,
Carl Meyertons

On Dec 14, 2018, at 5:57 PM, Micah<EMAIL_ADDRESS>wrote:
Closed #18598.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or mute the thread.


Can i get a full mask from one image

nice work!
Does this project support the image inference for get a mask like deeplabv3
Sent from PPHub

The detected result is actually binary mask for segment object.
 auto mask = nanosam.predict(image, { promptPoint }, labels);
For Example:

like sam the everything method ， without promptpoint，it can get this mask picture

It doesn't support everything method.

It doesn't support everything method.

copy that and i will close this issue ，Many thanks for your repo！！！


feat: Update scExpression docs to reflect tissue roll up

Need

To update scExpression docs to indicate how tissues are being aggregated into high-level tissues.
[Optional] if it does not affect readability, a tissue mapping table could be included

@pablo-gar is this work complete? Can we close this ticket?

Done as of 9/26!


Govee Curtain support?

Hello, just wondering if this project supports Govee Curtains as well - and if so, does it (or will it if not) enable proper addressing and mapping?
The way the current Govee desktop Dreamview app works, the  mapping is not very robust - and you can only assign areas of the screen to entire strip sections of lights - which for obvious reasons isn't optimal and gives a sub-par effect (one really has to wonder why Govee would go this route?).
It would be AMAZING if you could make these be able to be addressed and mapped on a per led basis (which is how Govee should have done it!)

Unfortunately, I don't think Govee allows controlling the lights on a per led basis :(
Maybe if you could control the lights another way, but I've only been able to do so with the built-in LAN control and API.
In the future, I may try something a bit more cheeky to see if I can back-engineer the lights

Would love to see it, I think something like that would be quite popular.
It seems strange to me that would be the case - I'm almost certain it's only a software limitation on Govee's end,, but haven't looked into it myself.
I mean, you can create a layered gif and send it to the curtains, have it play - you can download other peoples gifs, upload gifs, etc. - but for some reason it wouldn't be possible to address them that way with custom software?
I don't think that is right actually, because both the Govee desktop software and the mobile app allow to send to individual LED's in their apps.
The only thing that doesn't allow it is the 'Dreamview' part of the software, which let's you map your PC screen to the lights.
If you could figure this out, you'd be a personal hero of mine - it's absolutely ridiculous they don't allow it out-of-the-box.

Wish I had my own curtains to test it out.
I have the hex panels, which technically you can control the individual LEDs on, but the API is broken. Been working with Govee support to get it fixed.
If I can get that working, then it should be possible to control the curtains in a similar way (mapping areas of the screen to individual LEDs), but knowing the Govee API, it likely wouldn't be super responsive. I wish they'd add the capability to control individual LEDs through LAN (would make it much faster), but so far you can only change the color of the entire thing.


Allow switching of an identity's preferred locale

Dep https://github.com/SURFnet/Stepup-Middleware/pull/81

:bomb: @DRvanR

:bell: @DRvanR

Added a wee change.

As discussed, please move the form etc. to the stepup-bundle, not really something for an ApiClient[bundle] :wink:

:sparkles: @DRvanR

:+1:


Expanded InputConfigurator permissions checks to include Namespace.READ

Currently, InputConfigurator.validatePermissions only checks whether the user has Table.READ permission. However, access may also be allowed if the user has Namespace.READ instead. This expands the check to pass if either permission is present. This resolves #1370 .

When merging forward, a similar change may need to be made in the new mapreduce code.


Catalog item AWS ELB 'max 20 ELB' issue

Rancher Version:
1.2.2
OS and where are the hosts located? (cloud, bare metal, etc):
AWS, rancherOS
Environment Type: (Cattle/Kubernetes/Swarm/Mesos)
Cattle
Steps to Reproduce:
Have 20+  ELBs in AWS region where you want to work with Rancher ELB catalog app (that should dynamically update particular ELB instances list pointing to where services deployed)
Results:
Has AWS SDK error during startup (seen in logs)
time="2017-01-05T11:37:53Z" level=error msg="Failed to update provider: Failed to get LB configs from provider: Failed to lookup load balancer tags: DescribeTags SDK error: ValidationError: 1 validation error detected: Value '[..._about-40-our-other-ELBs_..., rancher-lb-test]' at 'loadBalancerNames' failed to satisfy constraint: Member must have length less than or equal to 20\n\tstatus code: 400, request id: 65289bf1-d33b-11e6-a205-d32380b90303"

Expected:
Catalog item to work, and update ELB instances list.
(the item is:  rancher/external-lb:v0.2.1 )
The issue is with "DescribeTags"  SDK command used in this catalog item probably, discussed here:  https://github.com/aws/aws-sdk-go/issues/717
quoting from that thread, the related post of @raphtheb  (thanks for sharing solution @raphtheb ! )
The problem actually laid in the 'DescribeTags' call instead of the 'DescribeLoadBalancers' call, from first glance.

Turns out that the API call: elb.DescribeTags(...) only allows for 20 loadbalancers worth of tags to be queried at once. This limitation is not described anywhere in the AWS SDK documentation, nor the source code.

http://docs.aws.amazon.com/sdk-for-go/api/service/elb/#example_ELB_DescribeTags

After being puzzled for the longest time, found myself on the API doc itself for the ELB service and it was actually documented there instead: http://docs.aws.amazon.com/ElasticLoadBalancing/latest/APIReference/API_DescribeTags.html

how we can solve this?   can I submit a pull request if i find how to fix it?

@Dmitry1987 A PR is most welcomed if you find a solution to this issue.

@Dmitry1987 The fix should be done in the DescribeLBTags() method
https://github.com/rancher/external-lb/blob/master/providers/elbv1/elbv1svc/elb_classic.go#L62
you probably need to make an extra API call for every additional set of 20 load balancers.

thanks @janeczku , I'll try to find the time to check this.
btw, when you're developing some parts of rancher, or catalog items like this one, how to test it?  i will recompile, rebuild docker image and upload to my own docker repo, then use my custom URLs in manifest/spec files that run it, is that correct way to work on such things, or may you share some tips/tricks?  :)    which IDE do you use? (i use Atom for small golang stuff, for now just wrote a few handy cli tools we use at work. but never worked with large projects)

@janeczku  I've read some of the code, want to ask if it's necessary to pass "all ELBs in region" to getTags here:
	allNames := make([]string, len(allLb))
	for i, lb := range allLb {
		allNames[i] = *lb.LoadBalancerName
	}
	lbTags, err := p.svc.DescribeLBTags(allNames)

or we can limit this "list" of names first, to only those ELBs that need our management?  because some may have 500+ ELBs in their accounts... (I just found out we have around 150 in one region :) )

+1 on this issue. Just tried using the catalog item for the first time and started getting this error.

Hi @Dmitry1987 , thank you for the very detailed solution.
I have made a simple change to fix it.
Would you mind having a try?
you can update the image id of elbv1 service to registry.cn-hangzhou.aliyuncs.com/logan/external-lb:5bcb3a0.

Thanks @loganhz , but we're not using Rancher at the moment. Definitely it'll be useful for all others who run ELB :)

@loganhz rancher/external-lb:v0.3.3 has been released for this fix.

Tested with rancher-server version- v1.6.10 with rancher/external-lb:v0.3.3
Test passed.


Cleaner ui for admin, repo settings, and user settings page (#1269)

~I will post a video after I test it.~ https://transfer.sh/EYam0/newui.mp4
Please review this asap, because many templates have been modified, and I do not want any conflicts
\cc @bkcsoft @tboerger @lunny @strk

I'm testing it right now

LGTM (merge is blocked until alpine fixes their shit 😉 )

@strk or @bkcsoft Can you merge this now?

Only owners can merge it :(

Oh, and "team maintainers" (@andreynering and @metalmatze) - I shall note that role (team maintainers) is not mentioned in the CONTRIBUTING file, so it's not really clear how they are elected (please feel free to file an issue to discuss this)

The owners or the team maintainers may invite the contributor.

@strk That role is mentioned, but not in any length, please make an issue 😉

fixed #1269

See:

Close attention to Organisations.

@Fastidious US writes "organisations", UK writes "organizations". #NotABug 😂

@bkcsoft sorry, it is about the icon too close to the word, not the spelling of it.

#offtopic
@bkcsoft you have it backwards, American English: organizations, British English: organisations
http://writingexplained.org/organisation-vs-organization-difference
For a second I thought I had been spelling it "wrong" my whole life, same with grey and gray, I never know which one I am supposed to use... English = Annoying

@plessbd thanks for the contribution. 😂 I wasn’t pointing out the spelling of a word, as explained above, but the fact that the Organizations’s icon is too close to the word itself.

@Fastidious Ooh that explains it 😆 In any case, I think it's just the icon being broken. Should probably be fixed though 🙂

Speaking of the new ui I did, GitHub just changed their search to a horizontal nav.

Damn, we lost the advantage ! :)


Enhancement:  1v1 me

1v1 me on any game

It is not place to talk, it is place to report issue, imposter

amoung us


[excel] (Rich API) Remove obsolete references to relationships

This change also tries to better document behavior around structs such as DataValidation.prompt and PageLayout.zoom.

Docs Build status updates of commit 950e48f:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docs/excel/excel-add-ins-advanced-concepts.md
:white_check_mark:Succeeded

docs/excel/excel-add-ins-core-concepts.md
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


Escaping $ in TBLFM doesn't work as with yasnippet

Hi,
Could you please elaborate in the README how I might define TBLFM including the usual $ characters in formula that survive expanding?
The yasnippet documentation suggests escaping dollar signs with one backslash.
Example
Snippet Definition
I'm currently playing around with following draft snippet (not tested yet):
#+TBLNAME: `(my-capture-prompt "Please enter a unique ID (or ISO datestring)" 'my-id)`-`(my-capture-prompt "Please enter the foreign currency as normal characters (USD)" 'my-currency)`-EUR-rate
|   | *100 `(my-capture-insert 'my-currency)`* | *100 `(my-capture-insert 'my-currency)` in EUR* | *Factor*   |
|---+------+------+------------|
|   |   100 | `(my-capture-prompt "Please enter the value of 100 foreign currency as €" 'my-100currency)` | $0 |
| ^ |        |     | `(my-capture-insert 'my-currency)`toEUR |
#+TBLFM: `(my-capture-insert 'my-currency)`toEUR=@2\$3/@2\$2

|     *When* | *Who* | *How*      | *What*               | *`(my-capture-insert 'my-currency)`* | *EUR* |
|------------+-------+------------+----------------------+-------+-------|
| 2018-01-03 | Karl  | Mastercard | Taxi Seattle Airport | 25.00 | 19.12 |
|------------+-------+------------+----------------------+-------+-------|
|            |       |            |                      |       | 19.12 |
#+TBLFM: @>\$6=vsum(@I\$6..@II\$6);%.2f::\$6=if("\$5" == "nan", \$6, \$5*remote(`(my-capture-insert 'my-id)`-`(my-capture-insert 'my-currency)`-EUR-rate,\$`(my-capture-insert 'my-currency)`toEUR));E%.2f

Expanded Snippet
After expanding, I get:
#+NAME: 2019-05-24-YEN-EUR-rate
|   | *100 YEN* | *100 YEN in EUR* | *Factor* |
|---+-----------+------------------+----------|
|   |       100 |         0.811659 |          |
| ^ |           |                  | YENtoEUR |
#+TBLFM: YENtoEUR=@2/@2

|     *When* | *Who* | *How*      | *What*               | *YEN* | *EUR* |
|------------+-------+------------+----------------------+-------+-------|
| 2018-01-03 | Karl  | Mastercard | Taxi Seattle Airport | 25.00 | 19.12 |
|------------+-------+------------+----------------------+-------+-------|
|            |       |            |                      |       | 19.12 |
#+TBLFM: @>=vsum(@I..@II);%.2f::=if("" == "nan", , *remote(2019-05-24-YEN-EUR-rate,$YENtoEUR));E%.2f

... which has broken TBLFM lines wherever $ was used.
Switching to \\$ or getting rid of the escaping did not help either.
So how is this done with yankpad properly?
Versions Used
I'm currently using following versions:

yas--version 0.11.0
yankpad-1.6

Version might be old since I am using conservative repositories and seldom do upgrades:
(add-to-list 'package-archives '("melpa" . "http://stable.melpa.org/packages/"))
(add-to-list 'package-archives '("org" . "http://orgmode.org/elpa/"))
(add-to-list 'package-archives '("gnu" . "http://elpa.gnu.org/packages/"))

Hi! If I understand correctly, the problem is that the \$ are removed when expanding the snippets?
I tried with a less complex one:
| Student  | Maths | Physics | Mean |
|----------+-------+---------+------|
| Bertrand |    13 |      09 |      |
| Henri    |    15 |      14 |      |
| Arnold   |    17 |      13 |      |
#+TBLFM: \$4=vmean(\$2..\$3)

And this expands into:
| Student  | Maths | Physics | Mean |
|----------+-------+---------+------|
| Bertrand |    13 |      09 |      |
| Henri    |    15 |      14 |      |
| Arnold   |    17 |      13 |      |
#+TBLFM: $4=vmean($2..$3)

This seems correct to me. I have yas--version 0.13.0 and the latest yankpad version. Perhaps try upgrading?

Hi,
I upgraded to yasnippet-0.13.0 (yankpad was up to date) and this seems to have fixed the issue.
Sorry for the fuzz and thanks for the quick confirmation that the error is on my side.
FYI: My snippet seems to work as expected after fixing the first TBLFM to #+TBLFM: @2\$4=@2\$3/@2\$2. Somehow, the named variable field using this way was not updated when invoking C-u C-u C-c C-c.


UI-Grid edit issue with custom template.

I have one column with custom edit template with drop-down (select) html:
When i am trying to edit the cell it works good, but when i am done with edit and clicks on other cell it should exit from edit mode and it should make cell non editable again.
However after scrolling edited cells exits edit mode.
Grid should behave like default drop-down template
Here is the Plunker with issue on pet column:  http://plnkr.co/edit/IrUVRjv4XSp48V27LjsO?p=preview

Why not use the dropdownEditor template for your own dropdown?  You need extra event bindings to make sure that the cell switches modes after the user selects a value and dropdownEditor adds that for you. Otherwise you'll have to write your own dropdown directive for that.

I tried to use dropdown editor but had few issues to bind dynamic values from $scope. and also I want to do some custom edit template those are different from default dropdown template. so I decided to go for custom template.  could you please help me to know how to do extra event binding or directive to solve my issue.

@c0bra @PaulL1 Please guide me with this issue.

@Ashish, I am facing similar issue. I had to use custom directive. Can u please let me know how did u solve the issue?


APP-172: GPIO app was moved from ant to gradle and updated

@kaa-leeroy test this please

@kaa-leeroy test this please

@kaa-leeroy test this please

@maxml pls, review


Account banned after a game.

I tested a few accounts since Jun and one of my account got banned after a match today. This account only played 11 rounds of match in July and I got the ban message a few hours after the match ended. Is it possible that the automatic operation mode of the current MSC script will be detected when directly communicating with the server.

If they could detect the script, then other accounts, including my test account, should have been banned as well.
And, MSC doesn't directly communicate with the server, but directly call clickHandler() for player actions (dapai, chi, tsumo, ron and etc...) .
I suspect that the script fell into unexpected behavior (such as calling clickHandler() too many times, or try to discard a tile on other player's turn) due to unstable communication with the server.
Did you see what was happening on that match?

Since akochan didn’t respond, I discarded a card manually, and Endpoint also discarded a card.

The situation is somewhat similar to the picture above, but two tiles are lost in the middle of the match before the account got banned.

OK. I will add code to prevent MSC from discarding tile on other player's turn.


napari plugin preview workflow

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 52.62%. Comparing base (6a2a3fe) to head (882de23).

Additional details and impacted files
@@            Coverage Diff             @@
##           master       #7      +/-   ##
==========================================
- Coverage   52.65%   52.62%   -0.04%
==========================================
  Files          42       42
  Lines        5762     5762
==========================================
- Hits         3034     3032       -2
- Misses       2728     2730       +2

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

No, the preview action is deprecated now and cannot be used (but there is still old documentation around referring to it, which is why I tried it here) https://github.com/chanzuckerberg/napari-hub-preview-action


Unclear error message when writing GPU_CORE_FREQUENCY_MAX_CONTROL below GPU_CORE_FREQUENCY_MIN_CONTROL

Describe the bug
I tried to change the gpu frequency by writing GPU_CORE_FREQUENCY_MAX_CONTROL and neglecting to write GPU_CORE_FREQUENCY_MIN_CONTROL. When doing so within an agent, I expect an error message that indicates which control was not written successfully. Instead, I observed the following error message:
Error: <geopm> Runtime error: BatchClient::write_batch The server is unresponsive: at src/BatchClient.cpp:96
On the command line, when writing GPU_CORE_FREQUENCY_MAX_CONTROL via geopmwrite, the error message is also undescriptive:
> geopmwrite GPU_CORE_FREQUENCY_MAX_CONTROL board 0 1.0e9

Error: cannot write control: <geopm> Invalid argument: PlatformIOImp::write_control(): no support for control name "GPU_CORE_FREQUENCY_MAX_CONTROL" and domain type "10"
The following errors were observed:<geopm> Runtime error: SDBus: Failed to call sd-bus function sd_bus_call_method(), error:-5 name: not.known.Error.RuntimeError: geopm_pio_write_control() failed: <geopm> Invalid argument: PlatformIOImp::write_control(): no support for control name "GPU_CORE_FREQUENCY_MAX_CONTROL" and domain type "10"
The following errors were observed:<geopm> Runtime error: LevelZero::frequency_control: Sysman failed to set freq: at src/SDBus.cpp:32
: at src/PlatformIO.cpp:832

GEOPM version
2.0.0+dev346g72bd6b69
Expected behavior
A clear error message, such as Error: LevelZero::frequency_control: Cannot set max frequency below min frequency.
Actual behavior
An undescriptive error message regarding BatchClient, when attempting to write the control via the agent, and an error message regarding lack of control support on the domain type when attempting to write the control via geopmwrite on command line.
Error messages produced
Debug messaging was not enabled.

Without the service there is error messaging indicating that an INVALID Argument is provided.
# geopmwrite GPU_CORE_FREQUENCY_MAX_CONTROL board 0 1.0e9
Error: cannot write control: <geopm> Invalid argument: PlatformIOImp::write_control(): no support for control name "GPU_CORE_FREQUENCY_MAX_CONTROL" and domain type "10"
The following errors were observed:<geopm> Runtime error: LevelZero::frequency_control: **Sysman failed to set frequency. Level Zero Error: ZE_RESULT_ERROR_INVALID_ARGUMENT**: at src/LevelZero.cpp:906
: at src/PlatformIO.cpp:832

With service (as user) the entire error message is not provided.
> geopmwrite GPU_CORE_FREQUENCY_MAX_CONTROL board 0 1.0e9
Error: cannot write control: <geopm> Invalid argument: PlatformIOImp::write_control(): no support for control name "GPU_CORE_FREQUENCY_MAX_CONTROL" and domain type "10"
The following errors were observed:<geopm> Runtime error: SDBus: Failed to call sd-bus function sd_bus_call_method(), error:-5 name: not.known.Error.RuntimeError: geopm_pio_write_control() failed: <geopm> Invalid argument: PlatformIOImp::write_control(): no support for control name "GPU_CORE_FREQUENCY_MAX_CONTROL" and domain type "10"
The following errors were observed:<geopm> Runtime error: LevelZero::frequency_control: Sysman failed to set freq: at src/SDBus.cpp:32
: at src/PlatformIO.cpp:832

Duplicate of
https://github.com/geopm/geopm/issues/2887

After discussion, the preferred solution here is to a retry loop in the write_batch() of LevelZeroIOGroup similar to the logic that exists in the NVMLIOGroup.  The goal is to retry setting controls if anything fails.


Test Ruby Agent with Rails 7.0 RCs

Please run our agent tests on Rails 7.0 RCs.

[x] Create issues from the errors that we find.
[ ] Provide initial t-shirt sizing to these errors.

I'll work with @tannalynn to size the Rails 7.0.0.rc1 raised issue: #881


[SDA-7429] Going through all policies to check upgrade

Related issue: https://issues.redhat.com/browse/SDA-7429
What
Some of the policies were not upgraded but are not being considered when checking
Why
Check was ending prematurely
#Changes
Prerequisites
Run the command once, remove the newly created role and it's policy from aws. Now all operator policies will be up to date but one. Run the command again, check if the policy got recreated and the recreated role also has it attached.
./rosa upgrade operator-roles -c [sda-7429](https://issues.redhat.com//browse/sda-7429) --version=4.10.40
I: Starting to upgrade the operator IAM roles and policies
? Operator IAM role/policy upgrade mode: auto
? Upgrade the operator role policy to version 4.11? Yes
I: Upgraded policy with ARN 'arn:aws:iam::123:policy/sda-7429-openshift-ingress-operator-cloud-credentials' to version '4.11'
I: Upgraded policy with ARN 'arn:aws:iam::123:policy/sda-7429-openshift-cluster-csi-drivers-ebs-cloud-credentials' to version '4.11'
I: Upgraded policy with ARN 'arn:aws:iam::123:policy/sda-7429-openshift-cloud-network-config-controller-cloud-credent' to version '4.11'
I: Upgraded policy with ARN 'arn:aws:iam::123:policy/sda-7429-openshift-machine-api-aws-cloud-credentials' to version '4.11'
I: Upgraded policy with ARN 'arn:aws:iam::123:policy/sda-7429-openshift-cloud-credential-operator-cloud-credential-op' to version '4.11'
I: Upgraded policy with ARN 'arn:aws:iam::123:policy/sda-7429-openshift-image-registry-installer-cloud-credentials' to version '4.11'
? Create the 'sda-7429-j9m3-openshift-cloud-network-config-controller-cloud-cr' role? Yes
I: Created role 'sda-7429-j9m3-openshift-cloud-network-config-controller-cloud-cr' with ARN 'arn:aws:iam::123:role/sda-7429-j9m3-openshift-cloud-network-config-controller-cloud-cr'
I: Waiting for operator roles to reconcile

/lgtm


Support default parameters in method invocations

Hi,
if required parameters of a method were omitted they were filled with null values to match the method signature. This approach did not allow to define default values on method parameters as they were overridden by the null values. Instead we now check first if omitted trailing parameters have default values and use these instead.
Thanks!

The test failure seems to be related to the RunIsolatesTest test. It's passing locally...


Maintainability status

Thank you for this great package.
i'm not trying to rush you, don't get me wrong but there are some open issues and pull requests preventing me from migrating to this package.
is there any specific time when these will be resolved?

Hello @saif-o99
Some of them might be outdated. Can you paste here the links of the issues and PRs that interest you?
I believe starting from september I will be more active.

I believe starting from september I will be more active.

Happy to hear that! .
these are some :
https://github.com/LunatiqueCoder/react-native-media-console/issues/26
https://github.com/LunatiqueCoder/react-native-media-console/issues/60
https://github.com/LunatiqueCoder/react-native-media-console/issues/78
but generally, Please try to close the Issues and the PRs that aren't valid / no in the package scope. it makes the package look much maintanable seeing fewer issues. 👍🏻

I can help if you need any help

I'm back. Started to cleanup issues and pull requests.


fix(Rule): automaticOptionalFacetFilters take the same input as automaticFacetFilters

Unless the documentation is wrong, the type should be the same.
(that also means there is no test for this use case)

thanks @bodinsamuel !


Add a warning message that import dir does not exist in downloadOsmNe…

…tworkData
Closes: #739

Let's do this instead of #740


Activation of global install bins are overwriting the path, affect program like pueue add

Checks

[x] I have checked that this issue has not already been reported.

[x] I have confirmed this bug exists on the latest version of pixi, using pixi --version.

Reproducible example
pixi global install "pueue" -c dnachun -c conda-forge
pueued -d #start deamon
export PATH="TEST:$PATH" # or pixi shell in another project
pueue add env
pueue log -f 1 | grep PATH # will get wrong PATH

Issue description
May like #133. pixi global will overwrite PATH and CONDA_PREFIX(no affect this example), so the actual execuable will get wrong PATH variable.
Maybe provide a way to expose binary without activation, and maybe use symbol link.
Expected behavior
not overwrite or just append necessary paths to PATH variable.

Thanks for the issue. We'd be open to a --no-activation option. Just haven't gotten around implementing it yet

@Hofer-Julian  didn't we discuss to keep the path dynamic? We could easily react to PATH changes without changing the rest of the logic

@Hofer-Julian didn't we discuss to keep the path dynamic? We could easily react to PATH changes without changing the rest of the logic

Yes, that is indeed the more elegant solution for this specific problem

It seems break many things, like pixi global make. When use make, it can't found binary in current PATH.

Seems fixed in v0.38.0


Ensure order is tracked by default

This PR sets the order_tracked property to true by default, but for files that already exists, attempts to leave the property in the way it found them

[x] Closes Issue https://github.com/h5netcdf/h5netcdf/issues/128
[x] Tests added

[x] Basic file appending
[x] Editing a variable that already existed
[x] Adding a new variable in netcdf4 and reading it n h5netcdf (and vice versa)

[x] Changes are documented in CHANGELOG.rst

@hmaarrfk Unfortunately the black style check doesn't show the diff. Apart from that LGTM.

Great! Excited to see this in!

@hmaarrfk Thanks! I'll leave this open a couple of days to give @shoyer the chance to chime in.

Sorry for rebasing. I added the suggested error behavior and updated the tests to match it.
I also added a test to ensure that the error behavior is as expected.

I know you tagged this for a 1.0 release, though I know those are always contentious. Do you think it is possible to have a release before then?

@hmaarrfk I think it does no harm to release 0.13 after merging this.
Although there is a lot of effort to push 1.0 forward, it might take another while.

0.13 after merging this.

Would you like me to update the text to indicate that this will come in version 0.13.0+ explicitely?

1.0 forward, it might take another while.

I totally understand mental blocks that exist before major versions.

Would you like me to update the text to indicate that this will come in version 0.13.0+ explicitely?

That would be much appreciated, thanks.

Thanks again @hmaarrfk. I see that this is your first time contribution to h5netcdf. You are very welcome.


Spatial Regulariser

Hi, did you add the Spatial Regulariser in this code, I can't  find it

Hi,
As written in README, spatial regulariser isn't added.

OK，thank you！

Thank you for your interest!


Controller for dynamic model between steps

Is your feature request related to a problem? Please describe.
I'm now trying to learn a model to produce action(a) given the current state(s) and next state(s') between steps without the prior knowledge of the car dynamic model used in SMARTS. I wonder whether it is possible to provide a controller based on the car dynamic model with the same function? That will help me a lot.
Describe the solution you'd like
A simple PID controller for example. It would be better if the controller can distinguish the unreachable state.
Describe alternatives you've considered
N/A
Additional context
N/A

Please take a look at the action spaces currently supported by SMARTS.
If your issue persists or for other questions, consider opening a new issue.


1.5.0 rc1

Codecov Report

Merging #144 into master will decrease coverage by 0.02%.
The diff coverage is 0%.

@@            Coverage Diff             @@
##           master     #144      +/-   ##
==========================================
- Coverage   25.12%   25.09%   -0.03%
==========================================
  Files          59       59
  Lines        5768     5774       +6
==========================================
  Hits         1449     1449
- Misses       4196     4202       +6
  Partials      123      123

Impacted Files
Coverage Δ

apps/core0/subsys/containers/manager.go
0% <0%> (ø)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update fb1d7e9...df1ff4d. Read the comment docs.


Develop alt text guidance for images on DS website

[x] Produce guidance for writing alt text for site
[x] Update template
[x] Provide examples

Guidance on alt text added to the alt text spreadsheet.

Guidance for writing alt text is available in the spreadsheet under the tab "Guidance for writing alt text".
Component documentation template will be updated accordingly. We are looking at adding content string patterns to standardize alt text.


Evidence codes for GO synapse projects

Umbrella ticket for addition of evidence codes for GO synapse project.  Equivalent umbrella ticket on Synapse github: geneontology/synapse#2

Thanks! Ready for new term requests.

On Aug 31, 2015, at 12:15 PM, David Osumi-Sutherland<EMAIL_ADDRESS>wrote:
Umbrella ticket for addition of evidence codes for GO synapse project. Equivalent umbrella ticket on Synapse github: geneontology/synapse#2
—
Reply to this email directly or view it on GitHub.


Question about generating audio (longer than 10s)

Hi, thanks for your sharing!  I want use the pre-trained model to generate audio longer than 10s, but i don't know how to achieve it? could you please give me some suggestions? Thanks a lots!

In google colab, it is
W_scale (int > 0): the output sound duration will be W_scale * 9.8 seconds
In the streamlit demo, it is
“temporal scale”

Hi, thanks for  sharing! i want to train a codebook which can generate much longer sound, do you have any clue?

Hi, the current codebook supports arbitrary length input. You can already generate audio of any length

May I ask if my video is 45 second, can the model directly generate 45 seconds audio, or do I need to first generate audio with 9.8*5=49s, then trim the audio to 45s?

May I ask if my video is 45 second, can the model directly generate 45 seconds audio, or do I need to first generate audio with 9.8*5=49s, then trim the audio to 45s?


Location based

Hi,

“Working with Mapbox’s new React Native AR SDK gave us a great toolkit to experiment with showcasing our POIs in a location-based AR experience, and explore the future of what POIs could look like.”
-Peter Krasniqi, VP Global Enterprise & Business Development, Foursquare

This article: blog.mapbox.com/introducing-native-ar says which is possible to display a POI (point of interest) using your SDK Mapbox ar.
We are creating currently a mobile application of travelling and we want to purpose to see a leisure activities from the camera in AR.
For this, we have a latitude and a longitude of a point of interest like a restaurant and we would like to display the POI in our app like in the article.
Is it really possible to achieve this with react-native-mapbox-ar?
Do you provide a sample for location-based AR experience?
The conversion lng/lat into xyz and rotation is auto generated by your SDK?
If it's not, do you have another tool for this?
Thanks you so much for your answer.

@loic-lopez we do have an internal branch that we have been using to create POI demos that we will be working on merging into master.
If you need any guidance with the mathematics and what libraries you can use to accomplish this on your own please feel free to ping me in https://gitter.im/react-native-mapbox-gl and I can help point you in the right directions.
I'll leave this ticket open for now incase others have this same question.

Hello !
Any ETA for POI in here? @nitaliano

Hi!
Any news on this?
Looking for the similar solution - display POI label over the place in AR mode

Hello !
Looking for similar solution .Any updates on this location based AR experience ?

@nitaliano

@loic-lopez we do have an internal branch that we have been using to create POI demos that we will be working on merging into master.
If you need any guidance with the mathematics and what libraries you can use to accomplish this on your own please feel free to ping me in https://gitter.im/react-native-mapbox-gl and I can help point you in the right direction.
I'll leave this ticket open for now incase others have this same question.

Can you show me how to convert from longitude coordinates, latitude to XYZ coordinates on Viro AR?

@nitaliano

@loic-lopez we do have an internal branch that we have been using to create POI demos that we will be working on merging into master.
If you need any guidance with the mathematics and what libraries you can use to accomplish this on your own please feel free to ping me in https://gitter.im/react-native-mapbox-gl and I can help point you in the right direction.
I'll leave this ticket open for now incase others have this same question.

Can you show me how to convert from longitude coordinates, latitude to XYZ coordinates on Viro AR?


Change status when the lease has expired.

When my service has crashed or killed -9 I would like to see that it is in DOWN status.
Currently when the lease has expired, the service can be evicted from the service registry. It happens when you configure enableSelfPreservation=false.
I would like to not evict the service from the registry, but instead change the status to DOWN.
This feature could be configured by new config parameter like goDownWhenLeaseExpired.

Eureka has pretty complex configuration already, and we prefer not adding more properties to it. What you are requesting here, could be implemented in a more generic way as:

disabling heartbeats (not supported)
overriding current status (supported)

Heartbeats/lease are essential concept in Eureka. Self preservation was provided to protect from loosing registry content during network failures or peer node crashes. You could try to set self preservation to 100%, which ideally would prohibit any node to be evicted. You can than override instance status with REST API call PUT /eureka/v2/apps/appID/instanceID/status?value=DOWN.

In my case, my service has already crashed. Therefore, the service is not able to change the status using REST API.
My service is written in Java. I have already registered a JVM shutdown hook which changes the status of my service to DOWN. The problem is that when the service was not stopped gracefully the shutdown hook is not executed.
In my case the only thing that Eureka server knows is that it has stopped receiving heartbeats. I would like this to be interpreted as the service is DOWN.

This behavior would require bigger changes in the code, and is not directly in line with Eureka architectural principles.
What you want to achieve here is better handled by the health check poller mechanism. This is an external monitoring service that periodically calls each server of your fleet at a well know endpoint (Eureka provides healtcheck URL field for that in InstanceInfo), and if there is no successful reply marks an instance as down.
If you look at karyon3 (https://github.com/Netflix/karyon/tree/3.x), it provides a framework for application health evaluation + REST endpoint.

I would like this to be interpreted as the service is DOWN.

Leaving aside Eureka internals, how would you use this DOWN status differently than the instance not being available in Eureka registry?

I have already implemented my own poller mechanism which is setting the status to down when there are no heartbeats. As I start Eureka server using spring boot, I have direct access to eureka registry.

I have already implemented my own poller mechanism which is setting the status to down when there are no heartbeats.

So, all servers that do not send an explicit remove, will stay in eureka registry forever?


Round to nearest with ties to even

In conversions from f32 or f64 to f16, instead of rounding to nearest with ties rounded away from zero, now ties are rounded to even. This can be achieved using only one extra mask check for normal numbers, using a method explained in an inline comment. (For subnormals, round_bit is not a constant so it is slightly more expensive, but normals should be the common case.)
Some redundant checks for zero/subnormals were removed as they are perfectly handled by the underflow condition.
Also, when converting NaNs, the most significant 10 bits of the mantissa are retained, then the most significant bit of the mantissa is set. This is similar to what happens when converting an f32 NaN to f64, where the most significant 23 bits of the NaN mantissa are retained, then the most significant bit of the mantissa is set.
Fixes #24.

This should also be done for bfloat16, that is round to the nearest with ties to even. I left it undone till now so that if there are any review issues they won't be repeated uselessly.


💥 [DevOps] Backup/Restore Authentik

💥 DevOps
If we want to use our previous user accounts for in a deployment like #1451 we need to be able to export these user accounts and groups and restore them to a different authentik instance.
This is the equivalent of a backup/restore of Authentik. Have we ever tested that? (A backup strategy that has not been tested, is not a backup strategy).
Implementation details
There are two ways to accomplish this:

A dump of postgresql
Export all objects as blueprints with ak export_blueprint, See docs

In both ways, we produce a file that needs to be downloaded. We need SSH access to download this file. Someone who has got SSH access already needs to publish the public SSH keys of the team to https://auth.dreammall.earth.

@roschaefer is this still a thing?

@roschaefer is this still a thing?

We talked in our pair-programming about this. It's still a thing for the currently used authentik instance. Maybe you can arrange SSH access for authentik on Friday.

We discussed this internally. I was able to download and restore user accounts to a local authentik instance. I've sent a README.md in our discord (because we don't want to publish it). This can be closed.


Enable Segmentation Configuration in Objectron

Hi,
The documentation shows the following image where the detected object is also segmented. But I can not see any enable_segmentation flag. How can I achieve the following results?

Hi @kXborg ,
could you please check this document for more information.

Hi @sureshdagooglecom,
Thanks for responding but that document is for the MediaPipe Pose solution not .  I can not see this API in Objectron docs. The point is, it's not included in the  itself. But since the output is being shown in the docs, I was wondering if we can achieve that by using a few modifications.

Hi @kXborg ,
We have python solution available API  available for objectron , Please check this document for more information.

Hi @kXborg ,
MediaPipe solutions do not include an object segmentation model.  It sounds like an interesting project.  We believe that object segmentation models do exist outside of MediaPipe.  Please let us know if you find useful approaches for this problem.


"applyingMessages" to "message" is better

It is compatible for TextLintMessage

https://github.com/textlint/textlint/blob/master/docs/formatter.md#result-of-fixing

Breaking Change, but anyone not use this.

6.0.1-0
a210ad8


the Output image size?

Original image and heatmap  are inconsistent in size
why???

Heatmap size is dictated by the network. As this network is not
fully-convolutional it outputs a fixed size heatmaps. Heatmap can be
resized to original image.
Thanks and Regards
Adi
On Thu, Apr 4, 2019 at 4:56 AM ByYourSide<EMAIL_ADDRESS>wrote:

Original image and heatmap are inconsistent in size
why???
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/iamaaditya/image-compression-cnn/issues/13, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AB008rvWkYN4xB05aNYDBBW3g9JkOGXEks5vdb46gaJpZM4ccRQT
.

How to adjust it? Do you adjust during training or during testing

You do not have to adjust it. Just resize the heatmap to the size of the
image.
Thanks and Regards
Adi
On Fri, Apr 5, 2019 at 11:46 AM ByYourSide<EMAIL_ADDRESS>wrote:

How to adjust it? Do you adjust during training or during testing
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/iamaaditya/image-compression-cnn/issues/13#issuecomment-480325096,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AB008oEJ2ouBdy640yGI4IdlI47OSvZkks5vd2_agaJpZM4ccRQT
.

But after this adjustment, the content of the heat map and the content of the original map is not a corresponding one. In other words, there is no corresponding heat map output in the original picture

Then probably your image is too large and with different aspect ratio. Can
you crop your image to the correct aspect ratio, so that after resizing all
the objects are in the same region?
Thanks and Regards
Adi
On Fri, Apr 5, 2019 at 11:51 AM ByYourSide<EMAIL_ADDRESS>wrote:

But after this adjustment, the content of the heat map and the content of
the original map is not a corresponding one. In other words, there is no
corresponding heat map output in the original picture
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/iamaaditya/image-compression-cnn/issues/13#issuecomment-480326689,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AB008s92Ugc18PEMoHZxdf1HLN9msCwAks5vd3DygaJpZM4ccRQT
.

Thanks
What is the aspect ratio that your project supports? As an aside, I don't think deep learning does a good job of compressing images. It's not nearly as good as Jpeg, like Google. What do you think?

I am not sure but I think it supports square image (1:1). What do you mean
it is not better than JPEG. This project uses JPEG to compress images. So
it should be at least as good as standard JPEG.
Thanks and Regards
Adi
On Fri, Apr 5, 2019 at 11:57 AM ByYourSide<EMAIL_ADDRESS>wrote:

Thanks
What is the aspect ratio that your project supports? As an aside, I don't
think deep learning does a good job of compressing images. It's not nearly
as good as Jpeg, like Google. What do you think?
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/iamaaditya/image-compression-cnn/issues/13#issuecomment-480329072,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AB008pWw7bQcPd6Da5uoE1B_WwXAr_klks5vd3J9gaJpZM4ccRQT
.

I just can't guarantee that my input image will produce a heat map of the same size, can I say that? And, as far as you know, there are other GitHub projects that generate heat maps


Fix: set policy CMP0144 to old behavior

Set CMNP0144 behavior to old.
It is really just a hack

Tested on coder with CUDA enabled. @neil-glydways it should be good to merge once you test it

Thanks!  I think we'll want to target glyd-master.  @jortega0, can you review and merge this into glyd-master if all is well?

Thanks! I think we'll want to target glyd-master. @jortega0, can you review and merge this into glyd-master if all is well?

@neil-glydways it looks like this is the fast_gicp library submodule and we don't have a glyd-master here

@jortega0 it is fine to cherry-pick this commit and the one from Anibal that adds CUDA as a language as cmake 3.27 breaks these.


Details on how to add new environment variables

I wanted to make it more clear for new devs who are not usually deal with environment variables and might tend to skip this step if they don't know how to use it.

The use of environment variables in the README is meant to be somewhat arbitrary, going to leave it up to devs as to how they would like to implement their variables based on whatever framework they're using.


Add keybinds for rotating and flipping objects

About the PR
Adds keybinds for rotating and flipping objects. Previously this was only accessible via the context menu.
Why / Balance
It was really frustrating to use and took way too much time if you were moving atmos devices.
Technical details
Works exactly the same as with the verbs.
I also fixed a few bugs:

the flip verb no longer shows up when anchored
the popups for anchored rotatable entities are actually used now

Media

(video is a little laggy because I did this on my notebook)
https://github.com/user-attachments/assets/9b9b71fe-81aa-430f-b7b6-d24cf12dcf78

[x] I have added screenshots/videos to this PR showcasing its changes ingame, or this PR does not require an ingame showcase

Breaking changes
none
Changelog
:cl:

add: Added new keybindings for rotating and flipping objects. The defaults are R for clockwise, Shift+R for counterclockwise and F for flipping.

make the new code predicted plz

For rotating this should be possible, but flipping deletes and spawns a new entity. I thought we cannot predict that? Maybe I can find a way to reuse the old one. Also I should probably add a small cooldown to both.

make the new code predicted plz

For rotating this should be possible, but flipping deletes and spawns a new entity. I thought we cannot predict that? Maybe I can find a way to reuse the old one. Also I should probably add a small cooldown to both.

guess it's fine for now.


App and DSU Supported Characters

PL user story:
Description:
The App and the DSU need to be able to manage the following characters as per the GS1 General Specification.

Sample Codes

Acceptance criteria's:
positive tests

Create a batch and serial numbers with special characters.
Scan the Datamatrix code and get the ePI.

negative tests / error path testing

N/A

Process scenario:

N/A

Additional information:
Refer to the GS1 General Specification for addition details.

It is possible to create a product with product code like !%*=&"?-+<.! and create a batch with a standard  batch number (e.g. TK1213). 🟢

t is possible to create a product with a standard product code<PHONE_NUMBER>3838 ) and create a batch with batch ID like !%*=&"?-+<.!. 🟢

However, when trying to create a 2D Data Matrix for any of these two products, there's an error. 🔴
Uncaught SyntaxError: Unexpected token ? in JSON at position 75     at JSON.parse (<anonymous>)     at batchesController.js:45     at HTMLElement.r (:8080/webcardinal/components/webcardinal-core/p-8219f559.js:1)

@andrejstas The Product Code (GTIN) is always numeric. As a general rule all batch numbers are alphanumeric/ numeric, so A-Z and/or 0-9. Most companies would not use a Batch Number with special characters as it would be difficult for the patient to read. However serial numbers could be using these special characters (most companies only use a-z, A-Z and 0-9). The Russian Code does contain/ could contain these special characters.
The following barcode has :
GTIN =<PHONE_NUMBER>3838
Batch = !%*=&"?-+<.!
Serial Number =<PHONE_NUMBER>5022
Expiry Date = 240623
This would most likely not be a realistic barcode that a company would produce, but in theory it is perfectly fine.

This Code is probably more realistic:
GTIN =<PHONE_NUMBER>3838
Batch = ABC112
Serial Number = ';'%::*,<!=+)))+%
Expiry Date = 240623


move disqus & google analytics settings to _config.yml

Hi, I move the disqus comments and google analytics settings to the _config.yml file so that users can set them directly.
Thanks for your awesome theme and I am using it now!

good)


add a function to support custom color in the color table

Add DKColorMapping.plist for user to custom their own custom color.
you can use the prefix “@” and a custom name for a hex color number in
the DKColorTable.txt according the mapping file.
then you can manager your colors better.

some one who can figure out that why the build failed.

Build error isn't related to your pull request, but I really don't think this is a good functionality for this project, but still thanks for your work. 👍

thanks,
Please see the issue i put that about the tableviewcell's background
发自网易邮箱大师
On 01/09/2017 23:54, Draveness wrote:
Build error isn't related to your pull request, but I really don't think this is a good functionality for this project, but still thanks for your work. 👍
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub, or mute the thread.