Port the plugins to Python 3

@Silarn is currently working on porting over MO2 to Python 3. I can't really test this conversion (and thus tweak what needs manual tweaking) until his work has produced a test build, but this is a start at least.

Thanks. When the new Python 3 build is ready I will create a separate Python 3 branch and merge in your changes.

@Silarn put up a Python 3 build in the MO2 Discord earlier and it seems like the automated 2to3 wasn't enough to make your plugins work smoothly (I didn't really expect it to, but one could hope :) ).
common.ensureUnicode seems to cause an issue for syncModOrder.py, but just circumventing that (ie., removing the function call) in PluginWindow.__tr() isn't enough… now I just get a 'Plugin "" failed:' without an error message (replace  with Sync Mod Order/Merge Plugins Hide). Not sure how to debug further without any meaningful error messages/tracebacks.

Actually, restarting MO2 seems to have Python-byte-recompiled the plugins and now they work, as long as they don't call Dc/common.ensureUnicode. Is that function still needed with Py3 having strings as UTF-8 by default?

common.ensureUnicode (an ugly hack) is indeed not needed for Python 3. I created that to convert different kind of types that can encode Unicode characters in them to a byte string.


pkg-config returning wrong data for static linking

The cmake build creates a static library with the name libuv_a.a, but running with pkg-config --static --libs libuv returns -luv which then is not found by linker.

Right, that's something I overlooked when switching to cmake.
CMakeListst.txt has two library targets, uv and uv_a, to allow building the shared and the static library at the same time.
Unfortunately, I don't know of a good way to inform pkg-config that the static library has a different name. I don't think it has e.g. a Libs.static: field.
I'm open to suggestions, as long as they're not variations on "drop the uv_a target." :-)

I'm no expert myself, but pkg-config has Libs.private which I think is what is needed in the .pc file.
On my system, for example, I have in vulcan.pc
exec_prefix=/usr
libdir=/usr/lib/x86_64-linux-gnu
includedir=${prefix}/include

Name: Vulkan-Loader
Description: Vulkan Loader
Version: 1.2.141
Libs: -L${libdir} -lvulkan
Libs.private:  -lstdc++ -lm -lgcc_s -lgcc -lc -lgcc_s -lgcc
Cflags: -I${includedir}

and the output is
$ pkg-config --libs --static vulkan.pc
-lvulkan -lstdc++ -lm -lgcc_s -lgcc -lc -lgcc_s -lgcc

and
$ pkg-config --libs vulkan.pc
-lvulkan

Libs.private: is for additional libraries that should be linked in when --static is specified, not for providing an alternative library name. I think pkg-config always uses Libs: for that.

After reading up some more on pkg-config I think the only option is to have two .pc files: libuv.pc and libuv-static.pc

You know, that's not a bad idea. Want to open a PR?


Rule: 942100 False positive 0202

Description
[-:error] ModSecurity: Warning. detected SQLi using libinjection with fingerprint 'f(n)' [file "/../.. /coreruleset-3.4-dev/rules/REQUEST-942-APPLICATION-ATTACK-SQLI.conf"] [line "65"] [id "942100"] [msg "SQL Injection Attack Detected via libinjection"] [data "Matched Data: f(n) found within ARGS:q: cos(accckt)"] [severity "CRITICAL"] [ver "OWASP_CRS/3.3.0"] [tag "application-multi"] [tag "language-multi"] [tag "platform-multi"] [tag "attack-sqli"] [tag "paranoia-level/1"] [tag "OWASP_CRS"] [tag "capec/1000/152/248/66"] [tag "PCI/6.5.2"] [hostname **************]
Your Environment

CRS version (v3.2.0):
Paranoia level setting:
ModSecurity version (v2.9.3):
Web Server and version (httpd2.4.41):
Operating System and version: RHEL 7.9

Confirmation
[ ] I have removed any personal data (email addresses, IP addresses,
passwords, domain names) from any logs posted.
Hi Guys,
I am getting this false positive when I click a particular tab in my website. Could you please help me that this rule can be removed or we have any other fix?

Thank you for reporting this. Unfortunately, it is not problem with CRS, but with Libinjection that provides this operator to ModSecurity and we have a rule that uses it.
I'm sorry, but I can only close this issue and tell you to visit https://github.com/client9/libinjection to submit your report.
If you are interested, you can upload full request log and i will help you creating an exlusion rule for this case.


How is the file generated?

@mrphu3074 In the index.d.ts file it is writte:
// Generated by typings

How is this file generated? I'm asking because I would like to add the declaration of FooterTab in it.

Don't worry, I copied from a template. 😄  . Feel free to add more declaration.


WIP: Puhti web interface R17

Adds changes for Puhti web interface release 17. Depends on #1776 due to broken links until that PR is merged.
https://csc-guide-preview.rahtiapp.fi/origin/wwwpuhti-r17/

#1776 now merged.


v3.26 Update certificate policy for SSL.com

This pull request updates §<IP_ADDRESS> and §<IP_ADDRESS> with certificate policy identifiers for SSL.com.
Document updates:

Updated document version to 3.26 and date to October 15, 2024. (entrust.md)
Added a new entry in the document history for version 3.26, noting the update for SSL.com certificate policy. (entrust.md)

Policy updates:

Clarified that subordinate CA certificates may include policy object identifiers as listed in §<IP_ADDRESS>. (entrust.md)
Listed SSL.com certificate policies for DV, OV, and EV TLS certificates. (entrust.md)

@bcmorton please review this update from v3.25 > v3.26 as to be in sync with the Word version.

Looks good.


Fix some Xcode 7 warnings

This breaks Xcode 6.4 compatibility and requires Xcode 7.

I've created barijaona/vienna-rss/pull/4 to hopefully fix the travis CI build


$ElementType doesn't work properly with union of objects

Flow version: 0.102.0
Expected behavior
$ElementType should work correctly with the nested union of objects:
type A = { a: string }
type B = { b: number }
type C = { deep: A | B }

;(1: $ElementType<$ElementType<C, 'deep'>, 'b'>) // should be correct

Because the next example works correctly:
;(1: $ElementType<A | B, 'b'>) // correct

Actual behavior
Above example causes an error: Cannot instantiate $ElementType because property b is missing in A [1].

Link to Try-Flow or Github repo: https://flow.org/try/#0C4TwDgpgBAglC8UDeUCGAuKBnYAnAlgHYDmUAvgFCiRQBCCyUARpoQK4C2TEu5V40AMIMUAEwgQwmOAB86fCgG4AFAEZMAEgCiAGwgcIhYABUBAHll0ANFADkTWwD4AlFAD0bqAGMA9rlwQXsBKapq6+oYm5tp6BkamkGaCNrbikk4pDi7unlgAFj5sOqLM0L7+gcBAA

huh, interesting that adding an intermediate type seems to work fine

Shouldn't $ElementType work like regular property access?
https://flow.org/try/#0C4TwDgpgBAglC8UDeAfAUFKBDAXFAzsAE4CWAdgOZooC+A3GqJFAEILLqYBGeZArgFsuEItXqNw0AMLtUGKABMIEMHjgpWYhmiUBjADZYi0AG5GoAMwD2VvFO3WrAOiUqnXOlAD0XqCKJWREA

https://flow.org/try/#0C4TwDgpgBAglC8UDeUCGAuKBnYAnAlgHYDmUAvgFCiRQBCCyUARpoQK4C2TEu5V40AMIMUAEwgQwmOAB86fCuIDGAG1S5oAN3VQAZpgAkAURUQOEQsAAqAgDyy6AGigByJi4B8AbigB6X1AA9gDWFLpeFIoQqupaOqKGJmYW1nbGpuaWNpC2gs4u4pKe+e7ekaJeQA
This works the same as property access, so it's not an issue

@goodmind Thank you! You are right, I close the issue.
I think the next example has the right behavior:
https://flow.org/try/#0C4TwDgpgBAglC8UDeUCGAuKBnYAnAlgHYDmUAvgFCiRQBCCyUARpoQK4C2TEu5V40AMIMUAEwgQwmOAB86fCuIDGAG1S5oAN3VQAZpgAkAURUQOEQsAAqAgDyy6AGigByJi4B8AbigB6X1AA9gDWFLpeFIoQqupaOqKGJmYW1nbGpuaWNpC2gs4u4pKe+e7eil5AA


Questions regarding lidar2image transformation

Hey,
Thank you for this repo!
I'm doing my best to understand the lidar_camera_project.py code and have some questions regarding it.
I took snippets of the code to make this question a bit more readable
render_lidar_on_image function
def render_lidar_on_image(pts_velo, img, calib, img_width, img_height):
    # projection matrix (project from velo2cam2)
    proj_velo2cam2 = project_velo_to_cam2(calib)

    # apply projection
    pts_2d = project_to_image(pts_velo.transpose(), proj_velo2cam2)

    # Filter lidar points to be within image FOV
    inds = np.where((pts_2d[0, :] < img_width) & (pts_2d[0, :] >= 0) &
                    (pts_2d[1, :] < img_height) & (pts_2d[1, :] >= 0) &
                    (pc_velo[:, 0] > 0)
                    )[0]

    # Filter out pixels points
    imgfov_pc_pixel = pts_2d[:, inds]

    # Retrieve depth from lidar
    imgfov_pc_velo = pts_velo[inds, :]
    imgfov_pc_velo = np.hstack((imgfov_pc_velo, np.ones((imgfov_pc_velo.shape[0], 1))))
    imgfov_pc_cam2 = proj_velo2cam2 @ imgfov_pc_velo.transpose()

    cmap = plt.cm.get_cmap('hsv', 256)
    cmap = np.array([cmap(i) for i in range(256)])[:, :3] * 255

    for i in range(imgfov_pc_pixel.shape[1]):
        depth = imgfov_pc_cam2[2, i]
        color = cmap[int(640.0 / depth), :]
        cv2.circle(img, (int(np.round(imgfov_pc_pixel[0, i])),
                         int(np.round(imgfov_pc_pixel[1, i]))),
                   2, color=tuple(color), thickness=-1)
    plt.imshow(img)
    plt.yticks([])
    plt.xticks([])
    plt.show()
    return img

In this function you first transform the lidar points to 2d space, then extract the indices to only have the 2d points that are inside our camera. I get stuck in understand what you are trying to achieve with

    imgfov_pc_velo = np.hstack((imgfov_pc_velo, np.ones((imgfov_pc_velo.shape[0], 1))))
    imgfov_pc_cam2 = proj_velo2cam2 @ imgfov_pc_velo.transpose()

First you add an extra dimension with just ones, which I don't quite understand.
Further you transform the pointcloud points that belong to the pixels back to 2d space, which I don't understand either.
Why are you doing these operations?

You define depth as: depth = imgfov_pc_cam2[2, i], so basically taking the 'z' coordinate of the pointcloud that is transformed into 2D space. This doesn't make any sense to me since you are trying to get a depth from 2d space and the z coordinate doesn't have a meaning in there (what should it even mean in a 2d space?). Furthermore that value can be less than 0 when debugging the code, which doesn't make any sense either. Shouldn't the depth be calculated like something like:
        x = imgfov_pc_velo[i, 0]
        y = imgfov_pc_velo[i, 1]
        z = imgfov_pc_velo[i, 2]
        depth = np.sqrt(x**2 + y**2 + z**2)

project_to_image
def project_to_image(points, proj_mat):
    """
    Apply the perspective projection
    Args:
        pts_3d:     3D points in camera coordinate [3, npoints]
        proj_mat:   Projection matrix [3, 4]
    """
    num_pts = points.shape[1]

    # Change to homogenous coordinate
    points = np.vstack((points, np.ones((1, num_pts))))
    points = proj_mat @ points
    points[:2, :] /= points[2, :]
    return points[:2, :]

In project_to_image you divide the transfomred x,y with the transformed z coordinate, why do you do this? Furthermore before transformation you add a dimension with ones, what's the purpose of this?

Hopefully you can help me out with these questions!
Kind regards
Alex

Hi @wartek69

np.ones is to convert to homogenous coordinates (x, y, z, 1). The operation is to transform from lidar to cam2 coord. Not to 2d pixel space. This is to get depth in cam2 coordinate.

Same reasoning. cam2 coordinate. Not 2d space

This is perspective transformation https://www.cse.psu.edu/~rtc12/CSE486/lecture12.pdf

Hope this helps

Hi @darylclimb,
Thank you for your fast response and linking the lecture, it gave me some insights!
I'll repeat just to check if my understandigs are correct:
imgfov_pc_velo = np.hstack((imgfov_pc_velo, np.ones((imgfov_pc_velo.shape[0], 1)))) is the conversion to homogenous coordinates.
imgfov_pc_cam2 = proj_velo2cam2 @ imgfov_pc_velo.transpose() projects our pointcloud to the camera reference coordinates. It uses the camera intrinsics & camera-lidar extrinsics to do so. The result of this transformation is basically the X, Y, Z from the following picture.

As seen in the picture, to get the actual pixel values we divide the X & Y by Z. This is basically retransforming back from the homogenous coordinates. I did not notice you using the focal length in project_to_image as shown on the screenshot from the lecture, but I suppose that is contained inside the projection matrix.
In this repo you use the Z to define the depth, which is basically the depth if you transform all the points to the ground plane. What I mean with that it is not the distance to the actual point which you would obtain by doing something like
distance = sqrt(X²+Y²+Z²)
What I still do not understand is that whenever I change the calibration to my own calibration I'll get some negative values for the Z, which would basically mean that the points are behind the camera? (Points with a positive Z seem to be projected correctly from visual inspection)
Does this mean that my calibration is incorrect and thus I'm getting these weird artifacts?
Once again, thank you for providing all the useful information!
Kind regards
Alex

imgfov_pc_cam2 = proj_velo2cam2 @ imgfov_pc_velo.transpose() projects our pointcloud to the camera reference coordinates. It uses the camera intrinsics & camera-lidar extrinsics to do so.

If you look at the parameters carefully, proj_velo2cam2 does not use camera intrinsic.

What I still do not understand is that whenever I change the calibration to my own calibration I'll get some negative values for the Z, which would basically mean that the points are behind the camera? (Points with a positive Z seem to be projected correctly from visual inspection)
Does this mean that my calibration is incorrect and thus I'm getting these weird artifacts?

RIght, It is possible some of your lidar points are behind the camera.

Hi @darylclimb
proj_velo2cam2 uses the P2 matrix, which contains the camera intrinsics or am I missing something?

Hi @wartek69
Sorry, I misread. Yes, you are right.


Problems with initial setup

I'm trying to setup ember-intl with ember 2.3 and I have few problems.
http://formatjs.io/ember/ writes about adding
ready: function () {
        this.intl.set('locales', ['en-US']);
    }

while this.intl isn't available there. Also "locale" doesn't shows up as valid blueprting for locale generation with ember-cli. I have the app/formats.js and those two demo translation files, but something is missing somewhere.

Have you tried to use the intl service?
The example from the github README works for me:
  // app/routes/application.js
  export default Ember.Route.extend({
    intl: Ember.inject.service(),
    beforeModel() {
      // define the app's runtime locale
      // For example, here you would maybe do an API lookup to resolver
      // which locale the user should be targeted and perhaps lazily
      // load translations using XHR and calling intl's `addTranslation`/`addTranslations`
      // method with the results of the XHR request
      //
      this.get('intl').setLocale('en-us');

      // OR for those that sideload, an array is accepted to handle fallback lookups

      // en-ca is the primary locale, en-us is the fallback.
      // this is optional, and likely unnecessary if you define defaultLocale (see below)
      // The primary usecase is if you side load all translations
      this.get('intl').setLocale(['en-ca', 'en-us']);
    }
  });

The blueprint for creating new dummy translations is ember g translation de-de (see https://github.com/yahoo/ember-intl/tree/master/packages/ember-intl/blueprints/translation).
Aside from the translation and default ember-intl, there is no blueprint (check ember g --help for a list of all commands).

@riklaunim the documentation on formatjs is old and I created an issue to remove it.  Please use the README and wiki articles on github.
https://github.com/yahoo/formatjs-site/issues/201

I've submitted a PR to remove the documentation from formatjs.io to avoid this confusion.


elasticgo it supports tcp protocol access elasticsearch it?

elasticsearch itself supports three methods, http, tcp and node way; elasticgo it supports tcp protocol access elasticsearch it?

I looked for the lib/conn.go file. It look like only support http ..

Too bad, too ugly, too can not be accepted, TCP way more stable than HTTP, why not support it?


Graphite Web Nginx + Gunicorn setup failure

Hi !
I've been following the documentation at here:
https://graphite.readthedocs.io/en/latest/config-webapp.html
to setup the nginx+gunicorn for graphite-web, and encountered following issue:

[2019-07-02 17:36:09 +0000] [13713] [ERROR] Exception in worker process
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/gunicorn/arbiter.py", line 583, in spawn_worker
worker.init_process()
File "/usr/lib/python2.7/site-packages/gunicorn/workers/base.py", line 129, in init_process
self.load_wsgi()
File "/usr/lib/python2.7/site-packages/gunicorn/workers/base.py", line 138, in load_wsgi
self.wsgi = self.app.wsgi()
File "/usr/lib/python2.7/site-packages/gunicorn/app/base.py", line 67, in wsgi
self.callable = self.load()
File "/usr/lib/python2.7/site-packages/gunicorn/app/wsgiapp.py", line 52, in load
return self.load_wsgiapp()
File "/usr/lib/python2.7/site-packages/gunicorn/app/wsgiapp.py", line 41, in load_wsgiapp
return util.import_app(self.app_uri)
File "/usr/lib/python2.7/site-packages/gunicorn/util.py", line 350, in import_app
import(module)
ImportError: No module named graphite_wsgi
[2019-07-02 17:36:09 +0000] [13713] [INFO] Worker exiting (pid: 13713)
[2019-07-02 17:36:09 +0000] [13668] [INFO] Shutting down: Master
[2019-07-02 17:36:09 +0000] [13668] [INFO] Reason: Worker failed to boot.

All i did that isn't on the doc was copied the graphite.wsgi file from conf folder to webapp/graphite/
Would you please help to point out the root cause?
Thanks a lot!
David

Hi @caldavid ,
You can try solution from Stackoverflow - https://stackoverflow.com/questions/22158635/graphite-and-gunicorn-config-issue-or-path-issue

Hi @deniszh
Thanks for the hint, that worked!
But i've got stuck at Nginx layer, it seems that the Nginx is showing default page instead of the graphite.
Here is what I have so far:
Got Gunicorn running, bind to gunicorn.sock, tested with curl local gunicorn socket, got following response  curl --unix-socket /run/gunicorn.sock <IP_ADDRESS>:

Graphite Browser

<frame src="/composer?" name="content" id="composerFrame"/>

My Gunicorn service file looks like this:

[Unit]
Description=gunicorn daemon
After=network.target
[Service]
User=root
Group=apache
WorkingDirectory=/opt/graphite/webapp
ExecStart=/usr/bin/gunicorn wsgi --workers=4 --bind=unix:/run/gunicorn.sock --log-file=/var/log/gunicorn.log --preload --pythonpath=/opt/graphite/webapp/graphite
[Install]
WantedBy=multi-user.target

My nginx site-available/graphite looks like this:

server {
listen 80 default_server;
server_name "my_ip";
graphite /opt/graphite/webapp;

access_log /var/log/nginx/graphite.access.log;
error_log  /var/log/nginx/graphite.error.log;

location = /favicon.ico {
    return 204;
}

# serve static content from the "content" directory
location /static {
    alias /opt/graphite/webapp/content;
    expires max;
}

location / {
    #try_files $uri @graphite;
    include proxy_params;
    proxy_pass http://unix:/run/gunicorn.sock;
}

location @graphite {
    proxy_pass_header Server;
    proxy_set_header Host $http_host;
    proxy_redirect off;
    proxy_set_header X-Real-IP $remote_addr;
    proxy_set_header X-Scheme $scheme;
    proxy_connect_timeout 10;
    proxy_read_timeout 10;
    proxy_pass http://graphite;
}

I have been checking around, but didn't find useful solution to me. Please help~

Just remove
server_name "my_ip";
line from config above and restart Nginx.

still no luck, default page shown.
should i touch my nginx.conf?
`user nginx;
worker_processes auto;
error_log /var/log/nginx/error.log;
pid /run/nginx.pid;
Load dynamic modules. See /usr/share/nginx/README.dynamic.
include /usr/share/nginx/modules/*.conf;
events {
worker_connections 1024;
}
http {
log_format  main  '$remote_addr - $remote_user [$time_local] "$request" '
'$status $body_bytes_sent "$http_referer" '
'"$http_user_agent" "$http_x_forwarded_for"';
access_log  /var/log/nginx/access.log  main;

sendfile            on;
tcp_nopush          on;
tcp_nodelay         on;
keepalive_timeout   65;
types_hash_max_size 2048;

include             /etc/nginx/mime.types;
default_type        application/octet-stream;

# Load modular configuration files from the /etc/nginx/conf.d directory.
# See http://nginx.org/en/docs/ngx_core_module.html#include
# for more information.
include /etc/nginx/conf.d/*.conf;

server {
    listen       80 default_server;
    listen       [::]:80 default_server;
    server_name  _;
    root         /usr/share/nginx/html;

    # Load configuration files for the default server block.
    include /etc/nginx/default.d/*.conf;
    #include /etc/nginx/sites-enabled/*;
    location / {
    }

    error_page 404 /404.html;
        location = /40x.html {
    }

    error_page 500 502 503 504 /50x.html;
        location = /50x.html {
    }

}`

Uncomment sites-enabled line
On Thu, 4 Jul 2019 at 19:36, caldavid<EMAIL_ADDRESS>wrote:

still no luck, default page shown.
should i touch my nginx.conf?
`user nginx;
worker_processes auto;
error_log /var/log/nginx/error.log;
pid /run/nginx.pid;
Load dynamic modules. See /usr/share/nginx/README.dynamic.
include /usr/share/nginx/modules/*.conf;
events {
worker_connections 1024;
}
http {
log_format main '$remote_addr - $remote_user [$time_local] "$request" '
'$status $body_bytes_sent "$http_referer" '
'"$http_user_agent" "$http_x_forwarded_for"';
access_log  /var/log/nginx/access.log  main;
sendfile            on;
tcp_nopush          on;
tcp_nodelay         on;
keepalive_timeout   65;
types_hash_max_size 2048;
include             /etc/nginx/mime.types;
default_type        application/octet-stream;
Load modular configuration files from the /etc/nginx/conf.d directory.
See http://nginx.org/en/docs/ngx_core_module.html#include
for more information.
include /etc/nginx/conf.d/*.conf;
server {
listen       80 default_server;
listen       [::]:80 default_server;
server_name  _;
root         /usr/share/nginx/html;
# Load configuration files for the default server block.
include /etc/nginx/default.d/*.conf;
#include /etc/nginx/sites-enabled/*;
location / {
}

error_page 404 /404.html;
    location = /40x.html {
}

error_page 500 502 503 504 /50x.html;
    location = /50x.html {
}

}`
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/graphite-project/graphite-web/issues/2460?email_source=notifications&email_token=AAJLTVT5ENVQGFHWQTGUPTDP5YYILA5CNFSM4H5A3ZI2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODZH4UII#issuecomment-508545569,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAJLTVQQS3JER5OPO7Z7PHLP5YYILANCNFSM4H5A3ZIQ
.

This server block is what's showing the nginx default page:
    server {
        listen       80 default_server;
        listen       [::]:80 default_server;
        server_name  _;
        root         /usr/share/nginx/html;

        # Load configuration files for the default server block.
        include /etc/nginx/default.d/*.conf;
        #include /etc/nginx/sites-enabled/*;
        location / {
        }

I'm not sure if that sites-enabled line is in the right place - I think these "sites" configs usually have a server block, and I don't think you can put a server block inside a server block.
It's arbitrary anyway. I'd just remove that entire server block, and include your nginx-graphite config in its stead (e.g. replace that whole server block with include /etc/nginx/sites-available/graphite; or whatever).

@ploxiln @deniszh  That did the trick !!!!
And I also removed include proxy_params; which causing the trouble.
Thank so much you guys!  Happy 4th~


[update] ember-cli and dependencies

This PR updates project to ember-cli v2.12.1, adds support for Yarn (for local dev) and fixes a bug in tests related to ember 2.12
This PR also restores my name in the license/copyright file

hey @JoshSmith please check this out when you get a chance, once this one is in @NicolleJimenez you can rebase and that should solve your tests breaking.


--email and -m false positive

Hello,
When I went to manually request a certificate this morning for a new domain running a Bitnami image of Ubuntu 16, I received the following error:
You have to pass an account (email address) to the program using --email or -m
However, this is the command I entered:
sudo lego --tls --email="EMAIL-ADDRESS" --domains="DOMAIN" --domains="www.DOMAIN" --path="/etc/lego" run
("EMAIL-ADDRESS" and "DOMAIN" placeholders added, I used real values when encountering the error)
Please advise on the issue and if you need more information to recreate the error.

Thank you

Hello, could you give the version of lego that you use?

Idez,
Thank you for the prompt reply. I am in fact using lego version 1.2.1 and dropping the TLS argument has worked. It seems the guide I have used for months was edited recently to reflect the v2 update and I didn't catch that change.
Thanks again, sorry for the operator error.

@ldez I have updated recently from v1 to v2 and tried the v2 commands and have received the same error message.
when I run lego -v: lego version v0.4.1-0-g67c86d860a79
I have both lego_linux_amd64.tar.xz  and  lego_v2.2.0_linux_amd64.tar.gz
What am I doing wrong here?

untar lego_v2.2.0_linux_amd64.tar.gz
./lego -v


feat: select - matching word hightlight color default color

:tada: This PR is included in version 2.7.0 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


How to evaluate the length of an array?

Is it possible to check the length of an array?

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 77c58a78-a567-e99a-9eb7-62dddd1b90b6
Version Independent ID: 680a79bc-11de-39fc-43e3-e07dc762db18
Content: Expressions - Azure Pipelines
Content Source: docs/pipelines/process/expressions.md
Product: devops
GitHub Login: @andyjlewis
Microsoft Alias: alewis

@jordanchang Please accept our apologies for the delay in getting to this issue.
It looks like you were working through a specific scenario or implementation, rather than an issue with the documentation. Here are a few options where you might consider asking your question in the future:

Azure DevOps on Stack Overflow
Azure DevOps Support Bot

It's not, sorry.


Full face or mouth region only

Hi,
Is the model uploaded here trained on the full faces, or just the mouth region ?
The paper says that the network takes the mouth region as input, but the testing script takes in the full face.
Thanks in advance

The model has been trained on the full faces, as in the example video.

Many thanks for your response.
What about the model in https://github.com/joonson/yousaidthat ? Is it trained on the face aswell, or the lips ?

It is also trained on the full face.


[BUG] Slow network inside docker container

I'm running 4 IIS application docker containers in each of 5 Service Fabric cluster nodes. It works fine for a while and then sometimes the network performance is intermittently slow on one or two of the nodes causing time outs all over the place. Sometimes curl works but sometimes it just takes a long time and times out. Restarting the container does NOT fix it, only restarting the node fixes it.
Any ideas?
Thank you.

Any ideas? @craftyhouse @sukanyamsft


Add examples section to ockam forwarder create command's help

Current Behaviour
ockam forwarder create --help

does not display any examples
Desired Behaviour
As part of the help show the following examples section:
EXAMPLES

    ockam node create n1
    ockam node create n2

    ockam forwarder create --from forwarder_to_n2 --for /node/n2 --at /node/n1
    ockam message send hello --to /node/n1/service/forwarder_to_n2/service/uppercase

LEARN MORE

References
Here's an example of command that currently shows examples
ockam node create --help

Here's the code for the ockam node create command
https://github.com/build-trust/ockam/blob/e6813de8c0cd5c10b438a7b1ff11d40b97d39c40/implementations/rust/ockam/ockam_command/src/node/create.rs#L39-L54
Here's the code for the ockam forwarder create command
https://github.com/build-trust/ockam/blob/develop/implementations/rust/ockam/ockam_command/src/forwarder/create.rs

We love helping new contributors!
If you have questions or need help as you work on your first Ockam contribution, please leave a comment on this discussion.
If you're looking for other issues to contribute to, checkout this discussion and labels -  https://github.com/build-trust/ockam/labels/good first issue or https://github.com/build-trust/ockam/labels/help wanted

Addressed in https://github.com/build-trust/ockam/pull/3350
Thank you @chrischiedo


COGS is not processing the Go Button Pressed

GOCS is not processing the Go Button Pressed:

cogs-plugin-manifest.js
toCogs: [
        {`
          name: "Go Button Pressed",`

App.tsx
<div
          className="button go"
          onClick={() => cogsConnection.sendEvent("Go Button Pressed")}
        >
          GO!
        </div>

Hey @SecurityHat, to react to that event in COGS, you'll need to add a behaviour and choose the "Device Event" option, and you should then see your event as an option when configuring the event:


Custom Events is lacking information

Description
I'm trying to follow the example given in the section Custom event arguments, but the documentation is not complete.
function eventArgsCreator(event) {
  return {
    customProperty1: 'any value for property 1',
    customProperty2: event.srcElement.value
  };

what 'type' is event? what else can I get from it?
  blazor.registerCustomEventType('customevent', {
    createEventArgs: eventArgsCreator
  });

what else can I pass to registerCustomeEventType? createEventArgs cannot possible be the only field or option?
<button @oncustomevent="HandleCustomEvent">Handle</button>

@code
{
    private void HandleCustomEvent(CustomEventArgs eventArgs)
    {
        // eventArgs.CustomProperty1
        // eventArgs.CustomProperty2
    }
}

how is @oncustomevent triggered? I cannot find documentation on how to trigger that function.
On StackOverflow I found this:
function OnMarkerClick(pId) {
    const event = new CustomEvent('cityclicked', {
        bubbles: true,
        detail: pId
    });
    document.getElementById('CarteLeaflet').dispatchEvent(event);
}

Is this the way to do it? Does not say in the documentation
Page URL
https://learn.microsoft.com/en-us/aspnet/core/blazor/components/event-handling?view=aspnetcore-8.0
Content source URL
https://github.com/dotnet/AspNetCore.Docs/blob/main/aspnetcore/blazor/components/event-handling.md
Document ID
5e8ef502-ccf9-659d-f25a-0f8f3c75f6e0
Article author
@guardrex

Hello @puppetSpace ... One small thing that I see is that a cut-'n-paste 😈 is in the code example ...
@using namespace BlazorSample.CustomEvents
@using BlazorSample.CustomEvents

That's easy enough to fix.
BUT ...  I think there's a regression in the framework or in the docs. I agree ... this guidance doesn't seem to work in a Blazor Web App. @oncustomevent isn't firing here either. I'll ping for assistance.
@MackinnonBuck ... In this section ...
https://learn.microsoft.com/en-us/aspnet/core/blazor/components/event-handling?view=aspnetcore-8.0#general-configuration
... there seems to be a problem for a Blazor Web App.
I'm going to test it in a Blazor WebAssembly app and see what happens.

Nevermind, @MackinnonBuck! ... I figured out the problem :tada: and am pushing a PR now to fix it.

WRT your questions ...

what 'type' is event?

AFAIK, a DOM Event.

what else can I get from it?

The usual DOM Event instance properties. See the MDN docs ...
https://developer.mozilla.org/en-US/docs/Web/API/Event

what else can I pass to registerCustomeEventType?

Nothing but the name and options AFAIK. See the reference source for details ...
https://github.com/dotnet/aspnetcore/blob/474d2944dba601440987b328d7044155023c3c14/src/Components/Web.JS/src/Rendering/Events/EventTypes.ts
It's possible that we might eventually expand this documentation with more details; but right now, we'll let devs look at the ref source for further details. It's a low priority until more devs ask for more detail given the high backlog of doc issues that I have to address.

WRT your questions ...

what 'type' is event?

A DOM Event.

what else can I get from it?

The usual DOM Event instance properties. See the MDN docs ...
https://developer.mozilla.org/en-US/docs/Web/API/Event

what else can I pass to registerCustomeEventType?

Nothing but the name and options AFAIK. See the reference source for details ...
https://github.com/dotnet/aspnetcore/blob/main/src/Components/Web.JS/src/Rendering/Events/EventTypes.ts
It's possible that we might eventually expand this documentation with more details; but right now, we'll let devs look at the ref source for further details. It's a low priority until more devs ask for more detail given the high backlog of doc issues that I have to address.

This is already a big help. Knowing that event is pure Javascript and not a blazer added type.
The reference source also helps. Tried looking for it, but didn't find it.
Thanks for the help.


WIP: BufferWrapper: support for partitions that slice the signal dimensions

This is needed for tiled processing of (live) data from detectors that deliver their data as independent streams for each detector part. It works by only allocating for the signal slice, and then shifting the tile slices to the local coordinate system of the partition (in signal dims).
The tests are not minimal yet - I'll work on implementing support in the memory dataset for this kind - then we can test at the interfaces.
Contributor Checklist:

[ ] I have added or updated my entry in the creators.json file
[ ] I have added a changelog entry for my contribution
[ ] I have added/updated documentation for all user-facing changes
[ ] I have added/updated test cases
[ ] I have included the rebuilt production build of the client (only if changes were made to the GUI)

Reviewer Checklist:

[x] /azp run libertem.libertem-data passed

/azp run libertem.libertem-data

Extracted into #1153 and #1152


Rename children that refer to a MemberDeclBlock from members to memberBlock

Previously, we frequently had patterns where we did node.members.members, which doesn’t read very nice. node.memberBlock.members is much nicer.

https://github.com/apple/swift/pull/65126
https://github.com/apple/swift-stress-tester/pull/232
https://github.com/apple/swift-format/pull/512
@swift-ci Please test

https://github.com/apple/swift/pull/65126
https://github.com/apple/swift-stress-tester/pull/232
https://github.com/apple/swift-format/pull/512
@swift-ci Please test

https://github.com/apple/swift/pull/65126
https://github.com/apple/swift-stress-tester/pull/232
https://github.com/apple/swift-format/pull/512
@swift-ci Please test Windows

https://github.com/apple/swift/pull/65126
https://github.com/apple/swift-stress-tester/pull/232
https://github.com/apple/swift-format/pull/512
@swift-ci Please test

https://github.com/apple/swift/pull/65126
https://github.com/apple/swift-stress-tester/pull/232
https://github.com/apple/swift-format/pull/512
@swift-ci Please test Windows

https://github.com/apple/swift/pull/65126
https://github.com/apple/swift-stress-tester/pull/232
https://github.com/apple/swift-format/pull/512
@swift-ci Please test Windows

https://github.com/apple/swift/pull/65126
https://github.com/apple/swift-stress-tester/pull/232
https://github.com/apple/swift-format/pull/512
@swift-ci Please test Windows

https://github.com/apple/swift/pull/65126
https://github.com/apple/swift-stress-tester/pull/232
https://github.com/apple/swift-format/pull/512
@swift-ci Please test Windows

https://github.com/apple/swift/pull/65126
https://github.com/apple/swift-stress-tester/pull/232
https://github.com/apple/swift-format/pull/512
@swift-ci Please test Windows


Add Full URL to Export Bundles

Summary
Adds a fullUrl to each exported bundle entry. Preserves fullUrls from imported bundles
Open Questions:

Should we preserve the fullUrl for imported testCaseMeasureReports?
Should we update the fullUrl if the id of an existing resource is updated?

New Behavior
When a patient test case is exported, each entry in the bundle will now have a fullUrl field. This fullUrl will be preserved if the patient test case was initially an imported case that had fullUrls defined, or will be generated in the urn:uuid style
Code Changes

Updated PatientTestCase to store a fullUrl for the Patient and an array of BundleEntries instead of resources to preserve fullUrl field
Updated createPatientBundle to take in a fullUrl for the patient and add fullUrls to the bundle entries
Updated all components that access resources to point to the nested entry.resource
Updated patient cloning to update fullUrls for cloned patient as well
Updated testing

Testing Guidance

npm run check
npm run dev
Upload a measure and create a few new patient test cases, each with a few resources
Export a single test case and ensure that the exported bundle has fullUrl fields for all the bundle entries
Clone a patient
Export all test cases and ensure they all have fullUrl fields. Also ensure that the cloned test case has appropriate fullUrls that match the ids of the cloned resources.
Restart and import one of your patient test cases
Now export the test case again and ensure the fullUrls match from the import

With those two open questions, yes and yes. Updating the fullUrls with the new ids is especially important when updating them or cloning a patient or resource.


error when 'npm start'

<EMAIL_ADDRESS>drop-sqlite-db

rm ./db/database.sqlite

'rm' is not recognized as an internal or external command,
operable program or batch file.

What OS are you using?

I use Windows OS.
Note: I chose mysql2

for windows the command would be del and not rm.
I will add support for windows as soon as possible...


fix: template fork button style on safari

Description
Originally meant to use the button tag. Replaced type with tag. Also fixed a similar issue in fork application modal.
Fixes #11960
Type of change

Bug fix (non-breaking change which fixes an issue)

How Has This Been Tested?
Manually
Checklist:

[x] My code follows the style guidelines of this project
[x] I have performed a self-review of my own code
[ ] I have commented my code, particularly in hard-to-understand areas
[ ] I have made corresponding changes to the documentation
[x] My changes generate no new warnings
[ ] I have added tests that prove my fix is effective or that my feature works
[x] New and existing unit tests pass locally with my changes

Test coverage results :test_tube:
:white_circle: Total coverage has not changed
No changes to code coverage between the base branch and the head branch

/ok-to-test sha=6eb55b6


feat: implement 0x39 - CODECOPY

Since
Frontier
Group
Environmental Information
Description
0x39 - CODECOPY: Copy code running in current environment to memory
Index 1 is top of the stack. See PUSH.NotesFor out of bound bytes, 0s will be copied.Stack inputdestOffset: byte offset in the memory where the result will be copied.offset: byte offset in the code to copy.size: byte size to copy.Examples
Code
0x7DFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFF7F
Reproduce in playground.Error casesThe state changes done by the current context are reverted in those cases:Not enough gas.Not enough values on the stack.Gasminimum_word_size = (size + 31) / 32
static_gas = 3
dynamic_gas = 3 * minimum_word_size + memory_expansion_cost
The memory expansion cost explanation can be found here.

Hi, I am working on this one presently.
It lead us to talk about byte-packaging for the code array in the ExcecutionContext, which is defered for now, getting a working opcode first.

Done


Executing command dnx ef dbcontext scaffold fails, regardless of the arguments specified

Running under an asp.net 5 beta 7 project, with EF 7 beta 7:
C:\Dev\project>dnx ef dbcontext scaffold provider EntityFramework.SqlServer connection "Data Source=(localdb)\MSSQLLocalDB;Initial Catalog=database;Integrated Security=True"
Expected:
Generated POCO dbcontext & classes from db tables.
Result:
Specify --help for a list of available options and commands.
System.Exception: TODO: Error: unrecognized argument 'connection'
at Microsoft.Dnx.Runtime.Common.CommandLine.CommandLineApplication.HandleUnex
pectedArg(CommandLineApplication command, String[] args, Int32 index, String arg
TypeName)
at Microsoft.Dnx.Runtime.Common.CommandLine.CommandLineApplication.Execute(St
ring[] args)...
Snippet of my project.json dependencies:
 "EntityFramework.SqlServer": "7.0.0-beta7",
 "EntityFramework.SqlServer.Design": "7.0.0-beta7",
 "EntityFramework.Commands": "7.0.0-beta7",

Version of the EntityFramework Commands:
C:\Dev\project>dnx ef --version
Entity Framework Commands
7.0.0-beta7-15540

To be frank I've tried almost any possible combination of the arguments connection & provider (like connection="connection string" provider="EntityFramework.SqlServer" but I keep getting various exceptions.
You should have provided a example on how to use it, as there is nothing about it in your EF wiki or any other docs on the net.

Try running dnx ef dbcontext scaffold --help to see how you should use this. The usage is:
dnx ef dbcontext scaffold <connection_string> <provider>
So in your case:
dnx ef dbcontext scaffold "Data Source=(localdb)\MSSQLLocalDB;Initial Catalog=database;Integrated Security=True" EntityFramework.SqlServer
Closing. But feel free to re-open if you're still having problems.

Be sure to nave installed the package EntityFramework.SqlServer.Design

@alfberga That's right. The runtime provider assembly defines its design-time provider assembly - which may be itself. If the design-time assembly is separate and you've failed to install it you should see a helpful error message saying what you're missing.


add Pejuang University of Republic of Indonesia

Adding Pejuang University of Republic of Indonesia
University url: https://upri.ac.id/

@yusrideb I am sorry, the university official website is under construction. Thus, we cannot check if the university fits the requirements listed in this repository rules. I have to close the request without merging.  Thank you for your understanding.

Currently it's no longer under construction.
please re-check. thank you


Feature request: tag scrolling

VSCode Version: 1.15.1
OS Version: Windows 8

I don't find minimap much useful when I need to scroll up and down in my file. Unless there is a large block of switch or comments, I cannot make out where to jump unless I'm aware of the position of the code I'm searching.
Here's feature request for alternative way for fast scrolling.

By default, auto-tag all method/functions and classes in a file.
In place of minimap, show all the tags. Except for a large file, ensure the tag list fits in one screen. Scrolling for tag list would likely defeat the purpose. Those who are disciplined enough will keep the file short enough.
As an enhancement, allow  custom tags.
Allow hotkeys/quick access buttons for toggle jump between last two locations.

Thanks,
-Shailesh

Reproduces without extensions: Yes/No

Maybe workbench.action.gotoSymbol can help you here?
Use Ctrl+Shift+O or insert an @ after a Ctrl+P and then type in the name of the function/method you are interested in in your editor. You can then jump to that function/method without using the mouse or scrolling with the keyboard.
Click here for more information.

The ':' to group by category is a nice trick. Thanks for the link.


[stable/sonatype-nexus]update-nexus-version

Signed-off-by: Vardit Natanson<EMAIL_ADDRESS>
Is this a new chart

NOTE: We're experiencing a high volume of PRs to this repo and reviews will be delayed. Please host your own chart repository and submit your repository to the Helm Hub instead of this repo to make them discoverable to the community. Here is how to submit new chart repositories to the Helm Hub.

What this PR does / why we need it:
Which issue this PR fixes
(optional, in fixes #<issue number>(, fixes #<issue_number>, ...) format, will close that issue when PR gets merged)

bump Sonatype Nexus Version to 3.19.1

Special notes for your reviewer:
Checklist
[Place an '[x]' (no spaces) in all applicable fields. Please remove unrelated fields.]

[X] DCO signed
[X] Chart Version bumped
[X] Variables are documented in the README.md
[X] Title of the PR starts with chart name (e.g. [stable/mychartname])

/assign @rjkernick
Get Outlook for Androidhttps://aka.ms/ghei36

From: Kubernetes Prow Robot<EMAIL_ADDRESS>Sent: Friday, November 15, 2019 6:11:22 PM
To: helm/charts<EMAIL_ADDRESS>Cc: Vardit Natanson<EMAIL_ADDRESS>Author<EMAIL_ADDRESS>Subject: Re: [helm/charts] [stable/sonatype-nexus]update-nexus-version (#18921)
[APPROVALNOTIFIER] This PR is NOT APPROVED
This pull-request has been approved by: TAvardithttps://github.com/helm/charts/pull/18921#
To complete the pull request processhttps://git.k8s.io/community/contributors/guide/owners.md#the-code-review-process, please assign rjkernick
You can assign the PR to them by writing /assign @rjkernick in a comment when ready.
The full list of commands accepted by this bot can be found herehttps://go.k8s.io/bot-commands?repo=helm%2Fcharts.
Needs approval from an approver in each of these files:

stable/sonatype-nexus/OWNERShttps://github.com/helm/charts/blob/master/stable/sonatype-nexus/OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://github.com/helm/charts/pull/18921?email_source=notifications&email_token=AJFGEFAFCEOSSRGX6GVEQITQT3J3VA5CNFSM4JN5ZZOKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEEGC3ZA#issuecomment-554446308, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AJFGEFB2QODMJEVEN7OWH2TQT3J3VANCNFSM4JN5ZZOA.

@rjkernick @tsiddique, it will be great if you could allow this PR to be tested. Thanks!

Hi guys @rjkernick @tsiddique, Am I missing something to get this reviewed?

/test all

/ok-to-test

/assign
/lgtm


Move UI out of apiserver and into an addon pod

(Filing for tracking; @timstclair is working on this as a starter project.)

@timstclair great work on https://github.com/GoogleCloudPlatform/kubernetes/pull/10077 really awesome starter project contribution.

Thanks!


[Project Proposal]:

Project Description
No response
Expected Outcomes
No response
Skills required
No response
Expertise
None
Topic Lead(s)
No response
Relevant links
No response

Closing this is empty


Unpin xarray and xesmf

Try to remove the pinning of xarray and xesmf.

hm... is it expected that test on python 3.9 stall?

OK, they don't hang... it was something random probably.


App crashes after eas update, works locally

Describe the bug
Hi, I'm added bugsnag to my project and I get the data from local testing, but when I "publish" my app through eas update it crashes when the code reaches Bugsnag.start() (I know it's this line cause I removed it and moved around to test it).
The biggest problem is that I don't know how to get any useful logs when it crashes, I tried to wrap in try catch but it didn't help. If you have an idea how to get the logs, I could try to resolve the issue myself.
Steps to reproduce

expo init
create blank app
npx bugsnag-expo-cli init (and follow basic init guide)
expo update --platform=ios
open expo go and run update
see crash

Environment

Bugsnag version: latest
Expo SDK version (e.g. SDK 44): 49.0.5
Device: iphone 13 mini

Example Repo

[ ] Create a minimal repository that can reproduce the issue
[ ] Link to it here: https://github.com/maciekstosio/bugsnagerror

Hi @maciekstosio,
Thank you for opening this PR. We will review this when priorities allow.

A fix for this has now been released in v49.0.1
Thanks again for the contribution @maciekstosio!


Name collisions

Thank you for this package! Keeping up with the official API is now painful. However, I believe we import this package as "twitter" which is likely to collide with other modules. Could you give it a different name, like "twitter-scraper" or some such thing?

Thanks for the feedback. This makes sense, I'll see if I can come up with a good solution.

It's kind of odd to close this as completed when it's not done...?


Defining a sampling distribution

I have parquet files divided into sub populations, I want to define a sampling distribution of the dataset to allow to sample from that distribution while training with pytorch.
In Tensorflow I have implemented it with:
ds = tf.data.experimental.sample_from_datasets(
    [ds1, ds2], [0.7, 0.3]
)

In pytorch I have implement it with:
class WeightedDataset(IterableDataset):
    def __init__(self, datasets: List[Dataset], weights: List[float]):
        self.datasets = datasets
        self.weights = weights

    def __iter__(self):
        ds_iters = [cycle(dataset) for dataset in self.datasets]
        while True:
            ds = np.random.choice(ds_iters, p=self.weights)
            yield next(ds)

ds = WeightedDataset([ds1, ds2], [0.7, 0.3])

Currently I am using the second method with Daft which is prone to OOM as the amount of subpopulations gets bigger. Is there an option currently to define this sampling logic within daft based on a column? or hive partitioning? If not, is it possible to implement this logic within daft in way that would be less resource intensive?
Ideally I would like to do:
df = df.sample_with(col="colname", weights={"value1": 0.7, "value2": 0.3})

Or,
df = daft.from_dataframes([df1, df2], weights=[0.7, 0.3])

What do you say?

We currently have a df.sample method that samples a fraction of a dataframe, you could do something like:
df1 = df1.sample(0.7)
df2 = df2.sample(0.3)
df = df1.concat(df2)

Would this work for your use case?

No, since the number of samples in each dataframe is different and I want df1 samples to represent 0.3 of the df distribution. We use this feature to deal with imbalanced data, to increase the probability of sampling a class that is eitherwise has low sampling probability.
Following is a toy example of how we currently sample from our dataset:
import tensorflow as tf

ds1 = tf.data.Dataset.from_tensor_slices(tf.ones([1])).repeat()
ds2 = tf.data.Dataset.from_tensor_slices(tf.zeros([100])).repeat()

n_iters = 100
batch_size= 100
ds = tf.data.experimental.sample_from_datasets([ds1, ds2],
                                               weights=[0.3, 0.7]).batch(batch_size)
iter_ds = iter(ds)
s = 0
for _ in range(n_iters):
    s += sum(next(iter_ds))

print(s / (n_iters * batch_size))

does this make sense?

Ah I see now. One more question, could you use batch_size and weights to calculate the number of rows returned from each dataframe? For example:
batch_size = 100
weights = [0.3, 0.7]
rows_to_sample = [batch_size * w for w in weights] # [30, 70]

If that's possible for your use case, we can add an option in the sample method to specify an exact number of rows, e.g. df.sample(n = 30) which would sample 30 rows from df.

No, it is not possible as well, since in some cases we have something like this:
batch_size = 2
weights = [0.1, 0.1, 0.8]

Gotcha. Going back to the proposed API: df = daft.from_dataframes([df1, df2], weights=[0.7, 0.3]), would it be correct to say that the ouput of from_dataframes is a new dataframe with total number of rows equal to the sum of df1 and df2 rows, i.e. len(df) = len(df1) + len(df2), but the distribution of df is 70% df1 and 30% df2?

No, in our current process we do something like this:
ds = tf.data.experimental.sample_from_datasets([ds1, ds2, ..., dsn],
                                                                                weights=[w1, w2, ..., wn])

Thus the sampling is a random process and the amount of samples in each dataset is different. That makes the size of the dataset(total amount of samples being drawn until a StopIteration is reached) depend on the first dataset (one of ds1, ds2, ..., dsn) that would get empty.

Ok, just wanna confirm:

Are you using the to_torch_iter_dataset method?
Are you using PyRunner?

We're gonna try reproduce this, I believe the issue with the OOM is that we are materializing too many partitions =

Yes to both questions.
Regarding the OOM statement(I belive you are refering to #2383 ?), I think you are right :)

From an offline conversation today:

Fixing #2493 should help a lot with Daft being overly-aggressive with scheduling when streaming data out of multiple dataframes.
Adding a new multi-stream concat operator (e.g. daft.sampled_concat([df1, df2, ...], [0.5, 0.4, ...])) would allow the Daft execution engine even better control around "muxing" streams of data coming out of each dataframe.

cc @samster25


[Feature Request] Hide Toolbar Icon

I would like to have an option to hide the Toolbar Icon.
This would also require to implement a settings button inside the Application Window

Discussed before


Add adaptive monochrome icon

Took some creative liberty to add a monochrome version of the icon. I don't have a licence to sketch, so I can't open or modify the sketch file. I do have a figma source available.

This is how it looks
Before:

After:

Thanks :) I ended up importing the .sketch file from figma, and it didn't seem to loose any gradient/masking. Here's the .svg for the monochrome version, and I will need help with someone with a sketch licence to commit this to source control for future reference

Nice! Today I learnt Figma can open .sketch files 👍


Fix this Images in for smaller Screens

Description
The Dive into the world of Development section in bigger resolution is Good but in smaller size the GitHub logo and Flutter Image is not proper. Fix it.
Screenshots
In Smaller Screen

In Bigger Screen

Additional information
No response

I want to work on this. Please assign me.

@shivamgupta2020 assigned you


Cannot jax.jit the nonzero operator

The current implementation of nonzero operator is not supported to be jit'ed.
When put the jax model inside jax.jit, there will be an error:
Traceback (most recent call last):
  File "/usr/local/google/home/username/jaxonnxruntime/scripts~/model_run_through.py", line 79, in <module>
    main()
  File "/usr/local/google/home/username/jaxonnxruntime/scripts~/model_run_through.py", line 54, in main
    _ = infer(inputs)
  File "/usr/local/google/home/username/jaxonnxruntime/scripts~/model_run_through.py", line 53, in infer
    return jax_model(params, inputs)
  File "/usr/local/google/home/username/jaxonnxruntime/jaxonnxruntime/call_onnx.py", line 101, in model_func
    outputs = jit_func(*node_inputs, **node.attrs_dict)
  File "/usr/local/google/home/username/jaxonnxruntime/jaxonnxruntime/onnx_ops/nonzero.py", line 74, in onnx_nonzero
    return jnp.stack(jnp.nonzero(x))
  File "/usr/local/google/home/username/anaconda3/envs/jort/lib/python3.9/site-packages/jax/_src/numpy/lax_numpy.py", line 1330, in nonzero
    size = core.concrete_or_error(operator.index, size,
jax.errors.ConcretizationTypeError: Abstract tracer value encountered where concrete value is expected: Traced<ShapedArray(int32[])>with<DynamicJaxprTrace(level=1/0)>
The size argument of jnp.nonzero must be statically specified to use jnp.nonzero within JAX transformations.
The error occurred while tracing the function infer at /usr/local/google/home/username/jaxonnxruntime/scripts~/model_run_through.py:51 for jit. This concrete value was not available in Python because it depends on the value of the argument inputs[0].

Below is the code to reproduce the error:
model = hub.load('gpt-2')
model = onnx.shape_inference.infer_shapes(model)
inputs = [np.random.normal(size=(1, 1, 1)).astype(np.int64)]
jax_model, params = call_onnx.call_onnx(model, inputs)

@jax.jit
def infer(inputs):
    return jax_model(params, inputs)

_ = infer(inputs)

The error message claimed that it should be compatible with jit if the argument size is set to be static. So I tried to workaround the jit error by changing the implementation to the following. But it still doesn't work because the size is still dependent on the value of inputs no matter what.
@functools.partial(jit, static_argnames=("size",))
def nonzero(*input_args,):
  """The impl for https://github.com/onnx/onnx/blob/v1.12.0/docs/Operators.md#NonZero."""
  assert len(input_args) == 1
  logging.warning("onnx_nonzero cann not support jax.jit mode.")
  (x,) = input_args
  return jnp.stack(jnp.nonzero(x))

def onnx_nonzero(*input_args):
  (x,) = input_args
  size = jit(jnp.where)(x != 0, 1, 0).sum().item()
  return nonzero(*input_args, size=size)

If we use the above implementation for nonzero, there will still be an error:
Traceback (most recent call last):
  File "/usr/local/google/home/username/jaxonnxruntime/scripts~/model_run_through.py", line 79, in <module>
    main()
  File "/usr/local/google/home/username/jaxonnxruntime/scripts~/model_run_through.py", line 54, in main
    _ = infer(inputs)
  File "/usr/local/google/home/username/jaxonnxruntime/scripts~/model_run_through.py", line 53, in infer
    return jax_model(params, inputs)
  File "/usr/local/google/home/username/jaxonnxruntime/jaxonnxruntime/call_onnx.py", line 101, in model_func
    outputs = jit_func(*node_inputs, **node.attrs_dict)
  File "/usr/local/google/home/username/jaxonnxruntime/jaxonnxruntime/onnx_ops/nonzero.py", line 77, in onnx_nonzero
    size = jit(jnp.where)(x != 0, 1, 0).sum().item()
  File "/usr/local/google/home/username/anaconda3/envs/jort/lib/python3.9/site-packages/jax/_src/numpy/array_methods.py", line 795, in meth
    return getattr(self.aval, name).fun(self, *args, **kwargs)
  File "/usr/local/google/home/username/anaconda3/envs/jort/lib/python3.9/site-packages/jax/_src/numpy/array_methods.py", line 83, in _item
    return int(a)
jax.errors.ConcretizationTypeError: Abstract tracer value encountered where concrete value is expected: Traced<ShapedArray(int32[])>with<DynamicJaxprTrace(level=1/0)>
The problem arose with the `int` function. If trying to convert the data type of a value, try using `x.astype(int)` or `jnp.array(x, int)` instead.
The error occurred while tracing the function infer at /usr/local/google/home/username/jaxonnxruntime/scripts~/model_run_through.py:51 for jit. This concrete value was not available in Python because it depends on the value of the argument inputs[0].

This error is casued by calling jnp_array.item() inside a jit'ed function. If we remove .item(), it still won't work with the following error message. The size within onnx_nonzero() becomes a jnp.array this time, and we can't input a jnp.array as a static argument as it's unhashable.
Traceback (most recent call last):
  File "/usr/local/google/home/username/jaxonnxruntime/scripts~/model_run_through.py", line 79, in <module>
    main()
  File "/usr/local/google/home/username/jaxonnxruntime/scripts~/model_run_through.py", line 49, in main
    jax_model, params = call_onnx.call_onnx(model, inputs)
  File "/usr/local/google/home/username/jaxonnxruntime/jaxonnxruntime/call_onnx.py", line 87, in call_onnx
    outputs = jit_func(*node_inputs, **node.attrs_dict)
  File "/usr/local/google/home/username/jaxonnxruntime/jaxonnxruntime/onnx_ops/nonzero.py", line 78, in onnx_nonzero
    return nonzero(*input_args, size=size)
ValueError: Non-hashable static arguments are not supported. An error occurred during a call to 'nonzero' while trying to hash an object of type <class 'jaxlib.xla_extension.ArrayImpl'>, 1. The error was:
TypeError: unhashable type: 'ArrayImpl'

I believe the argument size of nonzero is always dependent on the value of inputs, which makes nonzero impossible to be jit'ed. If we set it to be a fixed size, then the implementation won't be compatible with the onnx model structure.

It looks that currently jax have no way since xla can not support. I believe after jax2tf.call_tf land the new feature call_tf_graph=True, we can support it.

@jinning-li  can we close it now ? Thanks

Sure. The issue was resolved by https://github.com/google/jaxonnxruntime/pull/32. Thanks!


Upgrade rust to nightly-2019-07-19

What have you changed? (mandatory)
Upgrade the toolchain in an attempt to fix likely pipelining error, "error: crate librocksdb_sys required to be available in rlib format, but was not found in this form". re
https://github.com/tikv/tikv/issues/5130
As noted on the issue, a pipelining bug was fixed after we adopted pipelining. This upgrade may fix the error @BusyJay and others have been seeing.
What are the type of the changes? (mandatory)

Engineering (engineering change which doesn't change any feature or fix any issue)

How has this PR been tested? (mandatory)
make dev
Does this PR affect documentation (docs) or release note? (mandatory)
No
Does this PR affect tidb-ansible update? (mandatory)
No
Refer to a related PR or issue link (optional)
https://github.com/tikv/tikv/issues/5130
Benchmark result if necessary (optional)
Add a few positive/negative examples (optional)

you also need to run ./scripts/gen-dockerfile.sh to update the toolchain in docker.

You will need to update the docker file as suggested by @siddontang and also sign off your commits :)

Additionally CI failed because of some deprecate notes maybe you need to take a look.

Is #4301 resolved by this version?

CI still failed @brson

Ping @brson

I'm still working through clippy changes.

This is updated to fix all the clippy lints. I tried updated to a newer toolchain but they are broken with an error about "unrecognized option: json-rendered".

Looks like there are still some warnings according to CI:
https://internal.pingcap.net/idc-jenkins/blue/organizations/jenkins/tikv_ghpr_test/detail/tikv_ghpr_test/7275/pipeline

The rest looks good to me and I will approve it once CI is passed :)

em, CI still failed
maybe we need to upgrade to the latest toolchain?

/run-all-tests

/run-all-tests

/run-integration-ddl-test

/run-integration-compatibility-test


[Poll] Which Redis WordPress Object Cache plugins do you use/recommend?

Related to #472
We have tried a few but there is no clear winner. Below is a list of some. There are many.

https://wordpress.org/plugins/wp-redis/
https://github.com/BenjaminAdams/wp-redis-cache
https://github.com/ericmann/Redis-Object-Cache/blob/master/object-cache.php
https://wordpress.org/plugins/redis-cache/

Things we need to check:

[ ] How they implement object-cache
[ ] wp-admin option to enable/disable object-cache,
[ ] wp-admin cache usage/status
[ ] wp-cli integration

https://wordpress.org/plugins/redis-cache/

I've been using https://wordpress.org/plugins/wp-redis/ and it's been fine. Set it and forget it.

I am not a developer but I've always liked WP Redis. Check my thinking on this. Memcached is faster, but memory is limited. HDD is huge, but I/O is slow, compared to memory. The hottest stuff should go to memcached, and all the rest can go to cache files. So, which version of Redis management is probably less important than having NginX make intelligent decisions as to which goes where?

I've used https://wordpress.org/plugins/wp-redis/ and prefer that. (Doesn't have wp-admin ui)
EE3 used to install https://wordpress.org/plugins/redis-cache and i think it checks all boxes.
I've not used rest of two but seems like it doesn't have wp-cli support.

@chandrapatel EE makes sure PhPredis C-extension is always available
WP_REDIS_DISABLED is not needed as came can be done with wp-cli (all EE sites have wp-cli).
I think at some point we will use Redis Hashes feature so let's continue with wp-redis in V4.
Thanks a ton for an in-depth review! 🙇

I've been using number 4 from @tillkruss for many years. at the time that i chose it, it was the only one that worked reliably for me. I had problems with the pantheon wp-redis plugin causing insane CPU usage on my server. I'm sure whatever that is has been fixed in the mean time, but once i started using number 4, i had no reason to switch.
here are some things i like about it:

actively developed here on github and the developer is open to contributions
has a lot of parameters for advanced users to configure operation
has an admin front end that lets you click a button to install / uninstall the object-cache.php dropin.
supports wp-cli commands
admin gives you a status and tells you which client back end is being used
supports many redis client back ends
supports replication and clustering
has code by yours truly that allows wildcard purging of the object cache based on the salt prefix. not sure this is super-useful for v4 since it seems to put up a separate redis container for each site, but on a shared server architecture where one redis instance is storing keys for multiple sites, this lets you purge cache for one site without affecting cache for others.


ios13 compatibility

(Required) Version Number: 8.0.1 (and master)
Description
There it seems to be some strange interaction between reusable cells and iOS 13. Is there any chance there is something to be changed in the code to support iOS 13? Am I the only one to experience these problems?
The behaviour I'm experiencing is the following one: I am changing the appearance of cells depending on whether the cell represents a date:

is in the current month
is a day before today
in the first case the cell contents will be hidden; in the second case the text will appear in gray instead of black.

On the iOS 12 simulator everything is fine. On the iOS 13 simulator colors and hidden cells do not seem to work properly (they seems to show some random behaviour). My hypothesis is that something changed in how reusable cells are used and (maybe) there is something new I have to do to support this behaviour properly.
Steps To Reproduce
I have not at hand a sample project. But I can share my code if useful.
Expected Behavior
Additional Context

hmm. I did not notice any of those things. Maybe a sample app can help me?

Hi @patchthecode, I've added you to the github project for the app I'm testing. It is not really a "sample app", but it is the best I can do at the moment.
You can find the calendar delegates in the file: MainViewController+CalendarDelegates.swift;
the view I'm using for the calendar cells is in DayCellView.swift.
Note: the project is Carthage based.

Hey, just getting back to this. Had a busy week.
What is the link to the project? I didnt see any notofications.

Hey, just getting back to this. Had a busy week.
What is the link to the project? I didnt see any notifications. If its a private project, can you send me a link at<EMAIL_ADDRESS>
Hi Jay, did you receive the mail?

Sorry for the late reply. Will check! thanks.

Hi @patchthecode, do not waste your time. I just realised I was working on code that has not been yet committed. You would not be able to compile the project. I need to do some work on that code before committing it. I'll do the work and if at the end the problem persist I will try to bother you again.
Once again for your generous offer to look through my code.
All the best.

i am not bothered. I just got a little tied up trying to do multiple projects 😅.
If you still have the issue, then re-open this, i'll take a look

Hi Jay,
   I didn’t mean to imply you were bothered. This is not my first language so maybe it came off differently to what I intended.
I know very well the efforts you are willing to put to help everyone. I really only meant that I was going to fix things as best as I could before wasting your time due to problems in my code/repository.
Have a good day,
Roberto

Awesome thanks man.

Here I am. Cleaned up the project and fixed the repository. I still have the problem unfortunately.
I'm reopening the issue. Also, to simplify your work I have uploaded a .zip containing everything you need to look into the problem (if I did everything correctly, Carthage and other dependencies should already be there, if you open the workspace and just hit build you should be good to go).
I removed the .git directory to make the archive smaller. You still have access to the repository via GitHub if you need it.
I'll be mailing the download link to your personal mail in a second.
Thanks in advance for your help.

Try to implement the prepareForReuse()  function in the cellView like this:
        override func prepareForReuse() {
		resetAllTheUIWithBasicStyle()
	}

I  had the same problem and fixed with this.

Ok, this definitely seems to be a change in iOS 13.
Thanks for taking a look @AndreaMiotto
I got tied up with a number of projects to take a look in a timely manner.
Since this problem never existed prior to iOS13 I think I should force users to implement this function, and also update the tutorials.
Marking this with update flag.

Try to implement the prepareForReuse() function in the cellView like this:
        override func prepareForReuse() {
		resetAllTheUIWithBasicStyle()
	}

I had the same problem and fixed with this.

I've tried to override prepareForReuse so to reset all UI style so to match the "clean" state. I can see that the function is called, but this makes no difference in my case. Am I missing something? I've implemented it in my JTACDayCell subclass.

I'll  be free tommorrow.
I'll try it on my sample project. If @AndreaMiotto  's suggestion works, then i'll post a fix.

Try to implement the prepareForReuse() function in the cellView like this:
        override func prepareForReuse() {
		resetAllTheUIWithBasicStyle()
	}

I had the same problem and fixed with this.

I've tried to override prepareForReuse so to reset all UI style so to match the "clean" state. I can see that the function is called, but this makes no difference in my case. Am I missing something? I've implemented it in my JTACDayCell subclass.

Can you put here your reset code and you style code for the cell?

Can you put here your reset code and you style code for the cell?

Sure, sorry for the delay: https://gist.github.com/boborbt/d1aca6c8fcd00a10db5ffc4aea3038e1
Thanks in advance.

Hi Jay, I found the problem. If you look at my code (I shared the relevant class in gist https://gist.github.com/boborbt/d1aca6c8fcd00a10db5ffc4aea3038e1), I updated the appearance of cells using the following function:
private func updateMarksColor() {
        switch colorEmphasis {
        case .normal:
            self.alpha = 1.0
        case .dim:
            self.alpha = 0.3
        case .hidden:
            self.alpha = 0.0
        }
    }

The problem appears to be related to the fact that for whatever reason in iOS 13 the alpha property on the JTACDayCell seems to be not restored correctly when reusing cells (this is my best understanding of the matter).
I fixed the problem by setting the alpha value of the relevant part of the cells instead of setting it for the whole cell. The new code looks is:
    private func updateMarksColor() {
        switch colorEmphasis {
        case .normal:
            self.label.alpha = 1.0
            self.marksDisplayView.alpha = 1.0
        case .dim:
            self.label.alpha = 0.3
            self.marksDisplayView.alpha = 0.3
        case .hidden:
            self.label.alpha = 0.0
            self.marksDisplayView.alpha = 0.0
        }
    }

and it works well.
Hope this helps. I guess you will want to close this issue, I will not do it myself since you might want to investigate further the issue.

yea.. i keep saying that i will look. but i am so caught up on this project, that i do not want to make any further promises.
I am still investigating SwiftUI and just getting used to it.
Sorry I couldnt get to this sooner.
I will leave this open because i will get to it.


Network ray casting - custom helper

Networks ray casting helper
Build ray casting helper with following features:

ignore selected segments (by flag or array of ids)
ignore nodes (by flag or array of ids)
return collection of node ids based on current mode (normal/underground)
return collection of segment ids based on current mode (normal/underground)

bonus:

refactor existing tool code for detection of hovered network elements

If checking camera distance... https://github.com/Quistar-LAB/EManagersLib/blob/master/EMath.cs#L269


Unable to send DWN messages to target without send()

dwn.write() is missing a target property, so Bob creating a message like this where he doesn't store it in his local DWN and it's not sent to the recipient won't make it to Alice without Bob explicitly calling send()
  const { record } = await web5.dwn.records.create({
    store: false,
    data: 'sup Alice,
    message: {
      recipient: 'did:example:alice',
      dataFormat: 'text/plain',
    },
  });

From a convo with @diehuxx, it seems the recipient field is more of a protocol access based property, and not the same as target, so specifying recipient is not enough here. Bob needs to be able to specify a target on this message so that it is written to Alice's DWN.
Work around for now is to create this record then call send() to make sure it's sent to Alice.

@angiejones This should probably be moved over to web5-js since the web5.dwn.records.create() API is from the @web5/api package and not dwn-sdk-js.
The use of record.send() for this was intentional and based on exploring a number of different approaches and asking for feedback from devs directly and via Discord.  All of the approaches had tradeoffs, so I can definitely understand there being some confusion.  Happy to discuss in more detail to see if there's an opportunity to improve the docs or change the API again.


japanese translation is too slang.

For example:
https://github.com/jakubgarfield/Bonobo-Git-Server/blob/564556b0d03867d6a498aa7dff0cba2e4e16ab6f/Bonobo.Git.Server/App_GlobalResources/Resources.ja-JP.resx#L160
https://github.com/jakubgarfield/Bonobo-Git-Server/blob/564556b0d03867d6a498aa7dff0cba2e4e16ab6f/Bonobo.Git.Server/App_GlobalResources/Resources.ja-JP.resx#L160
I point to many sentences.

Please have a look at the latest version. if you still feel it is too slang please reopen the issue.

I forgot to close this when this commit had merged. https://github.com/jakubgarfield/Bonobo-Git-Server/commit/44f8c21f19f95e57afe89ca563cebd8a529cf513
thanks.


[CLI] Import wandb SDK does not work in Jupyter Notebook on Linux

Description
Wandb fails to load sdk.lib
Wandb features
Version: 0.7 - 0.12.6 all yield same problem
Code: import wandb
Error:
ModuleNotFoundError                       Traceback (most recent call last)
 in
----> 1 import wandb
/userdata/kaylo/anaconda3/envs/voca/lib/python3.6/site-packages/wandb/init.py in
32 from wandb.errors.term import termsetup, termlog, termerror, termwarn
33
---> 34 from wandb import sdk as wandb_sdk
35
36 import wandb
/userdata/kaylo/anaconda3/envs/voca/lib/python3.6/site-packages/wandb/sdk/init.py in
5 """
6
----> 7 from . import wandb_helper as helper  # noqa: F401
8 from .wandb_alerts import AlertLevel  # noqa: F401
9 from .wandb_artifacts import Artifact  # noqa: F401
/userdata/kaylo/anaconda3/envs/voca/lib/python3.6/site-packages/wandb/sdk/wandb_helper.py in
6 from wandb.errors import UsageError
7
----> 8 from .lib import config_util
9
10
ModuleNotFoundError: No module named 'wandb.sdk.lib'
How to reproduce
I am not sure how to reproduce this to be honest. It just happens on a fresh import
After deleting the package in the environment and reinstalling the latest version, I did confirm wandb/sdk/lib is a directory in the installed source code. All other code and packages run as desired.
That being said, I have a separate program using wandb in a separate directory in a large server system, but using the same config and account, and that program runs fine. After running that program, this is when the issue started.
Edit: I've verified that "import wandb" works using Python 3.6 from the command line and it is only via running on jupyter notebook (v6.2.0) that this problem occurs
Environment

OS: Ubuntu 20.04.3 LTS
Environment: Conda
Python Version:  3.6

Is this a common bug? This happens when reloading everything from scratch on a fresh build.

After deleting the package in the environment and reinstalling the latest version, I did confirm wandb/sdk/lib is a directory in the installed source code.

I had the same problem importing wandb from Google Colab.

We're working on a long term fix, the problem is being caused by the shortuuid library.  If you run the following, importing wandb should work:
pip install --force shortuuid==1.0.1


Numerical computing overhaul

This is a big overhaul of our numerical computing packages. The biggest change is replacing ATLAS with OpenBLAS in the following packages:

suitesparse
arpack
julia
hmatrix
R
numpy and scipy

This will decrease build times. Dynamic architecture detection improves performance on all platforms.
Some of these packages previously experienced segfaults when built with OpenBLAS due to its use of 64-bit integers in the BLAS and LAPACK interfaces. (Standard BLAS and LAPACK use 32-bit integers, even on 64-bit platforms.) We now build two versions of OpenBLAS; openblas uses platform-native integers, while openblasCompat uses 32-bit integers to be compatible with standard BLAS and LAPACK. Packages that depend on OpenBLAS natively (suitesparse, arpack, and julia) now use platform-native integers. Packages that depend on BLAS and LAPACK generically (hmatrix, R, numpy, and scipy) use 32-bit integers still.
@peti I use hmatrix myself extensively; I have tested these changes on my code without incident. I do not use R myself, but its tests continue to pass with these changes. For numpy and scipy, I have checked the short tests in #6772, but done no extensive testing.
I have improved the suitesparse package so that now it also builds shared libraries.
@7c6f434c I think you are listed as the maintainer of Julia. This PR includes a significant refactoring of the expression for julia03. There were several unused dependencies, which I removed. I also removed almost all of the private libraries in favor of the system versions. I updated to julia-0.3.9, released recently. Because suitesparse now provides shared libraries, I removed that step from the Julia build. I also changed the expression style in places to match the rest of Nixpkgs better. If any of these changes are a problem for you, I am happy to revert them, please just let me know. Also, can we drop julia02? That would also allow us to drop the old version of suitesparse.
I don't want to drop any huge changes on the other maintainers, so I will wait 48 hours before merging this, to see if there are any complaints.

I forgot to mention, regarding Julia:
I also generalized the architecture settings. The i686-linux build now works, and x86_64-darwin should also work (but I can't test it). I also generalized the JIT target because the x86_64-linux build wouldn't work on pre-Bulldozer AMD CPUs. I think the Hydra builds should be more compatible than that.

I just added two commits to switch Octave and its dependencies to OpenBLAS.
A quick grep reveals that only a few packages still require ATLAS, so I'll go for broke and switch them all.

This is gonna be interesting. :+1:

i've tested this on darwin. looks like clang (from xcode) does not support USE_OPENMP=1 option for openblas. i get
building path(s) ‘/nix/store/w3jgr6926p0hn0b8shj96hkh1y5v7wqj-openblas-0.2.14’
unpacking sources
unpacking source archive /nix/store/arpi0lqjwfaj4xg4yfri16w0s3jvp53q-openblas-0.2.14.tar.gz
source root is xianyi-OpenBLAS-2b0d8a8
patching sources
configuring
no configure script, doing nothing
building
make flags: SHELL=/nix/store/sl3scf6za8b9bpr4ynfkfh6sqn3rcdvl-bash-4.3-p33/bin/bash DYNAMIC_ARCH=1 NUM_THREADS=64 MACOSX_DEPLOYMENT_TARGET=10.9 FC=gfortran CC=clang PREFIX="$(out)" BINARY=64 USE_OPENMP=1 INTERFACE64=0
Makefile.system:379: *** OpenBLAS: Clang didn't support OpenMP yet..  Stop.

without USE_OPENMP=1 option openblas builds fine on darwin.
i've only tested nix-build -A pythonPackages.scipy.

Another option might be to use newer clang from nixpkgs on darwin, but disabling openmp should be easier for now.

@garbas Thanks for the report! I have disabled OpenMP on Darwin now. It is still enabled by default on other platforms because if another package links to OpenBLAS and uses OpenMP, it will segfault otherwise. That shouldn't be an issue on Darwin, though, because nothing can use OpenMP.

Tarball works now.


Controlling InspectorWindows

Is there a way to access InspectorWindows and say control when a window is open, currently forking and making it public, and adding want I need.  Am I missing something?
Still new to bevy and egui, and first time using bevy-inspector-egui.  Really a pleasure to use though =-)

I exposed the InspectorWindows now in the main branch, this is how you can control the visibility:
https://github.com/jakobhellermann/bevy-inspector-egui/blob/f73bd92968bdaf8fb0b6e017768038730942ba34/examples/hide_window.rs#L23-L24
I'll release a new version soon.

Huge thanks, love your work.

Sorry, to add to that, is there a way to control WorldInspector windows? I didn't find anything obvious from looking at the API.

Closing WorldInspector? Any suggestions?


Update Install-NSIS.ps1

Update NSIS to 3.08
See notes in #4739
Description
New tool, Bug fixing, or Improvement?
Please include a summary of the change and which issue is fixed. Also include relevant motivation and context.
For new tools, please provide total size and installation time.

Related issue:
Check list

[ ] Related issue / work item is attached
[ ] Tests are written (if applicable)
[ ] Documentation is updated (if applicable)
[ ] Changes are tested and related VM images are successfully generated

/azp run windows2016, windows2019, windows2022

@andrew-r-king would you mind moving the version to the toolset file in the https://github.com/actions/virtual-environments/tree/main/images/win/toolsets folder?
Something like this would be fine
    "nsis": {
        "version": "3.08"
    },

And in the script you can get the version using our helper function:
$nsisVersion = (Get-ToolsetContent).nsis.version
This will allow us to avoid changes in the installation script next time when NSIS needs to be updated.

@miketimofeev Not a problem. See commit d564ca2. Let me know if anything else should be tweaked.

/azp run windows2016, windows2019, windows2022


Release 1.1.1 appears to have broken graypy

Release 1.1.1 an hour ago.

from graypy import GELFHandler
Traceback (most recent call last):
File "", line 1, in
ImportError: cannot import name 'GELFHandler'

Is the 1.x release not intended to be backwards compatible with 0.3.x releases?

Yes 1.X.X is backwards breaking as majority of Handlers have been renamed and restructured.

Noted that graypy version 1.X.X+ is backwards breaking from graypy version 0.3.X+.


Add more controls

There should be a collapse / extend all button for grids using tree-like grids.
In extension, there should also be a Find-Replace Function.

Solved in release v2.4.0


[New Feature] Support synchronizing MySQL binlog in real time [stage 1]

Proposed changes
This commit is the first stage of #6287
In this commit, we support:
1、Sync Job
1)、 Creating sync job and data channel in Fe.
2)、Pause sync job.
3)、Resume sync job.
4)、Stop sync job.
5)、Show sync jobs.
2、Canal
1)、Subscribing and getting the binlog data of canal with creating syncjob.
Types of changes
What types of changes does your code introduce to Doris?
Put an x in the boxes that apply

[x] New feature (non-breaking change which adds functionality)

Checklist
Put an x in the boxes that apply. You can also fill these out after creating the PR. If you're unsure about any of them, don't hesitate to ask. We're here to help! This is simply a reminder of what we are going to look for before merging your code.

[x] I have created an issue on (Fix #6287 ) and described the bug/feature there in detail
[x] Compiling and unit tests pass locally with my changes
[x] I have added tests that prove my fix is effective or that my feature works

Further comments
If this is a relatively large or complex change, kick off the discussion at<EMAIL_ADDRESS>by explaining why you chose the solution you did and what alternatives you considered, etc...

LGTM

This feature is disable by default now, some performance issue should be handled. And document is also needed at next PR.


[CI/Build] Update mistral_common version for tests and docs

#10367 updated mistral_common only in requirements-common.txt. To maintain consistency, this PR updates it for the other files as well.

Wait, let me update the pip-compiled file as well


[BrokenLinksH2] Fixed the link path

Deactivated the Example URLs

@v-sidlama : Thanks for your contribution! The author(s) have been notified to review your proposed change.

Docs Build status updates of commit 4935a9b:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

microsoft-community-training/rest-api-management/api-documentation.md
:white_check_mark:Succeeded
View

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching the docs.microsoft.com contributor guidesPost your question in the Docs support channel

#sign-off

@v-sidlama: I'm sorry - only the author of this article, @nikotha, can sign off on your changes. But we do have an exception process - if you are on the Microsoft content or product team for this product area, you can ask the PR review team to review and merge it by sending mail to the techdocprs alias.


Add tests to evaluation log entries conversion.

Summary
This adds minimal test coverage to evaluation history log entries conversion in order to prevent issues like the one solved by commit 5ad938d8b2c8.
Change Type

[ ] Bug fix (resolves an issue without affecting existing features)
[ ] Feature (adds new functionality without breaking changes)
[ ] Breaking change (may impact existing functionalities or require documentation updates)
[ ] Documentation (updates or additions to documentation)
[X] Refactoring or test improvements (no bug fixes or new functionality)

Testing
Unit tested.
Review Checklist:

[X] Reviewed my own code for quality and clarity.
[ ] Added comments to complex or tricky code sections.
[ ] Updated any affected documentation.
[X] Included tests that validate the fix or feature.
[X] Checked that related changes are merged.

coverage: 54.411% (+0.2%) from 54.183%
when pulling 579b16ba452644b458174e32ef7b3935a0f9721f on test/evaluation-history-log-db-conversion
into 8041df27e1a06c680702ecce1ac9c05055a3dc15 on main.


/articles: "See more..." button seems unnecessary

Example: https://redesign.aprillion.workers.dev/questions/8QH5/Would-a-slowdown-in-AI-capabilities-development-decrease-existential-risk
None of the articles are particularly long (this example is 6 minutes). I think the button makes the page unnecessarily messy, and also leads to some confusion about the reading time (whether it's 6 minutes for the whole article or just until the button).

@melissasamworth

Hmm yeah, it is not the best design. I remember a few stakeholders wanting to keep it but... I probably agree with you. Let's remove it for now.

This is mainly a copy thing

@melissasamworth I remember us discussing this recently, what was the final verdict on whether we are removing this functionality? We (in copy) are OK either way, since it's not as relevant as when the website was infinite scrolling and it's not a lot of work to remove it from all existing articles.
If we decide to remove them, we can do so in the articles and style guide and then @mruwnik can eventually remove the code that deals with it from the backend

After discussing this with the folks from Copy, @melissasamworth and @ricewithabee we could benefit from a discussion to better understand the pros and cons of removing the [See more...] functionality

My opinion:
Reasons to keep it: none.
Reasons to remove it: cleaner UI, less confusion around the reading time stated at the top of the page.

Some positive user feedback on this functionality
https://docs.google.com/document/d/1SY2VqnSfd4qCMnv9rRyDiThJsIKIDOiTARbKYLHwKng/edit
Intro to AI safety
I stop him at “See more” and ask him about it. He thinks the 4-minute helps. He thought the “see more” might make him lose the page, and was happy to see that it does not. He thinks the “see more” has some value to feel like you can get a quick version. Would have expected the label “see more” to point to other articles, and not to the rest of the article. Suggest we might want to say “keep reading” or something. I point out that “keep reading” is already used, but we will take it into consideration.

I opened a PR to completely remove the feature from the codebase
https://github.com/StampyAI/stampy-ui/pull/833


Update convention-based locations that partials and layouts are looked for from Razor Pages

When a partial or layout is referred to from a Razor Page, e.g. @await Html.PartialAsync("_LoginPartial") and @{ Layout = "_Layout"; }, currently, the standard MVC-view locations are searched, which is clearly wrong.
The search order should be:

folder containing the current Razor Page
each parent folder of the above all the way to and including the configured Razor Pages root

I'm in two-minds as to whether we should also include a "Shared" folder in the paths to search while walking the folder hierarchy, like views do.

I chose that because it's the same semantic as _PageImports & _PageStart (and their View counterparts) and seems logical (in my mind anyway).
Could we incorporate this into the existing logic and keep them unified?

We decided to drop the hierarchical bit and just look for files in same folder as current page, the configured pages root, and a Shared folder in each of those.

I didn't think we decided anything other than to figure out what's possible 😆

Well OK then, let's start with that 😖

The decision is to use the proposal at https://github.com/aspnet/Mvc/issues/6073#issue-219381287 - but with the second ordering of search paths in Appendix A.
We're going to ignore Appendix B for now.

a8eb5bee7023a2a5d49fcdaea0c25b3416a6921


Always become user we are managing

Enhancement: Enable changing to other non-root users
Reason: Fix #72
Result:
Issue Tracker Tickets (Jira or BZ if any):

[citest]

Could you add a test that reproduces the issue that you had in #72?

I'm not sure how to, to be honest.  I think the behavior would show up running test_user_units.yml if connecting as a non-root user, but I believe that depends on parts of the workflow that I can't see (i.e. something behind tft.yaml?)


DocsArchive-<IP_ADDRESS>Auto archive content

Auto archive content from https://github.com/OPS-E2E-PPE/docs-archive-test

Docs Build status updates of commit 295db2e:
:x: Validation status: errors
Please follow instructions here which may help to resolve issue.

File
Status
Preview URL
Details

:x:Error

Details

[Error]

Cannot sync git repo to specified commit because branch Archive_master_2019-09-29-13-13-59 has been deleted or has been force pushed: fatal: Couldn't find remote ref Archive_master_2019-09-29-13-13-59

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


Add bump.sh to Documentation Generators category

As discussed in issue #30, this adds https://bump.sh to the tooling page. I added a new Language/Kind column to the Documentation generators category.

All should be good now, thanks for the review :)


CI use os.linesep instead of \n if/when possible

should then have stricter tests during CI so that windows behaviour is as close as possible to linux one
Is this only necessary when parsing stdin / stdout, not when reading files?

just checked this, and linesep is only used when necessary (parsing stdout, stderr)


Seamless Sort

I'm using seamless in a substantial production project (and loving it by the way) and we are consistently struggling with one minor annoyance, .sort()
My daydream scenario is an override on any immutable array that gives me .sort() that does not mutate and returns an immutable copy, like map, filter, and reduce appear to do. But I'm open if there's a different preferred solution.
Right now we find ourselves using either
[].concat(functionChain).sort(comparator)
for when we MIGHT be immutable (IE when we're first wiring together some stuff) and
functionChain.asMutabe().sort(comparator) for when we know we are.
This is working ok, so it isn't too urgent, but an override feels like it would be very elegant and result in much more readable and portable code. It also seems a little more 'seamless' ^_^
EDIT: I might note that I understand why it currently throws the error it does, and perhaps a seamless version of sort should be put under a different name, allowing the old mutating method to continue throwing an error. I think there may be some reasonable debate there and I'm not overly committed to either side.

I second this. I don't care if the function is called sort or sorted or whatever but we need this.
We could also add sortBy('name') and sortBy(item => item.name) helpers ; or it may be beyon the scope of this library.

👍 to adding Immutable.sortBy (statically, not as an override - I want to preserve the "don't surprisingly change mutable methods to be non-mutating" behavior) if anyone wants to make a PR!

I've had a crack at this in #211

Any update on this? Came looking for sorting and found this. @LukeusMaximus PR seems to be stuck on a broken Travis build.

+1 here - just ran into the need for sorting.  An immutable sort replacement would be a good solution and I believe sort is enough of a required feature.

Any progress on this?

Any progress on this (more than half a year later)?

I'm looking for this issue.

I had an issue regarding the sort method cannot be invoked on an immutable data structure while working on a react-native project.
Here's my workaround on this issue is below:
import Immutable from 'seamless-immutable';
// Existing
[].sort(comparator function)
// Change into
Immutable.asMutable([]).sort(comparator function)

Can you sort a seamless-immutable array yet?


Fixed shader compilation issue on vega 7

texture2D() is deprecated since OGL ES 3.0, it's been replaced by texture(). This has caused the program not to work on vega 7 iGPUs.

Done manually


Exports two functions out of OOBE.cpp

The two functions subject to this set of changes were previosuly hidden by an anonymous namespace, but now we need to expose them so that the InstallerPolicy can call them.

CI warnings about unused functions resolved by removing them. Indeed they will not be necessary in the upcoming changes as well.


Func tests for multi record flag

rebased off #872

Can we also have a functional test added for checking for invalid record data for Add and DeleteRecordSet? Just want to ensure that we get an expected error rather than a HTTP 500 response from the API.

Can we also have a functional test added for checking for invalid record data for Add and DeleteRecordSet? Just want to ensure that we get an expected error rather than a HTTP 500 response from the API.

There's one for invalid record data for DeleteRecordSet test_create_batch_delete_record_for_invalid_record_data_fails and there's already tests for invalid record data for Adds for each of the record types.

@britneywright Am good with these changes once we add a JSON validation.
The test_create_batch_delete_record_for_invalid_record_data_fails test has properly formatted record. And we should have just one test similar to the adds for deletes - the reason being that we caught an issue where we weren't actually validating the record data specifically for DeleteRecordSet: https://github.com/vinyldns/vinyldns/pull/872/commits/e1c144c063b283280e75a23bb434e2ad0b2bd8d8. The add test follows a separate flow in the validation process so we should check the flow for DeleteRecordSet.

Closing as I merged this PR into https://github.com/vinyldns/vinyldns/pull/872.


Make FST BytesStore grow smoothly

Description

Too bad we don't have a writer that uses tiny (like 8 bytes) block at first, but doubles size for each new block (16 bytes, 32 bytes next, etc.). Then we would naturally use log(size) number of blocks without over-allocating.
But then reading bytes is a bit tricky because we'd need to take discrete log (base 2) of the address. Maybe it wouldn't be so bad -- we could do this with Long.numberOfLeadingZeros maybe? But that's a bigger change ... we can do this separately/later.

From https://github.com/apache/lucene/pull/12604#discussion_r1344639608

Note that oal.store.ByteBuffersDataOutput takes a different and neat approach to gracefully growing: it picks an initial block size, and appends new blocks as you write bytes, but then if it reaches 100 blocks, it "resizes" itself by doubling the block size and copying over, so that now you have 50 blocks.
So it's still O(N) amortized cost of that doubling/copying with time, and at any given moment you will not be wasting too many %tg of the bytes you've written, except at the start 1 KB block size.

In https://github.com/apache/lucene/pull/12624, I moved the main FST body out of BytesStore into ByteBuffersDataOutput, and BytesStore becomes only a single byte[] for the currently written node so maybe we don't need to do this?


General questions

Can you help me with a couple of general things?
My object looks like this:
AnnData object with n_obs × n_vars = 37814 × 1802
obs: 'n_genes', 'n_genes_by_counts', 'total_counts', 'total_counts_mt', 'pct_counts_mt', 'leiden'
var: 'gene_ids', 'feature_types', 'n_cells', 'mt', 'n_cells_by_counts', 'mean_counts', 'pct_dropout_by_counts', 'total_counts', 'highly_variable', 'means', 'dispersions', 'dispersions_norm', 'mean', 'std'
uns: 'log1p', 'hvg', 'pca', 'neighbors', 'umap', 'leiden', 'rank_genes_groups', 'leiden_colors'
obsm: 'X_pca', 'X_umap'
varm: 'PCs'
obsp: 'distances', 'connectivities'
As far as I am aware, 'leiden' contains the cluster ID of my cells. How can I copy this to another obs slot?
And, I have sample ID, from the loup output file. It is a CSV with cell barcode in one column and sample ID in the other. In R, using seurat, I would assinge this ID suing the following code, is there a similar way I can do this in python using scanpy?
aggr$sampleID=(samples_ID[match(rownames(aggr@meta.data),samples_ID$Barcode),2])
Finally, to perform DE in seurat, I would copy cluster ID to smaple ID using;
aggr$cluster_sampleID <- paste(Idents(aggr), aggr$sampleID, sep = "_")
What would be the best way to do this using Scanpy?
Many thanks,
Chris

Hi,
please ask usage questions here: https://discourse.scverse.org/


add mongodb clean script

mongoscript to clean notifications and email_queue.

Coverage remained the same at 82.826% when pulling 06779dabfe8c5901164cd67b9e42c585e6d9479d on matiu:mongodb-clean into b4afcd7a34ccf32605590ad8a782e811b8378702 on bitpay:master.