UnicodeDecodeError when downloading annotations using CVAT API

My actions before raising this issue

[x] Read/searched the docs
[x] Searched past issues

I wrote a script to automatically download completed tasks using CVAT API. However, when executing the script, an error occurs.
The issue is similar to this gitter
Steps to Reproduce (for bugs)

use a remotely hosted CVAT application
create a task (my task is a video annotation task)
pip install cvat_sdk (latest version v2.3.0)
code to reproduce: https://gist.github.com/emmeduz/9f78c9d1bad6a951f09bc43ff1d97d08

Expected Behaviour

The download starts with no issues
Current Behaviour

when downloading annotations using api_client.tasks_api.retrieve_annotations I get the following error:
Traceback (most recent call last):
  File "download_completed_tasks.py", line 74, in <module>
    (data, response) = api_client.tasks_api.retrieve_annotations(
  File "C:\Users\user\Anaconda3\lib\site-packages\cvat_sdk\api_client\api\tasks_api.py", line 3534, in retrieve_annotations
    return self.retrieve_annotations_endpoint.call_with_http_info(**kwargs)
  File "C:\Users\user\Anaconda3\lib\site-packages\cvat_sdk\api_client\api_client.py", line 1052, in call_with_http_info
    return self.api_client.call_api(
  File "C:\Users\user\Anaconda3\lib\site-packages\cvat_sdk\api_client\api_client.py", line 495, in call_api
    return self.__call_api(**params)
  File "C:\Users\user\Anaconda3\lib\site-packages\cvat_sdk\api_client\api_client.py", line 280, in __call_api
    return_data = self.deserialize(
  File "C:\Users\user\Anaconda3\lib\site-packages\cvat_sdk\api_client\api_client.py", line 377, in deserialize
    response_data = response.data.decode(encoding)
UnicodeDecodeError: 'utf-8' codec can't decode bytes in position 10-11: invalid continuation byte

Furthermore, somethimes, by re-running the script, I also get:
Traceback (most recent call last):
  File "download_completed_tasks.py", line 74, in <module>
    (data, response) = api_client.tasks_api.retrieve_annotations(
  File "C:\Users\user\Anaconda3\lib\site-packages\cvat_sdk\api_client\api\tasks_api.py", line 3534, in retrieve_annotations
    return self.retrieve_annotations_endpoint.call_with_http_info(**kwargs)
  File "C:\Users\user\Anaconda3\lib\site-packages\cvat_sdk\api_client\api_client.py", line 1052, in call_with_http_info
    return self.api_client.call_api(
  File "C:\Users\user\Anaconda3\lib\site-packages\cvat_sdk\api_client\api_client.py", line 495, in call_api
    return self.__call_api(**params)
  File "C:\Users\user\Anaconda3\lib\site-packages\cvat_sdk\api_client\api_client.py", line 280, in __call_api
    return_data = self.deserialize(
  File "C:\Users\user\Anaconda3\lib\site-packages\cvat_sdk\api_client\api_client.py", line 387, in deserialize
    deserialized_data = validate_and_convert_types(
  File "C:\Users\user\Anaconda3\lib\site-packages\cvat_sdk\api_client\model_utils.py", line 1590, in validate_and_convert_types
    converted_instance = attempt_convert_item(
  File "C:\Users\user\Anaconda3\lib\site-packages\cvat_sdk\api_client\model_utils.py", line 1479, in attempt_convert_item
    raise conversion_exc
  File "C:\Users\user\Anaconda3\lib\site-packages\cvat_sdk\api_client\model_utils.py", line 1470, in attempt_convert_item
    return deserialize_model(input_value, valid_class,
  File "C:\Users\user\Anaconda3\lib\site-packages\cvat_sdk\api_client\model_utils.py", line 1386, in deserialize_model
    return model_class._new_from_openapi_data(model_data, **kw_args)
  File "C:\Users\user\Anaconda3\lib\site-packages\cvat_sdk\api_client\model_utils.py", line 51, in wrapped_init
    return fn(_self, *args, **kwargs)
  File "C:\Users\user\Anaconda3\lib\site-packages\cvat_sdk\api_client\model_utils.py", line 355, in _new_from_openapi_data
    oneof_instance = get_oneof_instance(cls, model_kwargs, kwargs, model_arg=arg)
  File "C:\Users\user\Anaconda3\lib\site-packages\cvat_sdk\api_client\model_utils.py", line 1904, in get_oneof_instance
    raise ApiValueError(
cvat_sdk.api_client.exceptions.ApiValueError: Invalid inputs given to generate an instance of AnnotationsRead. Multiple oneOf schemas matched the inputs, but a max of one is allowed.

From a naive debugging, I noticed weird content in the variable "response.data" (api_client.py line 377), which is supposed to contain the json with all the annotations. Here's a snippet of the content:
obj_train_data/frame_010917.txtPK\x01\x02\x14\x03\x14\x00\x00\x00\x00\x00\xf8{\\V\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x1f\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\xa4\x81\x91\xfd\x03\x00
Possible Solution

The UnicodeDecodeError seems to occur when action="download is passed to the retrieve_annotations method.
Context

I want to use a python script to download task annotations (specifically, only completed tasks updated after a certain date).
I am able to download an AnnotationRead object using API (https://my.cvat.host.com/api/tasks/30/annotations). The problem seems to be with the creation of the zip file client side.
Your Environment

Git hash commit (git log -1): CVAT release v2.3.0
Operating System and version (e.g. Linux, Windows, MacOS): Windows and Linux (I also tested the script from Google Colab)
Code example or link to GitHub repo or gist to reproduce problem: https://gist.github.com/emmeduz/9f78c9d1bad6a951f09bc43ff1d97d08
Other diagnostic information / logs:
everything seems fine server side (no recent logs in any of the containers)

Hi, please use the _parse_response=False parameter for file downloads like here.

Thanks a lot for your reply. The error disappeared.
Can you also suggest the correct method to download annotations (without images) using the python SDK? (or pointing out the documentation for doing that?)
using the following lines nothing is downloaded. What am I missing?
(data, response) = api_client.tasks_api.retrieve_annotations(
                                                                    id=int(task['id']),
                                                                    action="download",
                                                                    _parse_response=False,
                                                                    format=args.export_format
                                                                    )

I always seem to get byte code when I try to download annotations with retrieve_annotations() (if I supply _parse_response=False)
But then there's no way simple to convert it to json or a dictionary. Any tips or hints?

Hi @zhiltsov-max are there more instructions anywhere on how to do those 3 steps?

Hi all,
I wrote an example script. It can't be used as it is, but I hope can help.
import os
import time
from pathlib import Path
from http import HTTPStatus
from urllib3 import HTTPResponse

from cvat_sdk.api_client import Configuration, ApiClient, exceptions
from cvat_sdk.api_client.api_client import Endpoint

def export_dataset(endpoint: Endpoint, file_name: Path, max_retries: int = 20, interval: float = 0.1, **kwargs) -> HTTPResponse:
    for _ in range(max_retries):
        (_, response) = endpoint.call_with_http_info(**kwargs, _parse_response=False)
        if response.status == HTTPStatus.CREATED:
            break
        if not response.status == HTTPStatus.ACCEPTED:
            raise Exception(f"response.status not {HTTPStatus.ACCEPTED}")
        time.sleep(interval)
    if not response.status == HTTPStatus.CREATED:
        raise Exception(f"response.status not {HTTPStatus.CREATED}")

    (_, response) = endpoint.call_with_http_info(**kwargs, action="download", _parse_response=False)

    if response.status == HTTPStatus.OK:
        save_zip(response, file_name)

    return response

# helper function
def save_zip(response, file_name, chunk_size=100):
    with open(f'{file_name}.zip', 'wb') as out:
        while True:
            data = response.read(chunk_size)
            if not data:
                break
            out.write(data)
    response.release_conn()

# helper function
def get_project_id_by_name(api_client: ApiClient, project_name: str, organization_name: str) -> int:
    """ Lists the available projects and returns the ID of the project with the given name """
    try:
        (project_data, response) = api_client.projects_api.list(org=organization_name)
        if response.status == 200:
            for project in project_data["results"]:
                if project["name"] == project_name:
                    return project["id"]
        raise exceptions.NotFoundError(f"Project {project_name} not found")
    except exceptions.ApiException as e:
        raise e

# Authenticate with CVAT
configuration = Configuration(host=CVAT_HOST, api_key={"tokenAuth": CVAT_TOKEN})

# create output directory
if not os.path.exists(args.export_dir):
    os.makedirs(args.export_dir)

with ApiClient(configuration) as api_client:
    try:
        # list all CVAT projects
        (data, response) = api_client.projects_api.list()
        if response.status == 200:
            project_id = get_project_id_by_name(api_client, args.project_name, args.organization_name)

            # retrieve all the tasks
            (data, response) = api_client.projects_api.list_tasks(id=project_id, org=args.organization_name, page_size=10000)

            # filter the response based on your need
            task_list = filter_response(data, filter_dict)

            paths = []
            for task in task_list:
                print(f"downloading task {task['id']}...")
                out_path = Path(args.export_dir, task.name)

                # https://github.com/opencv/cvat/issues/5779
                response = export_dataset(api_client.tasks_api.retrieve_annotations_endpoint,
                                          id=int(task['id']),
                                          file_name=out_path,
                                          format=args.export_format
                                          )
                status = response.status

                print("done.", status)
                paths.append(out_path)

            print("Download files located at", paths)

    except exceptions.ApiException as e:
        print("Exception when dowloading: %s\n" % e)


Can't install libmysql on OSX 10.14.2

Ultimately I'm trying to install Poco with mysql connector support. Or if someone can recommend a go-to stack for http server + mysql connector support, I'm open to suggestions. Many thanks in advance.
Package: libmysql:x64-osx
Vcpkg version: 2018.11.23-unknownhash
config-x64-osx-dbg-out.log:
-- Running cmake version 3.12.4
-- Found Git: /usr/bin/git (found version "2.17.2 (Apple Git-113)")
-- Configuring with MAX_INDEXES = 64U
-- The C compiler identification is AppleClang <IP_ADDRESS>01145
-- The CXX compiler identification is AppleClang <IP_ADDRESS>01145
-- Check for working C compiler: /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/cc
-- Check for working C compiler: /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/cc -- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Detecting C compile features
-- Detecting C compile features - done
-- Check for working CXX compiler: /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/c++
-- Check for working CXX compiler: /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/c++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- CMAKE_GENERATOR: Ninja
-- Performing Test HAVE_BUGGY_CLANG_VERSION
-- Performing Test HAVE_BUGGY_CLANG_VERSION - Failed
-- Performing Test HAVE_SUPPORTED_CLANG_VERSION
-- Performing Test HAVE_SUPPORTED_CLANG_VERSION - Success
-- Looking for sys/types.h
-- Looking for sys/types.h - found
-- Looking for stdint.h
-- Looking for stdint.h - found
-- Looking for stddef.h
-- Looking for stddef.h - found
-- Check size of void *
-- Check size of void * - done
-- SIZEOF_VOIDP 8
-- MySQL 8.0.4-rc
-- Packaging as: mysql-8.0.4-rc-osx10.14-x86_64
-- Performing Test C_LD_GOLD_RESULT
-- Performing Test C_LD_GOLD_RESULT - Failed
-- Performing Test CXX_LD_GOLD_RESULT
-- Performing Test CXX_LD_GOLD_RESULT - Failed
-- Found /Users/izmarverhage/git/vcpkg/installed/x64-osx/include/boost/version.hpp
-- BOOST_VERSION_NUMBER is #define BOOST_VERSION 106800
-- BOOST_INCLUDE_DIR /Users/izmarverhage/git/vcpkg/installed/x64-osx/include
-- Performing Test HAVE_LLVM_LIBCPP
-- Performing Test HAVE_LLVM_LIBCPP - Failed
-- Looking for pthread.h
-- Looking for pthread.h - found
-- Looking for pthread_create
-- Looking for pthread_create - found
-- Found Threads: TRUE
-- Looking for floor
-- Looking for floor - found
-- Looking for __infinity
-- Looking for __infinity - not found
-- Looking for __infinity in m
-- Looking for __infinity in m - not found
-- Looking for gethostbyname_r
-- Looking for gethostbyname_r - not found
-- Looking for gethostbyname_r in nsl_r
-- Looking for gethostbyname_r in nsl_r - not found
-- Looking for gethostbyname_r in nsl
-- Looking for gethostbyname_r in nsl - not found
-- Looking for bind
-- Looking for bind - found
-- Looking for crypt
-- Looking for crypt - found
-- Looking for setsockopt
-- Looking for setsockopt - found
-- Looking for dlopen
-- Looking for dlopen - found
-- Looking for sched_yield
-- Looking for sched_yield - found
-- Looking for clock_gettime
-- Looking for clock_gettime - found
-- Looking for timer_create
-- Looking for timer_create - not found
-- Looking for timer_create in rt
-- Looking for timer_create in rt - not found
-- Looking for atomic_thread_fence
-- Looking for atomic_thread_fence - found
-- Looking for backtrace
-- Looking for backtrace - found
-- Looking for include file alloca.h
-- Looking for include file alloca.h - found
-- Looking for include file arpa/inet.h
-- Looking for include file arpa/inet.h - found
-- Looking for include file dlfcn.h
-- Looking for include file dlfcn.h - found
-- Looking for include file endian.h
-- Looking for include file endian.h - not found
-- Looking for include file execinfo.h
-- Looking for include file execinfo.h - found
-- Looking for include file fpu_control.h
-- Looking for include file fpu_control.h - not found
-- Looking for include file grp.h
-- Looking for include file grp.h - found
-- Looking for include file ieeefp.h
-- Looking for include file ieeefp.h - not found
-- Looking for include file langinfo.h
-- Looking for include file langinfo.h - found
-- Looking for include file malloc.h
-- Looking for include file malloc.h - not found
-- Looking for include file netinet/in.h
-- Looking for include file netinet/in.h - found
-- Looking for include file poll.h
-- Looking for include file poll.h - found
-- Looking for include file pwd.h
-- Looking for include file pwd.h - found
-- Looking for include file strings.h
-- Looking for include file strings.h - found
-- Looking for include file sys/cdefs.h
-- Looking for include file sys/cdefs.h - found
-- Looking for include file sys/ioctl.h
-- Looking for include file sys/ioctl.h - found
-- Looking for include file sys/mman.h
-- Looking for include file sys/mman.h - found
-- Looking for include file sys/resource.h
-- Looking for include file sys/resource.h - found
-- Looking for include file sys/select.h
-- Looking for include file sys/select.h - found
-- Looking for include file sys/socket.h
-- Looking for include file sys/socket.h - found
-- Looking for include files curses.h, term.h
-- Looking for include files curses.h, term.h - found
-- Looking for include file termios.h
-- Looking for include file termios.h - found
-- Looking for include file termio.h
-- Looking for include file termio.h - not found
-- Looking for include file unistd.h
-- Looking for include file unistd.h - found
-- Looking for include file sys/wait.h
-- Looking for include file sys/wait.h - found
-- Looking for include file sys/param.h
-- Looking for include file sys/param.h - found
-- Looking for include file fnmatch.h
-- Looking for include file fnmatch.h - found
-- Looking for include file sys/un.h
-- Looking for include file sys/un.h - found
-- Looking for include file vis.h
-- Looking for include file vis.h - found
-- Looking for include file sasl/sasl.h
-- Looking for include file sasl/sasl.h - found
-- Looking for include file sys/devpoll.h
-- Looking for include file sys/devpoll.h - not found
-- Looking for include file sys/epoll.h
-- Looking for include file sys/epoll.h - not found
-- Looking for TAILQ_FOREACH
-- Looking for TAILQ_FOREACH - found
-- Looking for _aligned_malloc
-- Looking for _aligned_malloc - not found
-- Looking for backtrace
-- Looking for backtrace - found
-- Looking for printstack
-- Looking for printstack - not found
-- Looking for index
-- Looking for index - found
-- Looking for chown
-- Looking for chown - found
-- Looking for cuserid
-- Looking for cuserid - not found
-- Looking for directio
-- Looking for directio - not found
-- Looking for ftruncate
-- Looking for ftruncate - found
-- Looking for fchmod
-- Looking for fchmod - found
-- Looking for fcntl
-- Looking for fcntl - found
-- Looking for fdatasync
-- Looking for fdatasync - found
-- Looking for fdatasync
-- Looking for fdatasync - not found
-- Looking for fedisableexcept
-- Looking for fedisableexcept - not found
-- Looking for fseeko
-- Looking for fseeko - found
-- Looking for fsync
-- Looking for fsync - found
-- Looking for gethrtime
-- Looking for gethrtime - not found
-- Looking for getnameinfo
-- Looking for getnameinfo - found
-- Looking for getpass
-- Looking for getpass - found
-- Looking for getpassphrase
-- Looking for getpassphrase - not found
-- Looking for getpwnam
-- Looking for getpwnam - found
-- Looking for getpwuid
-- Looking for getpwuid - found
-- Looking for getrlimit
-- Looking for getrlimit - found
-- Looking for getrusage
-- Looking for getrusage - found
-- Looking for initgroups
-- Looking for initgroups - found
-- Looking for issetugid
-- Looking for issetugid - found
-- Looking for getuid
-- Looking for getuid - found
-- Looking for geteuid
-- Looking for geteuid - found
-- Looking for getgid
-- Looking for getgid - found
-- Looking for getegid
-- Looking for getegid - found
-- Looking for madvise
-- Looking for madvise - found
-- Looking for malloc_info
-- Looking for malloc_info - not found
-- Looking for memrchr
-- Looking for memrchr - not found
-- Looking for mlock
-- Looking for mlock - found
-- Looking for mlockall
-- Looking for mlockall - found
-- Looking for mmap64
-- Looking for mmap64 - not found
-- Looking for poll
-- Looking for poll - found
-- Looking for posix_fallocate
-- Looking for posix_fallocate - not found
-- Looking for posix_memalign
-- Looking for posix_memalign - found
-- Looking for pread
-- Looking for pread - found
-- Looking for pthread_condattr_setclock
-- Looking for pthread_condattr_setclock - not found
-- Looking for pthread_sigmask
-- Looking for pthread_sigmask - found
-- Looking for setfd
-- Looking for setfd - not found
-- Looking for sigaction
-- Looking for sigaction - found
-- Looking for sleep
-- Looking for sleep - found
-- Looking for stpcpy
-- Looking for stpcpy - found
-- Looking for stpncpy
-- Looking for stpncpy - found
-- Looking for strlcpy
-- Looking for strlcpy - found
-- Looking for strndup
-- Looking for strndup - found
-- Looking for strlcat
-- Looking for strlcat - found
-- Looking for strsignal
-- Looking for strsignal - found
-- Looking for fgetln
-- Looking for fgetln - found
-- Looking for strsep
-- Looking for strsep - found
-- Looking for tell
-- Looking for tell - not found
-- Looking for vasprintf
-- Looking for vasprintf - found
-- Looking for memalign
-- Looking for memalign - not found
-- Looking for nl_langinfo
-- Looking for nl_langinfo - found
-- Looking for ntohll
-- Looking for ntohll - not found
-- Looking for epoll_create
-- Looking for epoll_create - not found
-- Looking for inet_ntop
-- Looking for inet_ntop - found
-- Looking for kqueue
-- Looking for kqueue - found
-- Looking for timeradd
-- Looking for timeradd - found
-- Looking for timerclear
-- Looking for timerclear - found
-- Looking for timercmp
-- Looking for timercmp - found
-- Looking for timerisset
-- Looking for timerisset - found
-- Looking for include file sys/time.h
-- Looking for include file sys/time.h - found
-- Looking for include file sys/times.h
-- Looking for include file sys/times.h - found
-- Looking for times
-- Looking for times - found
-- Looking for gettimeofday
-- Looking for gettimeofday - found
-- Looking for lrand48
-- Looking for lrand48 - found
-- Looking for TIOCGWINSZ
-- Looking for TIOCGWINSZ - found
-- Looking for FIONREAD
-- Looking for FIONREAD - found
-- Looking for FIONREAD
-- Looking for FIONREAD - found
-- Looking for isinf
-- Looking for isinf - found
-- Performing Test HAVE_CXX_ISINF
-- Performing Test HAVE_CXX_ISINF - Success
-- Looking for timer_create
-- Looking for timer_create - not found
-- Looking for timer_settime
-- Looking for timer_settime - not found
-- Looking for kqueue
-- Looking for kqueue - found
-- Looking for EVFILT_TIMER
-- Looking for EVFILT_TIMER - found
-- Check if the system is big endian
-- Searching 16 bit integer
-- Check size of unsigned short
-- Check size of unsigned short - done
-- Using unsigned short
-- Check if the system is big endian - little endian
-- Check size of uint8_t
-- Check size of uint8_t - done
-- Check size of uint16_t
-- Check size of uint16_t - done
-- Check size of uint32_t
-- Check size of uint32_t - done
-- Check size of uint64_t
-- Check size of uint64_t - done
-- Check size of char *
-- Check size of char * - done
-- Check size of long
-- Check size of long - done
-- Check size of short
-- Check size of short - done
-- Check size of int
-- Check size of int - done
-- Check size of long long
-- Check size of long long - done
-- Check size of off_t
-- Check size of off_t - done
-- Check size of time_t
-- Check size of time_t - done
-- Check size of ulong
-- Check size of ulong - failed
-- Check size of u_int32_t
-- Check size of u_int32_t - done
-- Check size of socklen_t
-- Check size of socklen_t - done
-- Performing Test HAVE_VISIBILITY_HIDDEN
-- Performing Test HAVE_VISIBILITY_HIDDEN - Success
-- Performing Test HAVE_CLOCK_GETTIME
-- Performing Test HAVE_CLOCK_GETTIME - Success
-- Performing Test HAVE_CLOCK_REALTIME
-- Performing Test HAVE_CLOCK_REALTIME - Success
-- Looking for include files time.h, sys/time.h
-- Looking for include files time.h, sys/time.h - found
-- Looking for O_NONBLOCK
-- Looking for O_NONBLOCK - found
-- Performing Test HAVE_PAUSE_INSTRUCTION
-- Performing Test HAVE_PAUSE_INSTRUCTION - Success
-- Looking for C++ include cxxabi.h
-- Looking for C++ include cxxabi.h - found
-- Performing Test HAVE_ABI_CXA_DEMANGLE
-- Performing Test HAVE_ABI_CXA_DEMANGLE - Success
-- Performing Test HAVE_BUILTIN_UNREACHABLE
-- Performing Test HAVE_BUILTIN_UNREACHABLE - Success
-- Performing Test HAVE_BUILTIN_EXPECT
-- Performing Test HAVE_BUILTIN_EXPECT - Success
-- Performing Test HAVE_BUILTIN_STPCPY
-- Performing Test HAVE_BUILTIN_STPCPY - Success
-- Performing Test HAVE_GCC_ATOMIC_BUILTINS
-- Performing Test HAVE_GCC_ATOMIC_BUILTINS - Success
-- Performing Test HAVE_GCC_SYNC_BUILTINS
-- Performing Test HAVE_GCC_SYNC_BUILTINS - Success
-- Performing Test HAVE_SYS_GETTID
-- Performing Test HAVE_SYS_GETTID - Success
-- Performing Test HAVE_PTHREAD_GETTHREADID_NP
-- Performing Test HAVE_PTHREAD_GETTHREADID_NP - Failed
-- Performing Test HAVE_PTHREAD_THREADID_NP
-- Performing Test HAVE_PTHREAD_THREADID_NP - Success
-- Performing Test HAVE_INTEGER_PTHREAD_SELF
-- Performing Test HAVE_INTEGER_PTHREAD_SELF - Failed
-- Performing Test HAVE_IMPLICIT_DEPENDENT_NAME_TYPING
-- Performing Test HAVE_IMPLICIT_DEPENDENT_NAME_TYPING - Failed
-- Looking for netinet/in6.h
-- Looking for netinet/in6.h - not found
-- Check size of struct in6_addr
-- Check size of struct in6_addr - failed
-- Performing Test HAVE_SOCKADDR_IN_SIN_LEN
-- Performing Test HAVE_SOCKADDR_IN_SIN_LEN - Success
-- Performing Test HAVE_SOCKADDR_IN6_SIN6_LEN
-- Performing Test HAVE_SOCKADDR_IN6_SIN6_LEN - Success
-- Looking for include file numa.h
-- Looking for include file numa.h - not found
-- Looking for include file numaif.h
-- Looking for include file numaif.h - not found
-- NUMA library missing or required version not available
-- Found ZLIB: /Users/izmarverhage/git/vcpkg/installed/x64-osx/debug/lib/libz.a (found version "1.2.11")
-- Found OpenSSL: /Users/izmarverhage/git/vcpkg/installed/x64-osx/debug/lib/libcrypto.a (found version "1.0.2q")
-- Check size of mbstate_t
-- Check size of mbstate_t - done
-- Performing Test HAVE_LANGINFO_CODESET
-- Performing Test HAVE_LANGINFO_CODESET - Success
-- Looking for wcsdup
-- Looking for wcsdup - found
-- Check size of wchar_t
-- Check size of wchar_t - done
-- Check size of wint_t
-- Check size of wint_t - done
-- Found Curses: /usr/lib/libcurses.dylib
-- Performing Test HAVE_DECL_TGOTO
-- Performing Test HAVE_DECL_TGOTO - Success
-- Looking for strvis
-- Looking for strvis - found
-- Looking for strunvis
-- Looking for strunvis - found
-- PATH_TO_LZ4 /Users/izmarverhage/git/vcpkg/installed/x64-osx/include
-- LZ4_LIBRARY /Users/izmarverhage/git/vcpkg/installed/x64-osx/debug/lib/liblz4d.a
-- Looking for lzma_auto_decoder in /Users/izmarverhage/git/vcpkg/installed/x64-osx/debug/lib/liblzma.a
-- Looking for lzma_auto_decoder in /Users/izmarverhage/git/vcpkg/installed/x64-osx/debug/lib/liblzma.a - found
-- Looking for lzma_easy_encoder in /Users/izmarverhage/git/vcpkg/installed/x64-osx/debug/lib/liblzma.a
-- Looking for lzma_easy_encoder in /Users/izmarverhage/git/vcpkg/installed/x64-osx/debug/lib/liblzma.a - found
-- Looking for lzma_lzma_preset in /Users/izmarverhage/git/vcpkg/installed/x64-osx/debug/lib/liblzma.a
-- Looking for lzma_lzma_preset in /Users/izmarverhage/git/vcpkg/installed/x64-osx/debug/lib/liblzma.a - found
-- Found LibLZMA: /Users/izmarverhage/git/vcpkg/installed/x64-osx/include (found version "5.2.4")
-- Found the following ICU libraries:
--   uc (required)
--   io (required)
--   dt (required)
--   in (required)
--   data (required)
-- Found ICU: /Users/izmarverhage/git/vcpkg/installed/x64-osx/include (found version "61.1")
-- ICU_MAJOR_VERSION = 61
-- ICU_INCLUDE_DIRS /Users/izmarverhage/git/vcpkg/installed/x64-osx/include
-- ICU_LIBRARIES /Users/izmarverhage/git/vcpkg/installed/x64-osx/debug/lib/libicuuc.a;/Users/izmarverhage/git/vcpkg/installed/x64-osx/debug/lib/libicuio.a;/Users/izmarverhage/git/vcpkg/installed/x64-osx/debug/lib/libicudata.a;/Users/izmarverhage/git/vcpkg/installed/x64-osx/debug/lib/libicui18n.a;/Users/izmarverhage/git/vcpkg/installed/x64-osx/debug/lib/libicudata.a
-- No WITH_CURL has been set. Not using any curl library.
-- CURL_LIBRARY =
-- CURL_INCLUDE_DIR =
-- Performing Test HAVE_TAUTOLOGICAL_UNDEFINED_COMPARE
-- Performing Test HAVE_TAUTOLOGICAL_UNDEFINED_COMPARE - Success
-- Configuring incomplete, errors occurred!
config-x64-osx-dbg-err.log:
CMake Deprecation Warning at CMakeLists.txt:52 (CMAKE_POLICY):
The OLD behavior for policy CMP0045 will be removed from a future version
of CMake.
The cmake-policies(7) manual explains that the OLD behaviors of all
policies are deprecated and that a policy should be set to OLD only under
specific short-term circumstances.  Projects should be ported to the NEW
behavior and not rely on setting a policy to OLD.
getconf: no such configuration parameter `LEVEL1_DCACHE_LINESIZE'
CMake Error at extra/re2/CMakeLists.txt:74 (ADD_COMPILE_FLAGS):
Unknown CMake command "ADD_COMPILE_FLAGS".

same thing happened on my machine (macOS 10.15.2)
error log:
dtrees/libmysql/config-x64-osx-dbg-err.log
CMake Deprecation Warning at CMakeLists.txt:52 (CMAKE_POLICY):
  The OLD behavior for policy CMP0045 will be removed from a future version
  of CMake.

  The cmake-policies(7) manual explains that the OLD behaviors of all
  policies are deprecated and that a policy should be set to OLD only under
  specific short-term circumstances.  Projects should be ported to the NEW
  behavior and not rely on setting a policy to OLD.

getconf: no such configuration parameter `LEVEL1_DCACHE_LINESIZE'
CMake Error at extra/re2/CMakeLists.txt:74 (ADD_COMPILE_FLAGS):
  Unknown CMake command "ADD_COMPILE_FLAGS".

Hello, I have the same problem.
$ ./vcpkg install libmysql
Computing installation plan...
The following packages will be built and installed:
    libmysql[core]:x64-osx
Starting package 1/1: libmysql:x64-osx
Building package libmysql[core]:x64-osx...
-- Using cached /opt/vcpkg/downloads/mysql-mysql-server-mysql-8.0.4.tar.gz
-- Using source at /opt/vcpkg/buildtrees/libmysql/src/ysql-8.0.4-a02d75c4bb
-- Configuring x64-osx-dbg
CMake Error at scripts/cmake/vcpkg_execute_required_process.cmake:72 (message):
    Command failed: /opt/vcpkg/downloads/tools/cmake-3.14.0-osx/cmake-3.14.0-Darwin-x86_64/CMake.app/Contents/bin/cmake /opt/vcpkg/buildtrees/libmysql/src/ysql-8.0.4-a02d75c4bb -DWITHOUT_SERVER=ON -DWITH_UNIT_TESTS=OFF -DENABLED_PROFILING=OFF -DWIX_DIR=OFF -DHAVE_LLVM_LIBCPP_EXITCODE=1 -DSTACK_DIRECTION=-1 -DWINDOWS_RUNTIME_MD=ON -DIGNORE_BOOST_VERSION=ON -DWITH_SSL=system -DWITH_ICU=system -DWITH_LIBEVENT=system -DWITH_LZMA=system -DWITH_LZ4=system -DWITH_ZLIB=system -DCMAKE_MAKE_PROGRAM=/opt/local/bin/ninja -DCMAKE_SYSTEM_NAME=Darwin -DBUILD_SHARED_LIBS=OFF -DVCPKG_CHAINLOAD_TOOLCHAIN_FILE=/opt/vcpkg/scripts/toolchains/osx.cmake -DVCPKG_TARGET_TRIPLET=x64-osx -DVCPKG_SET_CHARSET_FLAG=ON -DVCPKG_PLATFORM_TOOLSET=external -DCMAKE_EXPORT_NO_PACKAGE_REGISTRY=ON -DCMAKE_FIND_PACKAGE_NO_PACKAGE_REGISTRY=ON -DCMAKE_FIND_PACKAGE_NO_SYSTEM_PACKAGE_REGISTRY=ON -DCMAKE_INSTALL_SYSTEM_RUNTIME_LIBS_SKIP=TRUE -DCMAKE_VERBOSE_MAKEFILE=ON -DVCPKG_APPLOCAL_DEPS=OFF -DCMAKE_TOOLCHAIN_FILE=/opt/vcpkg/scripts/buildsystems/vcpkg.cmake -DCMAKE_ERROR_ON_ABSOLUTE_INSTALL_DESTINATION=ON -DVCPKG_CXX_FLAGS= -DVCPKG_CXX_FLAGS_RELEASE= -DVCPKG_CXX_FLAGS_DEBUG= -DVCPKG_C_FLAGS= -DVCPKG_C_FLAGS_RELEASE= -DVCPKG_C_FLAGS_DEBUG= -DVCPKG_CRT_LINKAGE=dynamic -DVCPKG_LINKER_FLAGS= -DVCPKG_TARGET_ARCHITECTURE=x64 -DCMAKE_INSTALL_LIBDIR:STRING=lib -DCMAKE_INSTALL_BINDIR:STRING=bin -G Ninja -DCMAKE_BUILD_TYPE=Debug -DCMAKE_INSTALL_PREFIX=/opt/vcpkg/packages/libmysql_x64-osx/debug
    Working Directory: /opt/vcpkg/buildtrees/libmysql/x64-osx-dbg
    Error code: 1
    See logs for more information:
      /opt/vcpkg/buildtrees/libmysql/config-x64-osx-dbg-out.log
      /opt/vcpkg/buildtrees/libmysql/config-x64-osx-dbg-err.log

Call Stack (most recent call first):
  scripts/cmake/vcpkg_configure_cmake.cmake:304 (vcpkg_execute_required_process)
  ports/libmysql/portfile.cmake:38 (vcpkg_configure_cmake)
  scripts/ports.cmake:90 (include)

Error: Building package libmysql:x64-osx failed with: BUILD_FAILED
Please ensure you're using the latest portfiles with `.\vcpkg update`, then
submit an issue at https://github.com/Microsoft/vcpkg/issues including:
  Package: libmysql:x64-osx
  Vcpkg version: 2020.02.04-unknownhash-external

And the contents of buildtrees/libmysql/config-x64-osx-dbg-err.log:
CMake Deprecation Warning at CMakeLists.txt:52 (CMAKE_POLICY):
  The OLD behavior for policy CMP0045 will be removed from a future version
  of CMake.

  The cmake-policies(7) manual explains that the OLD behaviors of all
  policies are deprecated and that a policy should be set to OLD only under
  specific short-term circumstances.  Projects should be ported to the NEW
  behavior and not rely on setting a policy to OLD.

getconf: no such configuration parameter `LEVEL1_DCACHE_LINESIZE'
CMake Error at extra/re2/CMakeLists.txt:74 (ADD_COMPILE_FLAGS):
  Unknown CMake command "ADD_COMPILE_FLAGS".

@izzyreal Does this problem still happen for you? It should be fixed by now and this issue can probably be closed.

@Toxe I'm not working on the related project anymore, but I'm fine closing this.


[BUG] : footer is not responsive

✏ Describe the bug
the footer overflows for width less than 700px
📸 Screenshots

i can work on this 😄

ya :smile:  go for it


aggressive inlining and less array instanciations

As discussed on Twitter, aggressive inlining, less array instanciations and some other minor changes for better performances at the cost of readability and maintainability.

\o/ thanks!


[Network] Add name property to PrivateEndpointCreate examples

This change is only in a single API example, it does not affect swagger. I think the existing example is missing a name attribute for PrivateLinkServiceConnection. I have been getting error: Code="InvalidRequestFormat" Message="Cannot parse the request." Details=[] until I have populated the name attribute.

MSFT employees can try out our new experience at OpenAPI Hub  - one location for using our validation tools and finding your workflow.

Changelog
Add a changelog entry for this PR by answering the following questions:

What's the purpose of the update?

[ ] new service onboarding
[ ] new API version
[ ] update existing version for new feature
[ ] update existing version to fix swagger quality issue in s360
[ ] Other, please clarify

When are you targeting to deploy the new service/feature to public regions? Please provide the date or, if the date is not yet available, the month.
When do you expect to publish the swagger? Please provide date or, the the date is not yet available, the month.
If updating an existing version, please select the specific langauge SDKs and CLIs that must be refreshed after the swagger is published.

[ ] SDK of .NET (need service team to ensure code readiness)
[ ] SDK of Python
[ ] SDK of Java
[ ] SDK of Js
[ ] SDK of Go
[ ] PowerShell
[ ] CLI
[ ] Terraform
[ ] No refresh required for updates in this PR

Contribution checklist:

[x] I commit to follow the Breaking Change Policy of "no breaking changes"
[ ] I have reviewed the documentation for the workflow.
[ ] Validation tools were run on swagger spec(s) and errors have all been fixed in this PR. How to fix?

If any further question about AME onboarding or validation tools, please view the FAQ.
ARM API Review Checklist

Applicability: :warning:
If your changes encompass only the following scenarios, you should SKIP this section, as these scenarios do not require ARM review.

Change to data plane APIs
Adding new properties
All removals

Otherwise your PR may be subject to ARM review requirements. Complete the following:

[ ] Check this box if any of the following apply to the PR so that label “WaitForARMFeedback” will be added automatically to begin ARM API Review. Failure to comply may result in delays to the manifest.

Adding a new service
Adding new API(s)
Adding a new API version
-[ ] To review changes efficiently, ensure you copy the existing version into the new directory structure for first commit (including refactoring) and then push new changes, including version updates, in separate commits.

[ ] Ensure you've reviewed following guidelines including ARM resource provider contract and REST guidelines. Estimated time (4 hours). This is required before you can request review from ARM API Review board.

[ ] If you are blocked on ARM review and want to get the PR merged with urgency, please get the ARM oncall for reviews (RP Manifest Approvers team under Azure Resource Manager service) from IcM and reach out to them.

Breaking Change Review Checklist
If any of the following scenarios apply to the PR, request approval from the Breaking Change Review Board as defined in the Breaking Change Policy.

[ ] Removing API(s) in a stable version
[ ] Removing properties in a stable version
[ ] Removing API version(s) in a stable version
[ ] Updating API in a stable or public preview version with Breaking Change Validation errors
[ ] Updating API(s) in public preview over 1 year (refer to Retirement of Previews)

Action: to initiate an evaluation of the breaking change, create a new intake using the template for breaking changes. Addition details on the process and office hours are on the Breaking change Wiki.
Please follow the link to find more details on PR review process.

@bowen0106, could you help to review this PR?

I can't remove labels... Is commenting enough?

Please review this PR

Thanks for your contributing @mikhailshilkov.


onWebResourceError is called overzealously on Android

b/166114697
onWebResourceError API in webview_flutter plugin that was implemented within https://github.com/flutter/flutter/issues/53023.
The method does not document whether it is called for any page resource error (including images or scripts) or only for top-level navigation failures. From what I can see in practice on iOS it is only called for top-level navigation errors and on Android it depends on the version (see the two overloads for onReceivedError).
This is confusing and leads applications to stop loading pages and display fatal errors where they shouldn't (http://b/159587529).
Please:

Only report top-level navigation errors this way (isForMainFrame==true) for consistency between platforms.
Document the behavior of the method wrt top-level frame vs dependent resource.

@bparrishMines

cc @cyanglaz @amirh @blasten

WebViewClient#onReceivedError:

Note that unlike the deprecated version of the callback, the new version will be called for any resource (iframe, image, etc.), not just for the main page. Thus, it is recommended to perform minimum required work in this callback.

https://developer.android.com/reference/android/webkit/WebViewClient#onReceivedError(android.webkit.WebView, android.webkit.WebResourceRequest, android.webkit.WebResourceError)
One possible workaround is to also pass WebResourceRequest#isForMainFrame() downstream.  Maybe, all the parameters from WebResourceRequest, so developers can be more precise about the behavior.


[v9rc1] Missing image on sample content /team

This has been fixed by the other image pull request I merged earlier this morning.


Add info about Compnay/Currency transactions (Deposit/Withdrawal time and fees)

Cex.io
Withdrawal ZIL
Fee: 10 ZIL (fixed)
Time: ...12.05
Effort: SMS validation + Email for validation


Example error

Cloned the repo and tried to run the example folder but got the error below on Line 88
int fib(int n, SendPort port)
package:example/main.dart

The argument type 'int Function(int, SendPort)' can't be assigned to the parameter type 'FutureOr<dynamic> Function(int, TypeSendPort<dynamic>)'.dart[argument_type_not_assignable](https://dart.dev/diagnostics/argument_type_not_assignable)

Fixed by changing SendPort to TypeSendPort

Hi, thx for issue, my bad

resolved, please try again

Thank you very much for your open source work!!!! 🔥


Rename 'getting started' link to 'docs'

@TryingToImprove pointed out that Getting started link might be misleading for new users who are looking for docs. I've changed Getting started to just Docs in the top of the navigation.
It's been mentioned here: https://github.com/facebook/create-react-app/issues/5753

I agree that having all the docs under "Getting Started" is confusing but I'm not sure if this is the right solution to that. I think ideally we'd want both "Getting Started" and "Docs" in the navigation. Getting Started would just be the tutorial and Docs would be the rest of the documentation.

Good point @iansu.
We were looking to align with React/Jest homepages, as it appears they follow this convention. I think we'd have to probably re-organize our documentation to do what you propose?

If we had to pick one title I think "Docs" would be the best choice. I was looking at the React docs and they have "Docs" and "Tutorial". However, our Getting Started section isn't really a standalone tutorial. Given all that I think this PR is probably fine as is.


DPL-586 Traction: As a user, I want to be able to perform successful plates reception from the Sequencescape Reception tab.

Additional context
Import library type from sequencescape doesn’t work – not sure if this is because the manifests are being filled in with library type.
o	Can we prevent plates from being imported without a library type?
o	Can we add the ability to remove duplicate plates in Traction (if no runs/libraries are associated)?
User story
Who are the primary contacts for this story
e.g. James Watt
Who is the nominated tester for UAT
e.g.  James Watt
Acceptance criteria
To be considered successful the solution must allow:

[ ] add a list of acceptance criteria here
[ ] ...

Dependencies
This story is blocked by the following dependencies:

#<issue_no.>
sanger/#<issue_no.>

References
This story has a non-blocking relationship with:

#<issue_no.>
sanger/#<issue_no.>

Sequencescape reception has been removed. Does this work from the general reception if so we can close?


When depositing we received a "Nonce too low" error

When depositing we received a "Nonce too low" error while depositing to the UDC contract. needs to be reproducible.

solved by #165


Remove ALB Ingress provision and clarify in docs.

Description

This PR removes the Ingress (and thus ALB) provision code from the
guide to let users do it based on their use-case i.e how they
want to expose the proxy svc to the internet with SSL.
In the easiest path, they can just use the proxy service's CLB URL
(created by default), and use it everywhere and things would work.
(We'll be using whatever certificate config option has, as the SSL
cert on the proxy)
This PR also adds a note on how to use SSH gateway stuff when a ALB
is used.
Signed-off-by: Tarun Pothulapati<EMAIL_ADDRESS>Related Issue(s)

Fixes https://github.com/gitpod-io/gitpod/issues/9751
How to test

Release Notes

Remove ALB Ingress provision in the EKS setup

Documentation

At first pass, notes as I try to run this:

make build step should be added as just doing make install resulted in a missing certificate_arn error because the image that is in the container registry isn't up to date with the branch
we should remove the "Update Gitpod auth providers" section entirely. If you don't set any auth providers, the first time you login to the console you're prompted to manually set one up. That may be a separate issue

Excuse me for the unasked feedback, but this PR removes ALB + Certificate but doesn't explain how to configure them if they are needed -> I'd suggest adding a more detailed explanation how to setup ingress clb/alb or both.
I'd be happy to make a documentation PR when this one will be merged but not sure it can happen in May, sorry 😅

Closing this PR as we don't plan to merge it. Thanks


⚠ Bofrost.at has degraded performance

In 86992aa, Bofrost.at (https://www.bofrost.at) experienced degraded performance:

HTTP code: 200
Response time: 1700 ms

Resolved: Bofrost.at performance has improved in 8f04cb3.


Implement nn.CrossEntropyLoss

https://pytorch.org/docs/stable/generated/torch.nn.CrossEntropyLoss.html

$$
\text{xent}(Y, P) = -\sum_{k=1}^{T} Y(k) \log(P(k))
$$
$Y$ is one-hot truth, $P$ is logit probabilities (softmax)

>>> import torch
>>> import torch.nn as nn
>>>
>>> criterion = nn.CrossEntropyLoss()
>>> inputs = torch.tensor([[0.1782, 0.2920]])
>>> target = torch.tensor([0])
>>>
>>> loss = criterion(inputs, target)
>>> print(loss)
tensor(0.7517)
>>>
>>> inputs.shape
torch.Size([1, 2])
>>> target.shape
torch.Size([1])
>>> target = torch.tensor([1])
>>> loss = criterion(inputs, target)
>>> target = torch.tensor([0.5])
>>> loss = criterion(inputs, target)
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/Users/ryan/.pyenv/versions/3.11.9/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1736, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/ryan/.pyenv/versions/3.11.9/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1747, in _call_impl
    return forward_call(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/ryan/.pyenv/versions/3.11.9/lib/python3.11/site-packages/torch/nn/modules/loss.py", line 1293, in forward
    return F.cross_entropy(
           ^^^^^^^^^^^^^^^^
  File "/Users/ryan/.pyenv/versions/3.11.9/lib/python3.11/site-packages/torch/nn/functional.py", line 3479, in cross_entropy
    return torch._C._nn.cross_entropy_loss(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
RuntimeError: expected scalar type Long but found Float

import torch

def softmax(inputs):
    exp_inputs = torch.exp(inputs)
    return exp_inputs / torch.sum(exp_inputs, dim=1, keepdim=True)

def cross_entropy_loss(inputs, target):
    # Apply softmax to inputs
    probs = softmax(inputs)

    num_classes = inputs.size(1)
    one_hot_target = torch.zeros_like(inputs)
    one_hot_target[range(target.size(0)), target] = 1.0

    log_probs = torch.log(probs)

    loss = -torch.sum(one_hot_target * log_probs) / inputs.size(0)
    return loss

inputs = torch.tensor([[0.1782, 0.2920]], requires_grad=True)
target = torch.tensor([0])
loss = cross_entropy_loss(inputs, target)
print(loss)

d60b6667db04213dad66de113711d3913aa4b22d
ryan@Lambda-TensorBook:~/cudagrad$ python benchmarks/_cudagrad/mnist.py
[-nan]
[0]

a8781c33fea336b3b0e4d8f0e09637637f512572
ryan@Lambda-TensorBook:~/cudagrad$ pip install .; python benchmarks/_cudagrad/mnist.py
Defaulting to user installation because normal site-packages is not writeable
Processing /home/ryan/cudagrad
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Building wheels for collected packages: cudagrad
  Building wheel for cudagrad (pyproject.toml) ... done
  Created wheel for cudagrad: filename=cudagrad-0.2.4-cp310-cp310-linux_x86_64.whl size=446155 sha256=30985f9e450651d7e3ef2674156f1d3b44d2baf071758d85ff91596bb3b07875
  Stored in directory: /tmp/pip-ephem-wheel-cache-idzvk3bm/wheels/6e/97/c6/cc52a8580426cb31cc0243410052955dcf33c64ff395da9f71
Successfully built cudagrad
Installing collected packages: cudagrad
  Attempting uninstall: cudagrad
    Found existing installation: cudagrad 0.2.4
    Uninstalling cudagrad-0.2.4:
      Successfully uninstalled cudagrad-0.2.4
Successfully installed cudagrad-0.2.4
[10, 784]
[784, 1]
[0.06124027012341844, -1.0549383884101509, 2.0069787533838053, 1.3228568645927572, -0.21885979700622898, -0.2925587056604654, 0.6236681220384541, -0.6672120663183203, -1.415718113031299, -0.3654569397119705]
[[0.0612403, -1.05494, 2.00698, 1.32286, -0.21886, -0.292559, 0.623668, -0.667212, -1.41572, -0.365457]]
[[0, 0, 0, 0, 0, 0, 0, 0, 0, 0]]
[1, 10]
[5]
[0]
[1]
[3.15314]
[0]
python: /home/ryan/cudagrad/src/tensor.hpp:712: std::vector<float> cg::broadcast(std::vector<long unsigned int>, std::vector<float>, std::vector<long unsigned int>): Assertion `from[1] == to[0]' failed.
Aborted (core dumped)

Need cross_entropy backward test?
38df252b3194d069015c061bfce32912a924eba7
ryan@Lambda-TensorBook:~/cudagrad$ pip install .; python benchmarks/_cudagrad/mnist.py
Defaulting to user installation because normal site-packages is not writeable
Processing /home/ryan/cudagrad
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Building wheels for collected packages: cudagrad
  Building wheel for cudagrad (pyproject.toml) ... done
  Created wheel for cudagrad: filename=cudagrad-0.2.4-cp310-cp310-linux_x86_64.whl size=446291 sha256=fec088fa9380b3d367db553205df0f2c86e309a6d58af2c80b0ea29964b29463
  Stored in directory: /tmp/pip-ephem-wheel-cache-mid3gka3/wheels/6e/97/c6/cc52a8580426cb31cc0243410052955dcf33c64ff395da9f71
Successfully built cudagrad
Installing collected packages: cudagrad
  Attempting uninstall: cudagrad
    Found existing installation: cudagrad 0.2.4
    Uninstalling cudagrad-0.2.4:
      Successfully uninstalled cudagrad-0.2.4
Successfully installed cudagrad-0.2.4
E:  0 I:  0 / 60000 L:  1.03941011428833
9.29%
E:  0 I:  6000 / 60000 L:  3.4580376148223877
9.29%
E:  0 I:  12000 / 60000 L:  2.1862568855285645
9.29%
E:  0 I:  18000 / 60000 L:  1.8692883253097534
9.29%
E:  0 I:  24000 / 60000 L:  2.320424795150757
9.29%
E:  0 I:  30000 / 60000 L:  1.3396905660629272
9.29%
E:  0 I:  36000 / 60000 L:  1.7386581897735596
9.29%
E:  0 I:  42000 / 60000 L:  3.8094520568847656
9.29%

Don't backward through target def cross_entropy(inputs: Tensor, target: int) -> Tensor:
>>> import torch
>>> import torch.nn as nn
>>> inputs = torch.tensor([[2.0991, -0.3244, -1.4904, -0.9129, -0.1676,  0.9251,  0.1822, -0.0762,0.3743, -0.6091]], requires_grad=True)
>>> target = torch.tensor([5])
>>> inputs_shape = [1, 10]
>>> target_shape = [1]
>>> assert inputs.shape == torch.Size(inputs_shape), f"Expected inputs shape {inputs_shape}, got {inputs.shape}"
>>> assert target.shape == torch.Size(target_shape), f"Expected target shape {target_shape}, got {target.shape}"
>>> criterion = nn.CrossEntropyLoss()
>>> loss = criterion(inputs, target)
>>> print(loss.item()) # 1.9081392288208008
1.9081449508666992
>>> loss.backward()
>>> target.grad
>>> inputs.grad
tensor([[ 0.4799,  0.0425,  0.0133,  0.0236,  0.0497, -0.8516,  0.0706,  0.0545,
          0.0855,  0.0320]])

>>> arr
[10313.3671875, 10705.2578125, 10968.7822265625, 9485.3994140625, 10403.1640625, 11223.978515625, 9851.5927734375, 11192.8427734375, 10083.37890625, 9867.6708984375]
>>> import numpy as np
>>> normalized
array([-0.16866002,  0.51858103,  0.980712  , -1.62063004, -0.01118726,
        1.42823831, -0.97845314,  1.37363695, -0.57198017, -0.95025765])
>>> Tensor
<class 'cudagrad.Tensor'>
>>> output = Tensor([1, 10], normalized.tolist())
>>> target = Tensor([1], [train_labels[i]])
>>> loss = cross_entropy(output, target)
>>> loss.backward()
>>> output.grad
<cudagrad.tensor._GradProxy object at 0x7553149682f0>
>>> print(output.grad)
<cudagrad.tensor._GradProxy object at 0x7552f7795530>
>>> print(output)
[[-0.16866, 0.518581, 0.980712, -1.62063, -0.0111873, 1.42824, -0.978453, 1.37364, -0.57198, -0.950258]]
[[0, 0, 0, 0, 0, -3, 0, 0, 0, 0]]
>>> print(target)
[5]
[0]

>>> import torch.nn.functional as F
>>>
>>> arr = [10313.3671875, 10705.2578125, 10968.7822265625, 9485.3994140625,
...        10403.1640625, 11223.978515625, 9851.5927734375, 11192.8427734375,
...        10083.37890625, 9867.6708984375]
>>>
>>> train_labels = [5]
>>>
>>> arr_tensor = torch.tensor(arr, dtype=torch.float32)
>>> normalized = (arr_tensor - arr_tensor.mean()) / arr_tensor.std()
>>>
>>> output = torch.tensor(normalized.unsqueeze(0), requires_grad=True)
<stdin>:1: UserWarning: To copy construct from a tensor, it is recommended to use sourceTensor.clone().detach() or sourceTensor.clone().detach().requires_grad_(True), rather than torch.tensor(sourceTensor).
>>> target = torch.tensor(train_labels, dtype=torch.long)
>>>
>>> loss = F.cross_entropy(output, target)
>>> loss.backward()
>>> loss
tensor(1.3642, grad_fn=<NllLossBackward0>)
>>> loss.grad
<stdin>:1: UserWarning: The .grad attribute of a Tensor that is not a leaf Tensor is being accessed. Its .grad attribute won't be populated during autograd.backward(). If you indeed want the .grad field to be populated for a non-leaf Tensor, use .retain_grad() on the non-leaf Tensor. If you access the non-leaf Tensor by mistake, make sure you access the leaf Tensor instead. See github.com/pytorch/pytorch/pull/30531 for more informations. (Triggered internally at /Users/runner/work/pytorch/pytorch/pytorch/build/aten/src/ATen/core/TensorBody.h:494.)
>>> arr_tensor.grad
>>> output.grad
tensor([[ 0.0562,  0.1078,  0.1672,  0.0142,  0.0652, -0.7444,  0.0261,  0.2427,
          0.0383,  0.0268]])
>>> target.grad
>>>
>>> output
tensor([[-0.1600,  0.4920,  0.9304, -1.5375, -0.0106,  1.3549, -0.9282,  1.3031,
         -0.5426, -0.9015]], requires_grad=True)

import torch
import torch.nn.functional as F

arr = [10313.3671875, 10705.2578125, 10968.7822265625, 9485.3994140625,
       10403.1640625, 11223.978515625, 9851.5927734375, 11192.8427734375,
       10083.37890625, 9867.6708984375]

train_labels = [5]

arr_tensor = torch.tensor(arr, dtype=torch.float32)
normalized = (arr_tensor - arr_tensor.mean()) / arr_tensor.std()

output = torch.tensor(normalized.unsqueeze(0), requires_grad=True)
target = torch.tensor(train_labels, dtype=torch.long)

loss = F.cross_entropy(output, target)
loss.backward()


Game crashes if a chest is open with AzuCraftyBoxes & MyLittleUi installed

Opening a chest with mods enabled crashes the game
Entering the Workbench with a chest nearby also crashes the game
How to reproduce:

Have both AzuCraftBoxes & MyLittleUi installed
Open a chest
Game crashes

LogOutput.log

You can temporary disable Multicraft option.

Thanks. Fixed in 1.1.9.


Fix finding lesson url

Thanks @hagent for making PR, I'm very appreciated, but I think your patch doesn't solve the issue.
I had fixed the issue
ref: https://github.com/produk/new-egghead-downloader/commit/c9b8e7fe0dbff136c10a8ac3a45d342f81d56efb

@rohmanhm yeah really good that you solved it, I see that you used another lesson link, but anyway I really believe that my solution is working also


Migrate Demos Datasets to Tensorflow 1.4

These are now in tf.data not tf.contrib.data
Also we can investigate the use of Dataset.from_generator

Make sure to also update the doco here:
http://aboleth.readthedocs.io/en/stable/quickstart.html#logistic-classification


All animations are removed whenever an element is removed

Hello,
I've noticed that whenever I want to remove an element that has an animation on it, Powerpoint makes me repair the pptx and remove all of the animations in the slide.
Do I do something wrong here? Is there already a workaround for this issue?
Otherwise, would it be possible to reorganize the animations while removing the element?
I have this issue with this code for example:
const title = (pres: Automizer, title?: string, subtitle?: string) => {
  pres.addSlide('title.pptx', 1, (slide) => {
    if (title)
      slide.modifyElement('title', [
        modify.replaceText([{ replace: 'title', by: { title } }]),
      ])
    if (subtitle)
      slide.modifyElement('subtitle', [
        modify.replaceText([{ replace: 'subtitle', by: { subtitle } }]),
      ])

    if (!title) slide.removeElement('title')
    if (!subtitle) slide.removeElement('subtitle')
  })
}

My temporary solution would be to have a slightly different template for each time I have to remove an element, but it's not handy nor maintainable.

Hi! I'm sorry, animations are not yet supported. I'll take a look!

Huh, that's complicated...
There is <p:timing> and <p:bldLst> that needs to get in sync with removeElement... The latter is nested deeply and I have no idea how this will look when there are lots of animations on a slide.
What about slide.hideElement? This function does not exist yet, but I could imagine there is only hidden that needs to be update:
<p:sp>
  <p:nvSpPr>
    <p:cNvPr id="11" name="Drum" hidden="1">
      <a:extLst>
        ///

What do yo think? This will be the same effect as ALT+F10 and toggle the eye-symbol right besides a shape.

I thought about that but I didn't saw the function in the documentation but yes it would work that would be great :)
Do you think it would be possible to implement the function soon? :)

This should do the job:
  pres.addSlide('animations', 1, (slide) => {
    slide.modifyElement('Drum', (shape) => {
      // You need to update the 'hidden' attribute with a callback:
      shape.getElementsByTagName('p:cNvPr').item(0).setAttribute('hidden', '1');
      // XmlHelper.dump(shape);
    });
  });

Feel free to create a helper & PR from this! :smile:

I'm happy to help :smile:


fix: remove duplicated call to the upgrade function in main.go

ref: https://issues.redhat.com/browse/RHOAIENG-6449
this is causing double called in the startup and looks like DSC already exist in the log but actually it was create by the first call
log from Kevin's test
I0424 08:47:43.602533       1 request.go:682] Waited for 1.038296111s due to client-side throttling, not priority and fairness, request: GET:https://<IP_ADDRESS>:443/apis/k8s.cni.cncf.io/v1?timeout=32s
2024-04-24T08:47:45Z	INFO	controller-runtime.metrics	Metrics server is starting to listen	{"addr": "<IP_ADDRESS>:8080"}
2024-04-24T08:47:45Z	INFO	secret-generator	Adding controller for Secret Generation.
2024-04-24T08:47:45Z	INFO	cert-configmap-generator	Adding controller for Configmap Generation.
starting deletion of Deployment in managed cluster
removing labels on Operator Namespace
creating default DSC CR
created DataScienceCluster resource
starting deletion of Deployment in managed cluster
removing labels on Operator Namespace
creating default DSC CR
DataScienceCluster resource already exists. It will not be updated with default DSC.

we will need backport this to main

@zdtsw sorry, on further review, should the second update call be removed instead of the first? that is because the call on line 218/213 is running for instance a removal for TrustyAI, but this I believe only exists in v2? so maybe for clarity run the update call first?

good question.
i do not know if it is for any reason,  this sequence is change in the original ODH PR https://github.com/opendatahub-io/opendatahub-operator/pull/955/files#diff-2873f79a86c0d8b3335cd7731b0ecf7dd4301eb19a82ef7a1cba7589b5252261
maybe @VaishnaviHire knows better?
in ODH, we do not have RemoveDeprecatedTrustyAI call.
for me , in RHOAI, it is

either we do all the cleanup of v2 (trustyai + others) then call UpdateFromLegacyVersion for v1's resource + create default CRs
or the other way around  first call UpdateFromLegacyVersion for v1's resource + create default CRs, then cleanup v2(trustyai + others)

Just to note here as well - The UpdateLegacyVersion() creates default dsc/dsci for managed. If we cleanup after that function, there might be some resources that are created as part of DSC with same name as legacy resources, those will also get cleaned up


Process distance matrices inside the neighborhood counts function

What is the purpose of this PR?
Addresses #720. Neighborhood analysis has an inefficiency where the distance matrices are all precomputed beforehand. This is unnecessary as we can just compute these as needed in the neighborhood analysis per-FOV loop.
How did you implement your changes
We remove any precomputing of distance matrices (including preloading of label maps) inside the notebooks. In addition to the neighborhood analysis notebook, there was one that existed in the spatial analysis notebook which needed addressing.
compute_neighborhood_counts now takes in similar arguments as the other spatial functions to load directly from label_dir and computing dist_mats on an as-needed per-FOV basis.

I'm not sure I follow. What does pre-computing distances matrices have to do with batching?

I'm not sure I follow. What does pre-computing distances matrices have to do with batching?

create_dist_matrices was written to make it easy to integrate with the batching functionality of the spatial analyses functions, namely the per-FOV loop. We shouldn't need to do this anymore now that the spatial functions themselves only operate on a per-FOV basis. Moving the distance matrix computations to the neighborhood matrix function (as opposed to pre-computing them all in the notebook) itself will allow us to start doing this.
I was originally intending to address both issues in this PR, however, because create_dist_matrices was used in all three spatial analysis functions, I think it's best to address this separately.

Okay got it. Given that all of the spatial analysis functions use the same distance matrices, I don't know if I would agree that it's inefficient to precompute them. Is there a benefit from not pre-computing? How much time does it take compared to the other tasks in the notebooks?

@ngreenwald based on our meeting today, conducted some timing tests on the calc_dist_matrix function and it can be a fairly expensive function if the image contains many different cell labels and the cohort contains several FOVs.
For 1000 different cell labels, it takes about 3 seconds per FOV. For 2000, about 6-7 seconds. For 5000, about 16.5 seconds. In a cohort with many FOVs, this can easily take a very long time. This is the case for both regionprops and regionprops_table with only the subset of needed properties specified.
Based on this, I think it's probably best to leave the distance matrices pre-computed prior to running them the spatial analyses. Using the save_path argument in calc_dist_matrix, we can save a .npz file that can be loaded up with the required data each time.
If we move forward with this, we should close this PR as the changes made here will no longer be relevant.

Got it, sounds good

We will address this a different way per #770.


Need warning for Government tenants here.

[This page is missing an all important warning for Government or GCC cloud tenants: The Migration Manager for Google is NOT available for our tenants.]

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: 4a52c60e-e617-f204-187b-25bfdb413975
Version Independent ID: 4a52c60e-e617-f204-187b-25bfdb413975
Content: Migrate Google files to Microsoft 365 for business - Microsoft 365 admin
Content Source: microsoft-365/admin/moveto-microsoft-365/migrate-files-migration-manager.md
Service: microsoft-365-business
GitHub Login: @efrene
Microsoft Alias: efrene

@allenlid Thank you for your feedback. We have made changes to the document via PR#https://github.com/MicrosoftDocs/microsoft-365-docs/pull/9940
Once the author approves, the changes will be live.
Thanks
Sri

@msbemba Thank you very much for the contribution and updating the documentation with PR. @allenlid Hope this update is helpful for you. Thanks for taking out some time to open the issue. Appreciate and encourage you to do the same in future also.


Add help graphics to main menu

Took a bit figuring out where the main menu popup was since I have not looked at that section since before the big refactor but took about an hour.


Serialization and deserialization for sktime estimators

Serialization and deserialization interface for sktime estimators, supporting the following workflows:

serialization to in-memory object and deserialization
serialization to single file and deserialization

Initially proposed in sktime issues #3128 and #3336.
The proposed design introduces:

an object interface points for estimators, save
a loose method load
a file format specification skt for serialized estimator objects

which are counterparts and universal.
Concrete class or intermediate class specific logic is implemented in:

save, a class method
load_from_path and load_from_serial, class methods called by load

while no class specific logic is present in load.

@aurunmpegasus, @achieveordie, I made changes to the STEP to add more specificity, and ensure we have a full design that does not only cover deep learning but all estimators.
Would appreciate comments, happy to revert or change

@fkiraly The document looks good and detailed!
I was thinking to add more comments on how the overwriting of save and load_from_file and load_from_serial was done by @achieveordie for DL models since the current document just mentions it.

I was thinking to add more comments on how the overwriting of save and load_from_file and load_from_serial was done by @achieveordie for DL models since the current document just mentions it.

Sure - feel free to add more detail there.
I think a really really key point is that we do not change load for adding the DL estimators, i.e., that it remains indefinitely extensible and all specific functionality goes in the class methods.

merging so Pr can be made to this


Clickable cards on the homepage

Someone noted that the RFC cards are the homepage aren't in any way styled as clickable. It might make it confusing for people to know these are actually links. Maybe we should add some text? "Read more", or maybe an icon? Not sure.

Maybe just a hover:ring class on them?
https://github.com/brendt/rfc-vote/assets/17316322/1327ca4c-3546-490c-819a-7a86a1092178

The problem with that is mobile though 🤔

I see... Then maybe this icon in top right corner?

Something like that. Although that icon usually means "open in new tab".
But some kind of arrow might help? @SerhiiCho wdyt?

Idk, I like the current version, I think we passed that point when people needed a button to click, but I can see the advantage of a button. I like the idea of @brendt to add something like "Read more" link. You know one of those links that google likes adding. Here are some examples:

Exactly, that seems like the best approach


Improve documentation for uploading data

Documentation on the project is pretty thin right now. I've created some sample data sets and was able to get docker up and running. At that point I can see a nice map of the US and interact with the sidebar, etc. But I haven't figured out how to post the data. localhost ports 5001 and 3000 don't work. Any suggestions?

Hi @gschivley, I've updated the documentation and included a client module, demo data, and an upload script in the repository now. You should be using port 3000 to upload data. The backend API will be rewritten in FastAPI fairly soon to enable some of the items on the roadmap. I will also update the client api to make it easier to upload data going forward.
Let me know if you still run into trouble or if you have any more questions.
-Micah


ValueError: Could not find requirements.txt at paths ['tests/requirements/py3.txt'] for repo django/django

Describe the bug
I'm running the testcode
python -m swebench.harness.run_evaluation     --predictions_path gold     --max_workers 1     --instance_ids sympy__sympy-20590     --run_id validate-gold
But found an error:
ValueError: Could not find requirements.txt at paths ['tests/requirements/py3.txt'] for repo django/django at commit 419a78300f7cd27611196e1e464d50fd0385ff27
Steps/Code to Reproduce
`
git clone git@github.com:princeton-nlp/SWE-bench.git
cd SWE-bench
python -m swebench.harness.run_evaluation     --predictions_path gold     --max_workers 1     --instance_ids sympy__sympy-20590     --run_id validate-gold`
Expected Results
No error
Actual Results
Traceback (most recent call last):
File "E:\anaconda\envs\agent\lib\runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "E:\anaconda\envs\agent\lib\runpy.py", line 86, in _run_code
exec(code, run_globals)
File "D:\swe-bench\SWE-bench\swebench\harness\run_evaluation.py", line 579, in
main(**vars(args))
File "D:\swe-bench\SWE-bench\swebench\harness\run_evaluation.py", line 547, in main
make_run_report(predictions, full_dataset, client, run_id)
File "D:\swe-bench\SWE-bench\swebench\harness\run_evaluation.py", line 429, in make_run_report
File "D:\swe-bench\SWE-bench\swebench\harness\run_evaluation.py", line 579, in
main(**vars(args))
File "D:\swe-bench\SWE-bench\swebench\harness\run_evaluation.py", line 547, in main
make_run_report(predictions, full_dataset, client, run_id)
File "D:\swe-bench\SWE-bench\swebench\harness\run_evaluation.py", line 429, in make_run_report
main(**vars(args))
File "D:\swe-bench\SWE-bench\swebench\harness\run_evaluation.py", line 547, in main
make_run_report(predictions, full_dataset, client, run_id)
File "D:\swe-bench\SWE-bench\swebench\harness\run_evaluation.py", line 429, in make_run_report
File "D:\swe-bench\SWE-bench\swebench\harness\run_evaluation.py", line 547, in main
make_run_report(predictions, full_dataset, client, run_id)
File "D:\swe-bench\SWE-bench\swebench\harness\run_evaluation.py", line 429, in make_run_report
test_specs = list(map(make_test_spec, full_dataset))
make_run_report(predictions, full_dataset, client, run_id)
File "D:\swe-bench\SWE-bench\swebench\harness\run_evaluation.py", line 429, in make_run_report
test_specs = list(map(make_test_spec, full_dataset))
File "D:\swe-bench\SWE-bench\swebench\harness\run_evaluation.py", line 429, in make_run_report
test_specs = list(map(make_test_spec, full_dataset))
test_specs = list(map(make_test_spec, full_dataset))
File "D:\swe-bench\SWE-bench\swebench\harness\test_spec.py", line 283, in make_test_spec
env_script_list = make_env_script_list(instance, specs, env_name)
File "D:\swe-bench\SWE-bench\swebench\harness\test_spec.py", line 165, in make_env_script_list
File "D:\swe-bench\SWE-bench\swebench\harness\test_spec.py", line 283, in make_test_spec
env_script_list = make_env_script_list(instance, specs, env_name)
File "D:\swe-bench\SWE-bench\swebench\harness\test_spec.py", line 165, in make_env_script_list
File "D:\swe-bench\SWE-bench\swebench\harness\test_spec.py", line 283, in make_test_spec
env_script_list = make_env_script_list(instance, specs, env_name)
File "D:\swe-bench\SWE-bench\swebench\harness\test_spec.py", line 165, in make_env_script_list
File "D:\swe-bench\SWE-bench\swebench\harness\test_spec.py", line 283, in make_test_spec
env_script_list = make_env_script_list(instance, specs, env_name)
File "D:\swe-bench\SWE-bench\swebench\harness\test_spec.py", line 165, in make_env_script_list
File "D:\swe-bench\SWE-bench\swebench\harness\test_spec.py", line 283, in make_test_spec
env_script_list = make_env_script_list(instance, specs, env_name)
File "D:\swe-bench\SWE-bench\swebench\harness\test_spec.py", line 165, in make_env_script_list
reqs = get_requirements(instance)
File "D:\swe-bench\SWE-bench\swebench\harness\test_spec.py", line 283, in make_test_spec
env_script_list = make_env_script_list(instance, specs, env_name)
File "D:\swe-bench\SWE-bench\swebench\harness\test_spec.py", line 165, in make_env_script_list
reqs = get_requirements(instance)
File "D:\swe-bench\SWE-bench\swebench\harness\test_spec.py", line 283, in make_test_spec
env_script_list = make_env_script_list(instance, specs, env_name)
File "D:\swe-bench\SWE-bench\swebench\harness\test_spec.py", line 165, in make_env_script_list
reqs = get_requirements(instance)
File "D:\swe-bench\SWE-bench\swebench\harness\test_spec.py", line 283, in make_test_spec
env_script_list = make_env_script_list(instance, specs, env_name)
File "D:\swe-bench\SWE-bench\swebench\harness\test_spec.py", line 165, in make_env_script_list
File "D:\swe-bench\SWE-bench\swebench\harness\test_spec.py", line 283, in make_test_spec
env_script_list = make_env_script_list(instance, specs, env_name)
File "D:\swe-bench\SWE-bench\swebench\harness\test_spec.py", line 165, in make_env_script_list
File "D:\swe-bench\SWE-bench\swebench\harness\test_spec.py", line 283, in make_test_spec
env_script_list = make_env_script_list(instance, specs, env_name)
File "D:\swe-bench\SWE-bench\swebench\harness\test_spec.py", line 165, in make_env_script_list
env_script_list = make_env_script_list(instance, specs, env_name)
File "D:\swe-bench\SWE-bench\swebench\harness\test_spec.py", line 165, in make_env_script_list
File "D:\swe-bench\SWE-bench\swebench\harness\test_spec.py", line 165, in make_env_script_list
reqs = get_requirements(instance)
reqs = get_requirements(instance)
File "D:\swe-bench\SWE-bench\swebench\harness\utils.py", line 270, in get_requirements
return get_requirements_by_commit(instance["repo"], commit)
File "D:\swe-bench\SWE-bench\swebench\harness\utils.py", line 215, in get_requirements_by_commit
raise ValueError(
ValueError: Could not find requirements.txt at paths ['tests/requirements/py3.txt'] for repo django/django at commit 419a78300f7cd27611196e1e464d50fd0385ff27
System Information
Python 3.10 Windows

Hello, I encountered the same problem, do you find a solution?


Fix source version check

@crcrpar can you try this instead?
Fixes https://github.com/pytorch/ao/pull/679#issuecomment-2290444713
This just basically takes advantage of the fact that every PyTorch version has the format X.Y.Z and then some stuff

# Test cases
import torch
from torchao.utils import torch_version_at_least

torch.__version__ = "2.5.0a0+git9f17037"
print(f"{torch.__version__}: {torch_version_at_least('2.5.0')}")  # Should be True
print(f"{torch.__version__}: {torch_version_at_least('2.4.0')}")  # Should be True

torch.__version__ = "2.5.0.dev20240708+cu121"
print(f"{torch.__version__}: {torch_version_at_least('2.5.0')}")  # Should be True
print(f"{torch.__version__}: {torch_version_at_least('2.4.0')}")  # Should be True

torch.__version__ = "2.5.0"
print(f"{torch.__version__}: {torch_version_at_least('2.4.0')}")  # Should be True
print(f"{torch.__version__}: {torch_version_at_least('2.5.0')}")  # Should be True

torch.__version__ = "2.4.0"
print(f"{torch.__version__}: {torch_version_at_least('2.4.0')}")  # Should be True
print(f"{torch.__version__}: {torch_version_at_least('2.5.0')}")  # Should be False

@crcrpar can you try this instead?
Fixes #679 (comment)
This just basically takes advantage of the fact that every PyTorch version has the format X.Y.Z and then some stuff
# Test cases
import torch
from torchao.utils import torch_version_at_least

torch.__version__ = "2.5.0a0+git9f17037"
print(f"{torch.__version__}: {torch_version_at_least('2.5.0')}")  # Should be True
print(f"{torch.__version__}: {torch_version_at_least('2.4.0')}")  # Should be True

torch.__version__ = "2.5.0.dev20240708+cu121"
print(f"{torch.__version__}: {torch_version_at_least('2.5.0')}")  # Should be True
print(f"{torch.__version__}: {torch_version_at_least('2.4.0')}")  # Should be True

torch.__version__ = "2.5.0"
print(f"{torch.__version__}: {torch_version_at_least('2.4.0')}")  # Should be True
print(f"{torch.__version__}: {torch_version_at_least('2.5.0')}")  # Should be True

torch.__version__ = "2.4.0"
print(f"{torch.__version__}: {torch_version_at_least('2.4.0')}")  # Should be True
print(f"{torch.__version__}: {torch_version_at_least('2.5.0')}")  # Should be False

maybe add these examples to tests?

@msaroufim , when do you guys plan to make a new release? Is it monthly?

We do monthly, next one is scheduled around Sep 5


[Refactor] Docs update

I can't comment that line in file changes cause it hasn't been touched, but there is the placeholder mention the tasks worth "forking"/building off of" in the section Creating a YAML file that probably should be replaced with an actual example.

Probably it should be good to describe file naming convention in creating task yaml. If we have task with the name Some_Task, how should we name the yaml file? Are there any limitations on characters or some autoloading mechanisms requiring that name should be consistent with some other source?

I see that it's partially described in Task name + groups (registering a task),  maybe it could be placed just a bit earlier, when the name is created.

It would be great to add a point about referencing the original paper and the availability of reference implementation of the task in the impl. checklist under Is the task an existing benchmark in the literature?

Sorry for that long list of questions. Overall the New Task Guide feels very comprehensive and easy to understand to me!


Loosing keybindings sometimes

Unfortunatly, this isn't reproducible easily, but Gnomesome looses it's keybindings multiple times over the course of a day for me.
E.g. I switch to another workspace with Super+3 just fine, but when I press Super+1 afterwards, Geary is being opend. At that point I just open Gnome Tweaks and reload Gnomesome once to get the bindings back.
If there is any information that might be helpful, I'll happily try to provide it.
GNOME Shell 3.34.5 on NixOS 20.03

Did you disable the dash-to-dock keybindings? See https://github.com/ChWick/gnomesome#disable-dash-to-dock-mod4digit-keybindings

Thanks for the feedback! I didn't, since I thought that wouldn't apply to me due to running NixOS instead of Ubuntu.
I checked in the dconf editor, and there are no dash-to-dock entries there.

However, I expect a similar problem: The shortcuts are used twice (since super+1 launches a program). Could you check if there are entries in the Keyboard Shortcut settings of gnome or any extension that might override the behavior of gnomesome?

I had a look through the extensions and nothing there has any shortcuts overlapping with Gnomesome (if any).
The same is true for the Keyboard Shortcut settings, though I there have settings like these configured:

I actually wasn't aware that the shortcuts I am using to move windows between workspaces (Mod4-Shift-[1-5]) aren't the Gnomesome defaults :smile:
But still: Where I often happen to stumble across this issue is when I move a window to another workspace with e.g. Mod4-Shift-3 and want to go back to e.g. to workspace 1 with Mod4-1  - Mod4-1 then opens Geary, I think. Mod-3 then opens Spotify, though I couldn't find any setting for that.
Again, thank you for helping out!

Just had the case again - it seems it isn't that Gnomesome is loosing the keybindings (Mod4-3 still moves me to Workspace 3), but it opens Spotify as well. And it does so consistently in that state: If I close Spotify, go to another Workspace and hit Mod4-3 again, I switch to Workspace 3 and Spotify opens.
After disabling/enabling Gnomesome, Spotify isn't opened anymore

Super+Shift+DIGIT is also the gnomesome default for moving windows.
The error description you are providing is revealing a very, very, very strange behavior. Gnomesome can be part of this problem but gnomesome itself cannot be the reason for it because gnomesome does not launch any program except for the terminal (Mod Enter). In the whole code, there is no such line. Therefore, the question is, who else captures the shortkey (or does somehow interact with gnomesome). And, to be honest, I have absolutely no idea what can cause this strange behavior.
Maybe a related question: Did you pin spotify to the dock/taskbar? And if yes, is it the third program?
Unfortunately, I can not help you out. Sorry for that! But please let me know if you found a solution or - even better - the reason to explain this!

 Spotify is on the third position, Geary on the first in the dock/taskbar!
At least this gives me a pointer, thank you very much! If you have an idea where this is configured, I am happy for any further help - but this definitively is an awesome start - thanks!

Good! This might explain the complete behavior: Hitting Mod+DIGIT launches a program or switches to the running window, but Mod+DIGIT also switches the Workspace.
This is the exact reason why I had to disable all keybindings with:
gsettings set org.gnome.shell.keybindings switch-to-application-1 []
gsettings set org.gnome.shell.keybindings switch-to-application-2 []
gsettings set org.gnome.shell.keybindings switch-to-application-3 []
gsettings set org.gnome.shell.keybindings switch-to-application-4 []
gsettings set org.gnome.shell.keybindings switch-to-application-5 []
gsettings set org.gnome.shell.keybindings switch-to-application-6 []
gsettings set org.gnome.shell.keybindings switch-to-application-7 []
gsettings set org.gnome.shell.keybindings switch-to-application-8 []
gsettings set org.gnome.shell.keybindings switch-to-application-9 []

Can you check if these entries exist in the dconf editor:

Found it, my issue is related to this ticket https://gitlab.gnome.org/GNOME/gnome-shell/-/issues/1250
Running these commands seem to fix it
gsettings set org.gnome.shell.keybindings switch-to-application-1 []
gsettings set org.gnome.shell.keybindings switch-to-application-2 []
gsettings set org.gnome.shell.keybindings switch-to-application-3 []
gsettings set org.gnome.shell.keybindings switch-to-application-4 []

perfect!
I will make it clear, that these commands (unset switch-to-application) must be run for all current versions of gnome/ubuntu

Once more: Thank you for your help, even if it didn't have to do anything with your tool!


Upgrade support for react 17

Closes https://github.com/adobe/react-spectrum/issues/1074
✅ Pull Request Checklist:

[ ] Included link to corresponding React Spectrum GitHub Issue.
[ ] Added/updated unit tests and storybook for this change (for new code or code which already has tests).
[ ] Filled out test instructions.
[ ] Updated documentation (if it already exists for this component).
[ ] Looked at the Accessibility Practices for this feature - Aria Practices

📝 Test Instructions:

🧢 Your Project:

Do we want to keep both the 16 and 17 build of storybook? and do we have a different way we want to expose the version to storybook ui?


Move certain evil bindings out of evil-org's way.

Related to issue #4935. Evil-org's "gj" and "gk" were shadowed whenever visual-line-mode was enabled. And "gl" was shadowed by evil-lion.
Not sure if it's best to unbind and rebind just the "gj" and "gk" keys, or if it's preferable to re-define the whole map. For now, I went with the former, but the original map is in evil-integration.el at line 492 and is only 10 lines long.

Thanks for the PR, but I cannot accept it as it is much too intrusive, and I'd rather not move evil-lion's keys. I'll come up a with a better solution soon.


Star formation and  quenching in dwarf galaxies

09/AUG/23

in progress
Sugata hopes to submit by LSST@Europe

04/OCT/23

hope to now submit in Nov'23

18/JAN/24

still close to submission

07/FEB/24

draft sent out for comments to co-authors
expect soon to be submitted

14/MAR/24

expect to submit to next couple of days

11/APR/24

submitted waiting for referee reports

23/MAY/24

still working on corrections

17/JUN/24

corrections almost finished

09/JUL/24

2nd referee report recvd.
will deal with these and reply to referee
hope to be accepted in next 4 to 6 weeks

23/JUL/24

replied to 2nd referee who provided another comment
still hoping for end of August to submit

06/AUG/24

working on reply to referee
still aiming for end August to resubmit

24/SEP/24

recvd another ref report
have updated in light of feedback
aim to submit in next week or so

22/OCT/24

paper resubmitted, waiting for referee
hope will be accepted

12/NOV/24

still with referees

28/NOV/24

further referee report recvd requesting addition of one figure.
hope to re-submit in coming week.


Embed command docs

related to #158

This looks fine, it just depends on #158 before we can merge it.

In the future, docs about a new feature should be part of the PR implementing that feature.


Use the main network by default.

Closes #52

Trying to get my local copay up and running again but that does look correct to me based.

Unless @alexlyp objects I'd say merge this in @davecgh

looks fine to me


tsp codegen for examples is broken with latest tcgc

For reference https://github.com/Azure/typespec-azure/issues/1688
Also observed was some of the ARM modules have missing/incorrect parameters.

Also impacted is armloadtestservice.
vet.exe: .\zz_loadtests_client_example_test.go:25:105: not enough arguments in call to clientFactory.NewLoadTestsClient().BeginCreateOrUpdate
        have (context.Context, string, string, nil)
        want (context.Context, string, string, armloadtestservice.LoadTestResource, *armloadtestservice.LoadTestsClientBeginCreateOrUpdateOptions)

The api-version issue has been fixed.

confirmed that all the example failure is from setting body parameter name with @encodedName. open tcgc issue here.


🐛 [Firebase Messaging] Data only message delayed when in doze mode and Android >= O

Bug report
When I send a high priority FCM data only message to the device, my background message handler is not given the message while the device is in doze (idle) state. As soon as the device comes out of doze the background handler is called.
Tested on multiples devices with Android >= O, in debug and release mode with flutter 2.2.1 and firebase messaging 10.0.2.
See #4718
In the file firebase/messaging/FlutterFirebaseMessagingBackgroundService.java, the class FlutterFirebaseMessagingBackgroundService extends JobIntentService.
The   JobIntentService documentation says:
" When running as a Job, it will be subject to standard JobScheduler policies for a Job with a JobInfo.Builder.setOverrideDeadline(long) of 0: the job will not run while the device is dozing, it may get delayed more than a service if the device is under strong memory pressure with lots of demand to run jobs."
Could this be the problem?

Closing this as a duplicate of https://github.com/FirebaseExtended/flutterfire/issues/4718
Please comment this information there.


How do you install this?

I'm not a Javascript person..
Installing with --global doesn't install Chromium so I get an error about missing Chromium?
Installing without --global I don't get an executable to run?

So I found the executable. What I've done is:
1: mkdir ~/puppeteer-pdf
2: cd ~/puppeteer-pdf
3: npm install puppeteer-pdf
4: ln -s ~/puppeteer-pdf/node_modules/puppeteer-pdf/puppeteer-pdf.js ~/bin/puppeteer-pdf
and that is working fine


docs: add description of data reduction procedure

Fixes #7
This is still a bit coarse, but I think it contains the important bits.
I'm marking this as a draft, but feedback is appreciated.
It's a lot to go over, maybe it's best to book a meeting for the review.
Edit: Derivations of the coordinate transformations are probably already in the api docs. Resolution function needs motivation. Footprint correction also, see #13.
Url to built docs, see user-guide/data-reduction.html.

To avoid making this PR too large. I'll add separate issues for documenting:

the frame unwrapping / how tof is computed
coordinate transformations
footprint correction procedure
how the resolution function is estimated

In general, splitting PRs into small units is good. But that only works when those units are self-contained. Here, I cannot judge whether the documentation is good without seeing all of it. In the last PR of this series, I would have to read everything again anyway. So can you please combine them into one PR?

The risk I see not splitting this effort into manageable pieces is that

it will never get finished, and never reviewed, because it will become to cumbersome,
it will get out of date with the code,
no one will have any use of it before everything is done.

I don't agree that the pieces are not self contained.
You don't need to know the exact geometry of the beamline, the exact chopper setup etc, to assume we can compute the wavelength of a neutron event.
This part of the documentation assumes there exists some procedure to compute $\lambda, \theta$ etc but doesn't specify how that is done, and I think that is fine.

If this was true, we would not need to do any error propagation at all before we compute a Q histogram.

Yes and we typically don't right?
But I see what you mean. There's something a bit wrong here. The events are weighted. So one > event is actually not a single events, but a "package" of events. Individual packages of events arrive independently, but inside a package the events don't arrive independently.
I think we should talk about this in person to get the formulation right here. 👍

We should


Use redux in react components

connect the react components to the redux state management

install react-redux to connect redux state to the react app
Use Selector to add the redux state to component
use dispatch to the dispatch an action from the component to the redux state
create an action to add to the bookstore
create an action to remove to the bookstore
create an action to filter bookstore

Thank you very much 🙏🏾


[Network] az network express-route port generate-loa: New commands to generate and download the PDF letter of authorization for a ExpressRoutePort

Description

Close https://github.com/Azure/azure-cli/issues/15790
Testing Guide

History Notes

[Component Name 1] BREAKING CHANGE: az command a: Make some customer-facing breaking change.
[Component Name 2] az command b: Add some customer-facing feature.

This checklist is used to make sure that common guidelines for a pull request are followed.

[ ] The PR title and description has followed the guideline in Submitting Pull Requests.

[ ] I adhere to the Command Guidelines.

[ ] I adhere to the Error Handling Guidelines.

Network


Radix sort

Write the code to perform radix sort in python.
Guidelines:

Write the codes in python only.
Refrain from any unfair means or plagiarism.
The code should display authenticity.
Use proper formatting and comments.

Hi Samaresh... wanted to work on your third issue. Hope you have liked the other two.

Hi Samaresh... wanted to work on your third issue. Hope you have liked the other two.

@Sohom2002 I am very much impressed by your work. I'll be happy to assign you the job. All the best.


Re-Deploying a cluster fails to re-install manifest CRDs onto the target

Whilst testing different versions of Kubernetes I've run into the CRDs for Calico failing to re-install when a cluster is deleted and recreated:

Helm install a cluster with a given name, e.g. foo, but leave the control plane on the bootstrap cluster
Uninstall the cluster
Helm install a new cluster with the same name

This will result in a single KCP node and your worker nodes waiting for the CNI to deploy.
Looking at the manifest gives you the following:
  Release Name:      cni-calico-monitoring
  Target Namespace:  tigera-operator
Status:
  Phase:  Installing
Events:
  Type   Reason   Age    From  Message
  ----   ------   ----   ----  -------
  Error  Logging  4m55s  kopf  Handler 'handle_addon_updated' failed with an exception. Will retry.
Traceback (most recent call last):
  File "/venv/lib/python3.10/site-packages/kopf/_core/actions/execution.py", line 276, in execute_handler_once
    result = await invoke_handler(
  File "/venv/lib/python3.10/site-packages/kopf/_core/actions/execution.py", line 371, in invoke_handler
    result = await invocation.invoke(
  File "/venv/lib/python3.10/site-packages/kopf/_core/actions/invocation.py", line 116, in invoke
    result = await f...tches for kind "ServiceMonitor" in version "monitoring.coreos.com/v1"
ensure CRDs are installed first, resource mapping not found for name: "calico-node-metrics" namespace: "calico-system" from "": no matches for kind "ServiceMonitor" in version "monitoring.coreos.com/v1"
ensure CRDs are installed first, resource mapping not found for name: "calico-typha-metrics" namespace: "calico-system" from "": no matches for kind "ServiceMonitor" in version "monitoring.coreos.com/v1"
ensure CRDs are installed first]
  Error  Logging  3m54s  kopf  Handler 'handle_addon_updated' failed with an exception. Will retry.
Traceback (most recent call last):
  File "/venv/lib/python3.10/site-packages/kopf/_core/actions/execution.py", line 276, in execute_handler_once
    result = await invoke_handler(
  File "/venv/lib/python3.10/site-packages/kopf/_core/actions/execution.py", line 371, in invoke_handler
    result = await invocation.invoke(
  File "/venv/lib/python3.10/site-packages/kopf/_core/actions/invocation.py", line 116, in invoke
    result = await f...tches for kind "ServiceMonitor" in version "monitoring.coreos.com/v1"
ensure CRDs are installed first, resource mapping not found for name: "calico-node-metrics" namespace: "calico-system" from "": no matches for kind "ServiceMonitor" in version "monitoring.coreos.com/v1"
ensure CRDs are installed first, resource mapping not found for name: "calico-typha-metrics" namespace: "calico-system" from "": no matches for kind "ServiceMonitor" in version "monitoring.coreos.com/v1"
ensure CRDs are installed first]
  Error  Logging  2m53s  kopf  Handler 'handle_addon_updated' failed with an exception. Will retry.
Traceback (most recent call last):
  File "/venv/lib/python3.10/site-packages/kopf/_core/actions/execution.py", line 276, in execute_handler_once
    result = await invoke_handler(
  File "/venv/lib/python3.10/site-packages/kopf/_core/actions/execution.py", line 371, in invoke_handler
    result = await invocation.invoke(
  File "/venv/lib/python3.10/site-packages/kopf/_core/actions/invocation.py", line 116, in invoke
    result = await f...tches for kind "ServiceMonitor" in version "monitoring.coreos.com/v1"
ensure CRDs are installed first, resource mapping not found for name: "calico-node-metrics" namespace: "calico-system" from "": no matches for kind "ServiceMonitor" in version "monitoring.coreos.com/v1"
ensure CRDs are installed first, resource mapping not found for name: "calico-typha-metrics" namespace: "calico-system" from "": no matches for kind "ServiceMonitor" in version "monitoring.coreos.com/v1"
ensure CRDs are installed first]
  Error  Logging  113s  kopf  Handler 'handle_addon_updated' failed with an exception. Will retry.
Traceback (most recent call last):
  File "/venv/lib/python3.10/site-packages/kopf/_core/actions/execution.py", line 276, in execute_handler_once
    result = await invoke_handler(
  File "/venv/lib/python3.10/site-packages/kopf/_core/actions/execution.py", line 371, in invoke_handler
    result = await invocation.invoke(
  File "/venv/lib/python3.10/site-packages/kopf/_core/actions/invocation.py", line 116, in invoke
    result = await f...tches for kind "ServiceMonitor" in version "monitoring.coreos.com/v1"
ensure CRDs are installed first, resource mapping not found for name: "calico-node-metrics" namespace: "calico-system" from "": no matches for kind "ServiceMonitor" in version "monitoring.coreos.com/v1"
ensure CRDs are installed first, resource mapping not found for name: "calico-typha-metrics" namespace: "calico-system" from "": no matches for kind "ServiceMonitor" in version "monitoring.coreos.com/v1"
ensure CRDs are installed first]
  Error  Logging  52s  kopf  Handler 'handle_addon_updated' failed with an exception. Will retry.
Traceback (most recent call last):
  File "/venv/lib/python3.10/site-packages/kopf/_core/actions/execution.py", line 276, in execute_handler_once
    result = await invoke_handler(
  File "/venv/lib/python3.10/site-packages/kopf/_core/actions/execution.py", line 371, in invoke_handler
    result = await invocation.invoke(
  File "/venv/lib/python3.10/site-packages/kopf/_core/actions/invocation.py", line 116, in invoke
    result = await f...tches for kind "ServiceMonitor" in version "monitoring.coreos.com/v1"
ensure CRDs are installed first, resource mapping not found for name: "calico-node-metrics" namespace: "calico-system" from "": no matches for kind "ServiceMonitor" in version "monitoring.coreos.com/v1"
ensure CRDs are installed first, resource mapping not found for name: "calico-typha-metrics" namespace: "calico-system" from "": no matches for kind "ServiceMonitor" in version "monitoring.coreos.com/v1"
ensure CRDs are installed first]

It looks like the manifest doesn't force helm to reinstall CRDs onto the target from the bootstrap cluster once it's been installed.
I suspect there are other add-ons which use CRDs which could be impacted by this too, especially if you have development clusters which get spun up and down often.

@DavidFair
This is an odd one. I re-install clusters with the same name all the time for development.
I wonder whether all the HelmReleases for the old cluster are deleted before you create the new one? If they are not, that would result in the new cluster picking up a deleted HelmRelease...

I've not seen this again since, so I'm going to close it as something environment related


Unavailable secret error

Unless for some reason this is not trivial to test

I think we can have an integration test in SessionLiveTest, where we evaluate code that accesses an env var and assert the button appears.

The action is failing coz the test needs the rc.1. Can we bump it?

@cristineguadelupe please bump it, yes! :) both in mix.exs and in CI!

@jonatanklosko Did I do something wrong on the test? It looks flaky 😞


Update README.md

English Translation

Thanks , to be advised，
Don't using google translate or other, it's can't translate chinese poetry.
[
  {	  {
    "strains": [	    "strains": [
      "平平平仄仄，平仄仄平平。",	      "Ping Ping Ping, Ping Ping Ping Ping.",
      "仄仄平平仄，平平仄仄平。",	      "仄仄平平仄, 平平平平.",
      "平平平仄仄，平仄仄平平。",	      "Ping Ping Ping, Ping Ping Ping Ping.",
      "平仄仄平仄，平平仄仄平。"	      "Ping 仄仄 flat, flat and flat."
    ],	    ],
    "author": "太宗皇帝",	    "author": "The Emperor Taizong",
    "paragraphs": [	    "paragraphs": [
      "秦川雄帝宅，函谷壯皇居。",	      "Qin Chuan Xiong's house, the letter to the valley of the emperor.",
      "綺殿千尋起，離宮百雉餘。",	      "The temple is looking for a thousand, and it’s a hundred miles away."
      "連甍遙接漢，飛觀迥凌虛。",	      "Let's get away with Han, fly to see Ling Ling.",
      "雲日隱層闕，風煙出綺疎。"	      "The cloud is hidden, and the wind is blowing out."
    ],	    ],
    "title": "帝京篇十首 一"	    "title": "The Ten Kings of the Imperial Palace"
  },	  },
  ... 每单个JSON文件1000条唐诗记录.	  ... 1000 Tang poem records per single JSON file.
]	]


Python 3.11 support

Python 3.11 was just released, so this tool should support that

Not needed - nothing of the code is python version dependent


2022/3/18放送分

[x] 募集サイトをconnpassに作る
[ ] URLを貼る
[ ] 放送開始

PowerShell and OpenSSH team investiments for 2022

Windows Package Manager 12.

Edge Developer Tools for Visual Studio (Preview)

End-of-service for SharePoint Online Machine Transaction Service and APISs

Debugging Microsoft Teams apps locally with Teams Toolkit

Join us at Microsoft JDConf 2022

.NET March 2022 Updates - .NET 6.0.3, .NET 5.0.15 and .NET 3.1.23

Public preview of SharePoint Framework 1.15 - First release of the upcoming features

Financial services firm Jack Henry finds a reliable, fast database in Azure Cosmos DB

Automate code metrics and class diagrams with GitHub Actions

A Proposal For Type Syntax in JavaScript

Embedded Software Development in Visual Studio Code

Announcing PowerShell Crescendo General Availability (GA)

Microsoft Edge dual-screen web APIs

The new Microsoft Cosmos DB Developer Speciality Certification is here!

Azure SDK Release (March 2022)

PIX-2203.07: Support for DirectStorage

Announcing .NET 7 Preview 2 - The New, 'New' Experience

Deprecating weak crypographic standards (TLS 1.0 and 1.1) in Azure DevOps Services

Happy 25th birthday Visual Studio!

ASP.NET Core updates in .NET 7 Preview 2

Learn from the community: Low code bot onboards members to Microsoft Teams channel

Build GraphQL apps with Hasura and Azure SQL Database

Visual Studio 2022 for Mac Preview 7

Azure export controls white paper updates

Announcing .NET MAUI Preview 14

Azure Artifacts now provides native support to use packages from more repositories

Azure Artifacts feed continues to make product accessible to everyone