#158

(Forgive my crappy code, I'm still learning Python)
Using the following "test" script:
import json
import getpass
import time
import pynetbox
from pprint import pprint

try:
        print("Setting up initial PyNetBox auth session to https://netbox-dev...")
        token_from_prompt = getpass.getpass("API Token: ")
        nb = pynetbox.api(
                url='https://netbox-dev',
                token = token_from_prompt
                )

        print("dcim.devices.all_count()")
        start = time.time()
        all_devices_count = nb.dcim.devices.all_count()
        end = time.time()
        print("Got: {} results, took {} seconds".format(all_devices_count, end - start))

        print("nb.dcim.devices.all(progress=True)")
        start = time.time()
        all_devices_with_progress = nb.dcim.devices.all(progress=True)
        end = time.time()
        print("Got: {} results, took {} seconds".format(len(all_devices_with_progress), end - start))

        print("nb.dcim.devices.all()")
        start = time.time()
        all_devices = nb.dcim.devices.all()
        end = time.time()
        print("Got: {} results, took {} seconds".format(len(all_devices), end - start))

        print('Getting "nb.ipam.prefixes.filter(within="<IP_ADDRESS>/10", status=1, progress=True)"')
        start = time.time()
        filtered_prefixes_with_progress = nb.ipam.prefixes.filter(within="<IP_ADDRESS>/10", status=1, progress=True)
        end = time.time()
        print("Got: {}, took {} seconds".format(len(filtered_prefixes_with_progress), end - start))

        print('Getting "nb.ipam.prefixes.filter(within="<IP_ADDRESS>/10", status=1, progress=False)"')
        start = time.time()
        filtered_prefixes = nb.ipam.prefixes.filter(within="<IP_ADDRESS>/10", status=1, progress=False)
        end = time.time()
        print("Got: {}, took {} seconds".format(len(filtered_prefixes), end - start))

        print('Getting "nb.ipam.prefixes.filter(within="<IP_ADDRESS>/10", status=1)"')
        start = time.time()
        filtered_prefixes = nb.ipam.prefixes.filter(within="<IP_ADDRESS>/10", status=1)
        end = time.time()
        print("Got: {}, took {} seconds".format(len(filtered_prefixes), end - start))

        print('Getting "nb.ipam.prefixes.filter_count(within="<IP_ADDRESS>/10", status=1, progress=True)"')
        start = time.time()
        filtered_prefixes_count_only = nb.ipam.prefixes.filter_count(
                within="<IP_ADDRESS>/10",
                status=1,
                progress=True)
        end = time.time()
        print("Got: {}, took {} seconds".format(filtered_prefixes_count_only, end - start))

except KeyboardInterrupt as e:
        print("CTRL-C seen.")

I get the following output:
$ python ./test.py
Setting up initial PyNetBox auth session to https://netbox-dev.datto.net...
API Token:
dcim.devices.all_count()
Got: 7326 results, took 0.47971320152282715 seconds
nb.dcim.devices.all(progress=True)
Progress: 100%|█████████████████████████████████████████████████████████████████████████████| 7326/7326 [02:18<00:00, 52.92results/s]
Got: 7326 results, took<PHONE_NUMBER>0838013 seconds
nb.dcim.devices.all()
Got: 7326 results, took<PHONE_NUMBER>1949463 seconds
Getting "nb.ipam.prefixes.filter(within="<IP_ADDRESS>/10", status=1, progress=True)"
Progress: 100%|█████████████████████████████████████████████████████████████████████████████████| 62/62 [00:00<00:00, 94.63results/s]
Got: 62, took 1.0894124507904053 seconds
Getting "nb.ipam.prefixes.filter(within="<IP_ADDRESS>/10", status=1, progress=False)"
Got: 62, took 1.018470048904419 seconds
Getting "nb.ipam.prefixes.filter(within="<IP_ADDRESS>/10", status=1)"
Got: 62, took 0.9354448318481445 seconds
Getting "nb.ipam.prefixes.filter_count(within="<IP_ADDRESS>/10", status=1, progress=True)"
Got: 62, took 0.45035815238952637 seconds

I've placated the linter, but my experience with setting up tests correctly borders on non-existent. Any and all help would be greatly appreciated. I'll give it a shot in the name of learning.
Not sure how much this PR failing Python 2.7 branch matters.

I was struggling deciding between doing .all(count_only=True) and what I wrote now - .all_count() - (and similarly .filter() having a special case for count_only, vs now having filter() and filter_count()).
In the end, I thought about the return types. .all() returns a list of Records, but .all(count_only) would return an int. That felt like I'd be setting up a future rife with TypeErrors or one full of if instance() checks, so having a separate all_count()  felt more appropriate. Happy to have been wrong.

With @Conan-Kudo's (https://github.com/digitalocean/pynetbox/compare/master...Conan-Kudo:158-maybefix), most of the tests now pass, but I am very confused about the failures still occurring.
As a total silly/desperate measure, I've added:
print("Object __dict__ special attribute via 'vars(test)': '{}'".format(vars(test)))
        print()
        print("Object attributes via 'dir(test)': '{}'".format(dir(test)))
        # Object Type: 'Record'

to file test_dcim.py inside test_get_napalm() test definition between test= and ret=.
This yielded:
python3 -m unittest discover -k test_get_napalm
Object __dict__ special attribute via 'vars(test)': '{'has_details': False, '_full_cache': [], '_init_cache': [('get_facts', '')], 'api': <pynetbox.api.Api object at 0x7f4c15efb090>, 'endpoint': <pynetbox.core.endpoint.Endpoint object at 0x7f4c15ee8390>, 'default_ret': <class 'pynetbox.core.response.Record'>, 'get_facts': }'

Object attributes via 'dir(test)': '['__class__', '__delattr__', '__dict__', '__dir__', '__doc__', '__eq__', '__format__', '__ge__', '__getattr__', '__getattribute__', '__getitem__', '__getstate__', '__gt__', '__hash__', '__init__', '__init_subclass__', '__iter__', '__le__', '__lt__', '__module__', '__ne__', '__new__', '__reduce__', '__reduce_ex__', '__repr__', '__setattr__', '__setstate__', '__sizeof__', '__str__', '__subclasshook__', '__weakref__', '_add_cache', '_compare', '_diff', '_full_cache', '_init_cache', '_parse_values', 'api', 'default_ret', 'delete', 'device_type', 'endpoint', 'full_details', 'get_facts', 'has_details', 'napalm', 'primary_ip', 'primary_ip4', 'primary_ip6', 'save', 'serialize', 'update', 'url']'
E
======================================================================
ERROR: test_get_napalm (tests.test_dcim.DeviceTestCase)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/lib64/python3.7/unittest/mock.py", line 1209, in patched
    return func(*args, **keywargs)
  File "/home/pmay/work/code/pynetbox_work/tests/test_dcim.py", line 274, in test_get_napalm
    ret = test.napalm.list(method='get_facts')
  File "/home/pmay/work/code/pynetbox_work/pynetbox/core/response.py", line 182, in __getattr__
    raise AttributeError('object has no attribute "{}"'.format(k))
AttributeError: object has no attribute "napalm"

----------------------------------------------------------------------
Ran 1 test in 0.001s

FAILED (errors=1)

So, dir(test) shows napalm, but vars(test) doesn't.
Quite confused as to the reasons why this is happening.


proximity loss when there are not continous features

the method compute_proximity_loss() from dice_genetic.py returns an error when the dataset does not contain continous features.
    def compute_proximity_loss(self, x_hat_unnormalized, query_instance_normalized):
        """Compute weighted distance between two vectors."""
        x_hat = self.data_interface.normalize_data(x_hat_unnormalized)
        feature_weights = np.array(
            [self.feature_weights_list[0][i] for i in self.data_interface.continuous_feature_indexes])
        product = np.multiply(
            (abs(x_hat - query_instance_normalized)[:, [self.data_interface.continuous_feature_indexes]]),
            feature_weights)
        product = product.reshape(-1, product.shape[-1])
        proximity_loss = np.sum(product, axis=1)

        # Dividing by the sum of feature weights to normalize proximity loss
        return proximity_loss / sum(feature_weights)

@DBrughmans, can you paste the error or the stack trace here?

@DBrughmans can you paste the error or the stack trace here so that we can make progress on this issue?

@gaugup I have the error message when setting all the variables as str to make it categorical:
"
367             (abs(x_hat - query_instance_normalized)[:, [self.data_interface.continuous_feature_indexes]]),
368             feature_weights)
--> 369         product = product.reshape(-1, product.shape[-1])
370         proximity_loss = np.sum(product, axis=1)
371
ValueError: cannot reshape array of size 0 into shape (0)
"

I have the same error


crash app on arch linux

Is there an existing issue for this?

[X] I have searched the existing issues.

Anyway, I suspect that this is related to the GUI library used by Sniffnet.
Try setting an environment variable ICED_BACKEND=tiny-skia and try again; this tells the app to use an alternative graphical renderer (tiny-skia over wgpu).

This means that for this problem to be solved it's necessary to wait until a new Sniffnet release using the most recent version of Iced will be published (this should happen in about one month or so).
Alternatively, you can build Sniffnet from the main branch with cargo (main depends on winit 0.28.7, while Sniffnet 1.2.2 depends on winit 0.28.6).

I use Arch and I can't replicate this issue.


Discussion forum is down

forum.pyro.ai is currently down.

ill take a look

it's back up, latency still high. wlil try to get approval for / upscale on monday

upgraded to an m4 instance. hopefully this will take care of the latency issues weve been seeing


Arduino with #include <SD.h> gives error because Energia.h is needed

I use the simple blink example on an nano and add the line #include <SD.h>. The compiler gives the error:
.pioenvs\autogen_nanoatmega328\SD_ID79\utility\Sd2Card.cpp:21:21: fatal error: Energia.h: No such file or directory
Shouldn't it use something like arduino.h?

This library doesn't support framework arduino. In other words, this is a port of this library https://github.com/adafruit/SD
I will add support for valid Arduino SD library as soon as possible.

Current solution: just create in src dir file named Energia.h with the next contents:
#include <Arduino.h>

I've just added new library which is compatible with Arduino framework. Please use it http://platformio.org/#!/lib/show/161/SD


UDP sample not working

I get WSAEINVAL 10022 at this line.
The sample is 2+ years old so the main question is if it is supposed to work as of now? And if it does then what could be wrong?

Found that AdressPool.GetBuffer(); returns a buffer without content length and AllocateAdress does not set it either. This line at the end of  AllocateAdress fixes the problem:
adressSegment.SegmentPointer->Length = adressSegment.TotalLength;
public RioBufferSegment AllocateAdress(IPEndPoint remoteAdress)
{
    Debug.Assert(inUse);
    var adressSegment = AdressPool.GetBuffer();
    SOCKADDR_INET* adress = (SOCKADDR_INET*)adressSegment.DataPointer;
    var adressBytes = remoteAdress.Address.GetAddressBytes();

    if (remoteAdress.AddressFamily == System.Net.Sockets.AddressFamily.InterNetwork)
    {
        adress->Ipv4.sin_family = ADDRESS_FAMILIES.AF_INET;
        adress->Ipv4.sin_port = WinSock.htons((ushort)remoteAdress.Port);

        fixed (byte* a = adressBytes)
            Unsafe.CopyBlock(adress->Ipv4.sin_addr.Address, a, (uint)adressBytes.Length);
    }
    adressSegment.SegmentPointer->Length = adressSegment.TotalLength;
    return adressSegment;
}

Great, thanks! sorry I haven't kept up with the repo, it should probably be changed to use span now instead


Possible to remove duplicate objects in arrays?

As the title stated is it possible to remove duplicate array objects when deep merging? I am referring to identical objects with identical values.
I tried the arrayMerge but that really isn't what I'm looking for, I'd like any array no matter how nested to figure this out automatically.

You can pass in a custom arrayMerge function that combines the arrays in the source and target however you like.  https://github.com/TehShrike/deepmerge#arraymerge


chore: update opentelemetry dependencies to 0.27.0

Motivation
New version 0.27.0 of the opentelemetry crates was recently released.
Solution
I've updated the dependencies and fixed any outstanding compilation issues caused by breaking changes in the upstream.
Two caveats:

I was not able to resolve the compilation issues with https://github.com/tokio-rs/tracing-opentelemetry/blob/95f9ab97e239e5789d71b9636445d89e47612f65/benches/metrics.rs since the NoopMeterProvider has been hidden: https://github.com/open-telemetry/opentelemetry-rust/pull/2191
The metric "views" are now gated behind the feature spec_unstable_metrics_views, and I wasn't sure whether to still include it in the example: https://github.com/MathiasPius/tracing-opentelemetry/blob/d18214596c97b1243ee955a63bed3875a4f8f5f9/examples/opentelemetry-otlp.rs#L47-L82

In order to solve the compilation issue from benches/metrics.rs with NoopMeterProvider,
you can declare NoopMeterProvider for the purpose of that metrics. it doesn't hurt replicating the logic in here.
I did it like this, it compiles successfully and the test was being to run successfully. Hope that helps for the compilation errors.
use opentelemetry::metrics::{InstrumentProvider, Meter, MeterProvider};

struct NoopMeterProvider{
    _private: ()
}

impl NoopMeterProvider {
    fn new()->Self{
        Self{
            _private: ()
        }
    }
}

impl MeterProvider for NoopMeterProvider{
    fn meter_with_scope(&self, scope: InstrumentationScope) -> Meter {
        Meter::new(Arc::new(NoopMeter::new()))
    }
}

struct NoopMeter {
    _private: (),
}

impl NoopMeter {
    /// Create a new no-op meter core.
    pub(crate) fn new() -> Self {
        NoopMeter { _private: () }
    }
}

impl InstrumentProvider for NoopMeter {}

fn metrics_events(c: &mut Criterion) {
.........

That was also the solution I was considering.
With a maintainer's blessing and some guidance on how to resolve the spec_unstable_metrics_views change, I can make the changes later today :)

I've resolved the caveats in the OP:

Added implementation of NoopMeterProvider in benches/metrics.rs
Enabled spec_unstable_metrics_views feature for opentelemetry-sdk (in dev-dependencies only)

Removed the "views" functionality from the example
Fixed the cargo hack powerset feature failures, missed some .init() to .build() renames.
Bumped version to 0.28.0

Looks like you'll need to bump the MSRV:
https://github.com/tokio-rs/tracing-opentelemetry/blob/v0.1.x/Cargo.toml#L16
https://github.com/tokio-rs/tracing-opentelemetry/blob/v0.1.x/.github/workflows/CI.yml#L91

Published tracing-opentelemetry v0.28.0 at registry crates-io
[new tag]         v0.28.0 -> v0.28.0
Release notes

Thanks


Question when building project with xcode-beta 16.0

Hi folks,
First of all, thanks for building and maintaining this project. It works really well.
However, I would like to report an issue I faced when I tried to build this project using xcode-beta 16. I was unable to build my project using carthage via this command carthage build --platform iOS --cache-builds --no-use-binaries --use-xcframeworks. There is an error message saying xcodebuild failed to found the destination, which, after looking a bit, I notice the Pulse project does not support iOS destination.
Hence, after I made a local modification, to add iOS as Supported Destination, then, the build command worked fine. As such, I would like to know, whether is it correct to add iOS as Supported Destination here? I feel like this issue kinda tied with xcodebuild tool as this does not happen in xcode 15.2.
Following is the patch for your perusal, feel free to use it in case needed. Thanks
diff --git a/Pulse.xcodeproj/project.pbxproj b/Pulse.xcodeproj/project.pbxproj
index de1126f6..afd3f1f4 100644
--- a/Pulse.xcodeproj/project.pbxproj
+++ b/Pulse.xcodeproj/project.pbxproj
@@ -2975,7 +2975,7 @@
 				SUPPORTS_MACCATALYST = YES;
 				SWIFT_ACTIVE_COMPILATION_CONDITIONS = DEBUG;
 				SWIFT_VERSION = 5.0;
-				TARGETED_DEVICE_FAMILY = 7;
+				TARGETED_DEVICE_FAMILY = "1,2,7";
 				VERSIONING_SYSTEM = "apple-generic";
 				VERSION_INFO_PREFIX = "";
 			};
@@ -3011,7 +3011,7 @@
 				SUPPORTED_PLATFORMS = "appletvos appletvsimulator iphoneos iphonesimulator macosx watchos watchsimulator xros xrsimulator";
 				SUPPORTS_MACCATALYST = YES;
 				SWIFT_VERSION = 5.0;
-				TARGETED_DEVICE_FAMILY = 7;
+				TARGETED_DEVICE_FAMILY = "1,2,7";
 				VERSIONING_SYSTEM = "apple-generic";
 				VERSION_INFO_PREFIX = "";
 			};

Pusle does not officially support Carthage and the Xcode project will be removed in the upcoming versions. I would recommend switching to one of the officially supported insallation options.


feat: update data folder path

We was assuming data folder will be in the same folder as cortex binary file
cortex
|__ engines
|__ models
|__ cortex.exe

but we finalized the data folder structure in https://github.com/janhq/cortex.cpp/discussions/1115
This requires us to update logic to make it works properly.

Closing this - adding as a sub feat of the bigger epic

https://github.com/janhq/cortex.cpp/issues/1154


make all fails with many messages like this: cannot use grpcServer (type *"github.com/hyperledger/fabric/vendor/google.golang.org/grpc".Server) as type *"github.com/hyperledger/fabric/vendor/github.com/hyperledger/fabric/vendor/google.golang.org/grpc".Server in argument to "github.com/hyperledger/fabric/vendor/github.com/hyperledger/fabric/protos".RegisterEventsServer

Description
Here is my environment:
Windows 7 --> virtualbox -> git bash -> vagrant
When running 'make all'. the command fails with many messages like this:
cannot use grpcServer (type *"github.com/hyperledger/fabric/vendor/google.golang.org/grpc".Server) as type *"github.com/hyperledger/fabric/vendor/github.com/hyperledger/fabric/vendor/google.golang.org/grpc".Server in argument to "github.com/hyperledger/fabric/vendor/github.com/hyperledger/fabric/protos".RegisterEventsServer
This worked for me a day or so ago, so recent code must have broken it.
Here is the full output of Make:
==================begin Make all output ==============================
$ make all
Building docker src-image
docker build -t hyperledger/fabric-src:latest build/image/src
Sending build context to Docker daemon 20.42 MB
Step 1 : FROM hyperledger/fabric-baseimage:latest
---> 3d32508b5e7f
Step 2 : ADD gopath.tar.bz2 $GOPATH/src/github.com/hyperledger/fabric
---> 44c00fdca742
Removing intermediate container 8aaccb02a159
Successfully built 44c00fdca742
Building docker ccenv-image
docker build -t hyperledger/fabric-ccenv:latest build/image/ccenv
Sending build context to Docker daemon 16.97 MB
Step 1 : FROM hyperledger/fabric-src:latest
---> 44c00fdca742
Step 2 : COPY bin/* /usr/local/bin/
---> 71b6b7c1dee0
Removing intermediate container 7578afbc4c70
Successfully built 71b6b7c1dee0
CGO_CFLAGS=" " CGO_LDFLAGS="-lrocksdb -lstdc++ -lm -lz -lbz2 -lsnappy" GOBIN=/opt/gopath/src/github.com/hyperledger/fabric/build/bin go install github.com/hyperledger/fabric/peer
github.com/hyperledger/fabric/peer
peer/main.go:349: cannot use grpcServer (type *"github.com/hyperledger/fabric/vendor/google.golang.org/grpc".Server) as type *"github.com/hyperledger/fabric/vendor/github.com/hyperledger/fabric/vendor/google.golang.org/grpc".Server in argument to "github.com/hyperledger/fabric/vendor/github.com/hyperledger/fabric/protos".RegisterEventsServer
peer/main.go:492: cannot use grpcServer (type *"github.com/hyperledger/fabric/vendor/google.golang.org/grpc".Server) as type *"github.com/hyperledger/fabric/vendor/github.com/hyperledger/fabric/vendor/google.golang.org/grpc".Server in argument to "github.com/hyperledger/fabric/vendor/github.com/hyperledger/fabric/protos".RegisterPeerServer
peer/main.go:495: cannot use grpcServer (type *"github.com/hyperledger/fabric/vendor/google.golang.org/grpc".Server) as type *"github.com/hyperledger/fabric/vendor/github.com/hyperledger/fabric/vendor/google.golang.org/grpc".Server in argument to "github.com/hyperledger/fabric/vendor/github.com/hyperledger/fabric/protos".RegisterAdminServer
peer/main.go:499: cannot use grpcServer (type *"github.com/hyperledger/fabric/vendor/google.golang.org/grpc".Server) as type *"github.com/hyperledger/fabric/vendor/github.com/hyperledger/fabric/vendor/google.golang.org/grpc".Server in argument to "github.com/hyperledger/fabric/vendor/github.com/hyperledger/fabric/protos".RegisterDevopsServer
peer/main.go:508: cannot use grpcServer (type *"github.com/hyperledger/fabric/vendor/google.golang.org/grpc".Server) as type *"github.com/hyperledger/fabric/vendor/github.com/hyperledger/fabric/vendor/google.golang.org/grpc".Server in argument to "github.com/hyperledger/fabric/vendor/github.com/hyperledger/fabric/protos".RegisterOpenchainServer
peer/main.go:578: cannot use "github.com/hyperledger/fabric/vendor/google/protobuf".Empty literal (type *"github.com/hyperledger/fabric/vendor/google/protobuf".Empty) as type *"github.com/hyperledger/fabric/vendor/github.com/hyperledger/fabric/vendor/google/protobuf".Empty in argument to serverClient.GetStatus
peer/main.go:611: cannot use "github.com/hyperledger/fabric/vendor/google/protobuf".Empty literal (type *"github.com/hyperledger/fabric/vendor/google/protobuf".Empty) as type *"github.com/hyperledger/fabric/vendor/github.com/hyperledger/fabric/vendor/google/protobuf".Empty in argument to serverClient.StopServer
peer/main.go:739: cannot use grpcServer (type *"github.com/hyperledger/fabric/vendor/google.golang.org/grpc".Server) as type *"github.com/hyperledger/fabric/vendor/github.com/hyperledger/fabric/vendor/google.golang.org/grpc".Server in argument to "github.com/hyperledger/fabric/vendor/github.com/hyperledger/fabric/protos".RegisterChaincodeSupportServer
peer/main.go:987: invocation.IdGenerationAlg undefined (type *"github.com/hyperledger/fabric/vendor/github.com/hyperledger/fabric/protos".ChaincodeInvocationSpec has no field or method IdGenerationAlg)
peer/main.go:1039: cannot use "github.com/hyperledger/fabric/vendor/google/protobuf".Empty literal (type *"github.com/hyperledger/fabric/vendor/google/protobuf".Empty) as type *"github.com/hyperledger/fabric/vendor/github.com/hyperledger/fabric/vendor/google/protobuf".Empty in argument to openchainClient.GetPeers
peer/main.go:1039: too many errors
make: *** [build/bin/peer] Error 2
vagrant@ubuntu-1404:/opt/gopath/src/github.com/hyperledger/fabric$
==================end Make all output ==============================
Sorry about the monster font in the middle of the Make output.
Describe How to Reproduce
1.From GIT BASH, Synchronize your laptop with github:
git fetch upstream
git merge upstream/master
git push origin
2. Start the vagrant VM :  vagrant up
3. vagrant ssh
4. cd to your fabric directory, for example:  cd /opt/gopath/src/github.com/hyperledger/fabric
5. Make all
You can also enter 'make peer' for a similar result.

As an experiment (I have multiple failures), I deleted fabric and cloned it again.  I rebuilt my vagrant VM.
The result is a big improvement in the number of messages.  The makefile still fails, but much later.  Here is the new error:
**core/rest/rest_api_test.go:124: cannot use new(mockDevops) (type mockDevops) as type "github.com/hyperledger/fabric/protos".DevopsServer in assignment:
mockDevops does not implement "github.com/hyperledger/fabric/protos".DevopsServer (missing EXP_ExecuteWithBinding method)
This is so similar to the original messages, I have decided to leave this issue open.  Here is the full makefile output:
/fabric$ make all
CGO_CFLAGS=" " CGO_LDFLAGS="-lrocksdb -lstdc++ -lm -lz -lbz2 -lsn                                  appy" GOBIN=/opt/gopath/src/github.com/hyperledger/fabric/build/b                                  in go install github.com/hyperledger/fabric/membersrvc
Binary available as build/bin/membersrvc
make gotool.gomega
make[1]: Entering directory /opt/gopath/src/github.com/hyperledg                                  er/fabric' go get github.com/onsi/gomega make[1]: Leaving directory /opt/gopath/src/github.com/hyperledge                                  r/fabric'
LINT: Running code checks..

Running goimports
Building build/docker/bin/peer
Building docker peer-image
cp build/docker/bin/peer build/image/peer/bin
docker build -t hyperledger/fabric-peer:latest build/image/peer
Sending build context to Docker daemon 27.05 MB
Step 1 : FROM hyperledger/fabric-src:latest
---> db76d82aa778
Step 2 : RUN mkdir -p /var/hyperledger/db
---> Running in 53ce8b4d0a3b
---> 41061ea2f1bf
Removing intermediate container 53ce8b4d0a3b
Step 3 : COPY bin/* $GOPATH/bin/
---> 4d59e59e494b
Removing intermediate container 53e1318d068d
Step 4 : WORKDIR $GOPATH/src/github.com/hyperledger/fabric
---> Running in 9f2e70cfd10f
---> aaabe73a43fd
Removing intermediate container 9f2e70cfd10f
Successfully built aaabe73a43fd
Obtaining list of tests to run..DONE!
Starting peer..DONE!
Running tests...
?       github.com/hyperledger/fabric/bddtests/chaincode/go/table                                  [no test files]
?       github.com/hyperledger/fabric/consensus [no test files]
?       github.com/hyperledger/fabric/consensus/controller      [                                  no test files]
ok      github.com/hyperledger/fabric/consensus/executor        0                                  .275s   coverage: 79.4% of statements
ok      github.com/hyperledger/fabric/consensus/helper  0.096s  c                                  overage: 0.5% of statements
ok      github.com/hyperledger/fabric/consensus/helper/persist  0                                  .008s   coverage: 0.0% of statements
?       github.com/hyperledger/fabric/consensus/noops   [no test                                   files]
ok      github.com/hyperledger/fabric/consensus/obcpbft 64.626s c                                  overage: 80.1% of statements
ok      github.com/hyperledger/fabric/consensus/obcpbft/custodian                                  0.731s  coverage: 98.6% of statements
ok      github.com/hyperledger/fabric/consensus/obcpbft/events  0                                  .218s   coverage: 91.2% of statements
ok      github.com/hyperledger/fabric/consensus/util    0.197s  c                                  overage: 93.8% of statements
ok      github.com/hyperledger/fabric/core      0.062s  coverage:                                   5.7% of statements
ok      github.com/hyperledger/fabric/core/chaincode    280.759s        coverage: 62.2% of statements
?       github.com/hyperledger/fabric/core/chaincode/platforms  [no test files]
?       github.com/hyperledger/fabric/core/chaincode/platforms/car      [no test files]
ok      github.com/hyperledger/fabric/core/chaincode/platforms/car/test 14.455s coverage: 0.0% of statements
ok      github.com/hyperledger/fabric/core/chaincode/platforms/golang   0.073s  coverage: 12.5% of statements
ok      github.com/hyperledger/fabric/core/chaincode/shim       0.057s  coverage: 1.9% of statements
?       github.com/hyperledger/fabric/core/chaincode/shim/crypto        [no test files]
ok      github.com/hyperledger/fabric/core/chaincode/shim/crypto/attr   0.052s  coverage: 90.4% of statements
ok      github.com/hyperledger/fabric/core/chaincode/shim/crypto/ecdsa  0.203s  coverage: 66.7% of statements
ok      github.com/hyperledger/fabric/core/comm 2.739s  coverage: 56.7% of statements
?       github.com/hyperledger/fabric/core/config       [no test files]
ok      github.com/hyperledger/fabric/core/container    13.663s coverage: 34.3% of statements
?       github.com/hyperledger/fabric/core/container/ccintf     [no test files]
?       github.com/hyperledger/fabric/core/container/dockercontroller   [no test files]
?       github.com/hyperledger/fabric/core/container/inproccontroller   [no test files]
?       github.com/hyperledger/fabric/core/container/util       [no test files]
ok      github.com/hyperledger/fabric/core/crypto       87.877s coverage: 62.6% of statements
ok      github.com/hyperledger/fabric/core/crypto/attributes    0.053s  coverage: 92.2% of statements
?       github.com/hyperledger/fabric/core/crypto/attributes/proto      [no test files]
ok      github.com/hyperledger/fabric/core/crypto/primitives    21.102s coverage: 72.6% of statements
ok      github.com/hyperledger/fabric/core/crypto/primitives/aes        0.007s  coverage: 85.7% of statements
ok      github.com/hyperledger/fabric/core/crypto/primitives/ecies      0.404s  coverage: 74.5% of statements
?       github.com/hyperledger/fabric/core/crypto/utils [no test files]
ok      github.com/hyperledger/fabric/core/db   1.019s  coverage: 67.1% of statements
ok      github.com/hyperledger/fabric/core/ledger       20.771s coverage: 80.0% of statements
ok      github.com/hyperledger/fabric/core/ledger/genesis       0.102s  coverage: 47.1% of statements
ok      github.com/hyperledger/fabric/core/ledger/perfstat      0.005s  coverage: 2.2% of statements
ok      github.com/hyperledger/fabric/core/ledger/statemgmt     0.009s  coverage: 68.2% of statements
ok      github.com/hyperledger/fabric/core/ledger/statemgmt/buckettree  0.798s  coverage: 91.6% of statements
ok      github.com/hyperledger/fabric/core/ledger/statemgmt/raw 0.010s  coverage: 0.0% of statements
ok      github.com/hyperledger/fabric/core/ledger/statemgmt/state       0.605s  coverage: 61.7% of statements
ok      github.com/hyperledger/fabric/core/ledger/statemgmt/trie        0.546s  coverage: 79.9% of statements
ok      github.com/hyperledger/fabric/core/ledger/test  15.188s coverage: 0.0% of statements
ok      github.com/hyperledger/fabric/core/ledger/testutil      0.005s  coverage: 0.0% of statements
ok      github.com/hyperledger/fabric/core/ledger/util  0.007s  coverage: 95.5% of statements
ok      github.com/hyperledger/fabric/core/peer 0.025s  coverage: 1.5% of statements
ok      github.com/hyperledger/fabric/core/peer/statetransfer   0.284s  coverage: 81.4% of statements
github.com/hyperledger/fabric/core/rest
core/rest/rest_api_test.go:124: cannot use new(mockDevops) (type *mockDevops) as type "github.com/hyperledger/fabric/protos".DevopsServer in assignment:
*mockDevops does not implement "github.com/hyperledger/fabric/protos".DevopsServer (missing EXP_ExecuteWithBinding method)
FAIL    github.com/hyperledger/fabric/core/rest [build failed]
ok      github.com/hyperledger/fabric/core/system_chaincode     2.279s  coverage: 81.0% of statements
?       github.com/hyperledger/fabric/core/system_chaincode/api [no test files]
?       github.com/hyperledger/fabric/core/system_chaincode/samplesyscc [no test files]
ok      github.com/hyperledger/fabric/core/util 2.019s  coverage: 73.7% of statements
?       github.com/hyperledger/fabric/discovery [no test files]
ok      github.com/hyperledger/fabric/events    4.067s  coverage: 81.0% of statements
?       github.com/hyperledger/fabric/events/consumer   [no test files]
?       github.com/hyperledger/fabric/events/producer   [no test files]
?       github.com/hyperledger/fabric/membersrvc        [no test files]
ok      github.com/hyperledger/fabric/membersrvc/ca     10.872s coverage: 75.6% of statements
?       github.com/hyperledger/fabric/membersrvc/protos [no test files]
ok      github.com/hyperledger/fabric/peer      0.072s  coverage: 11.1% of statements
ok      github.com/hyperledger/fabric/protos    0.158s  coverage: 5.8% of statements
?       github.com/hyperledger/fabric/tools/busywork/benchmarks [no test files]
ok      github.com/hyperledger/fabric/tools/busywork/busywork   2.195s  coverage: 88.9% of statements
?       github.com/hyperledger/fabric/tools/busywork/counters   [no test files]
ok      github.com/hyperledger/fabric/tools/dbutility   0.364s  coverage: 32.4% of statements
Stopping peer..
make: *** [unit-test] Error 2

P.S. Sorry about the monster font in the prior post.


Prepare sources

TODO:

[x] agree on the CLI interface:

packit prepare-sources --help
Usage: packit prepare-sources [OPTIONS] [PATH_OR_URL]

  Prepare sources for a new SRPM build using content of the upstream
  repository. Determine version, create an archive or download upstream and
  create patches for sourcegit, fix/update the specfile to use the right
  archive, download the remote sources. Behaviour can be customized by
  specifying actions (post-upstream-clone, get-current-version, create-
  archive, create-patches, fix-spec-file) in the configuration.

  PATH_OR_URL argument is a local path or a URL to the upstream git
  repository, it defaults to the current working directory

Options:
  --result-dir DIR            Copy the sources into DIR. By default,
                              `prepare_sources_result` directory in the
                              current working directory is created.

  --upstream-ref TEXT         Git ref of the last upstream commit in the
                              current branch from which packit should generate
                              patches (this option implies the repository is
                              source-git).

  --bump / --no-bump          Specifies whether to bump version or not.
  --release-suffix TEXT       Specifies release suffix. Allows to override
                              default generated:{current_time}.{sanitized_curr
                              ent_branch}{git_desc_suffix}

  --ref TEXT                  Git reference to checkout.
  --pr-id TEXT                Specifies PR to checkout.
  --merge-pr / --no-merge-pr  Specifies whether to merge PR into the base
                              branch in case pr-id is specified.

  -h, --help                  Show this message and exit.

[x] discuss copying of the sources, how to make it better
[x] more tests
[ ] make sure branch_param_name is not used anywhere

The additional parameters are added based on what needs to be passed from packit service
Fixes #1409

TBD

from Copr logs, it looks like there could be a problem with hidden option in click version we use, will look into it

from Copr logs, it looks like there could be a problem with hidden option in click version we use, will look into it

if it's really problematic, we can leave it displayed and say that it's an internal option


[VS Code] Joining collaboration session: Unable to connect to Live Share cloud relay. Check your proxy, firewall and network settings and try again.

Error:
Joining collaboration session: Unable to connect to Live Share cloud relay. Check your proxy, firewall and network settings and try again.
Steps to Reproduce:

Version Data

extensionName
VSLS

extensionVersion
1.0.45

protocolVersion
2.2

applicationName
VSCode

applicationVersion
1.33.0

platformName
Windows

platformVersion
10.0.10240

Closing as dupe of 1935.


 The tabs sliding window position is incorrect if tab selected by JS code

What happened?
When the tab list exceeds the width of the container, the sliding window of the tabs does not move to the selected tab position if the tab's selected state is controlled by javascript.
In the reproduction demo code, the tabs are force to lock to tab1. However if you click the tab5, the tabs position will stay on tabs 5 but not moves back to the tab1.
The real case is if the page is refreshing and the tab that needs to be displayed is the 5th tab (in my application this is determined by angular's routing parameter). The user will not be aware of that the 5th tab is selected. Instead, they think that no tab is selected

What type of frontend frameware are you seeing the problem on?
Angular
Which version of iX do you use?
v2.0.4
Code to produce this issue.
https://stackblitz.com/edit/1tqmdv?file=src%2Fapp%2Ftabs.ts

Internal ref [IX-866]

+1 - Facing the same issue

Fixed via #1390


Log aggregation for QA

Sentry seems not to do well when we want to know what is happening
to a test device on a remote location. We can either completely overflow sentry
with events by trying to make it show the flow (this proven not to be useful), or it can give us just the exception providing minimal context of what happened.
A proper log aggregation service would be much better.
Example use case:

Devices are handed out to test users (let's sat 10 people) that agreed for us to log what's happening on the device
We gather all the activity in INFO mode
If an issue that we can't address, we restart the test in DEBUG mode

All the logs should end up on some cloud service so they can easily be searched and
filtered.
@avichalp
You have an idea in mind on what service this could be and what for an implementation
time it might take?

Sentry seems not to do well when we want to know what is happening to a test device on a remote location

Would it be possible to adapt sentry to provide this functionality?
Could we create a new log file that logs actions, we define actions as user driven events user_event.log:
eg:

[Sonos] changing volume
[SenicApp] setting phue station 1
etc..

Then when an exception is hit, we grab the user_event.log and we can see what the user was in the process or doing.
Just a thought, perhaps there are tools that do this more easily that can be implemented.

I have previously used services like loggly they used inbuilt python logging module to push all the relevant logs(they had option of pushing logs based on critical levels of logs) to their web services.

Great, tnx. Exactly something like this.
Will check it out a bit after the SD card flashing is concluded.

I think Sentry is not good for such a use case. It can be adapted by either paying more or using self hosted setup which would need more work.

Having a different log file and analyzing it later looks like a solution to me although we won't get real time monitoring of events.

Using specialized cloud based service (eg: loglgy, datadog, honeycomb.io, etc..) is an option but pricing will be a concern here (most of them are quite expensive).

Another option would be to use frameworks like elastic (ELK), stats.d, prometheus, reieman etc but again it needs work to set them up and test them.

IMHO: Having a event log file is best for short term (can help now) and choosing one of the frameworks and setting them up and using them is good for long term (but will take some time).

Thanks.
Will do a quick test on this to see loggy can serve for this before opting for hacking with Sentry.
https://github.com/getsenic/dev-board/issues/4

@baali will do a proof of concept with loggly implementation on which we'll decide if it works for us.

Hello all,
Update on this one, I am able to push log data from nuimo_app and
netwatch process to loggly. I am following their documentation for
sending logs via Python Logging Over HTTP/S. I have to install their
logging handler: sudo pip install loggly-python-handler and
following conf file:
[handlers]
keys=HTTPSHandler

[handler_HTTPSHandler]
class=loggly.handlers.HTTPSHandler
formatter=jsonFormat
args=('https://logs-01.loggly.com/inputs/TOKEN/tag/python','POST')

[formatters]
keys=jsonFormat

[loggers]
keys=root

[logger_root]
handlers=HTTPSHandler
level=INFO

[formatter_jsonFormat]
format={ "loggerName":"%(name)s", "asciTime":"%(asctime)s", "fileName":"%(filename)s", "logRecordCreationTime":"%(created)f", "functionName":"%(funcName)s", "levelNo":"%(levelno)s", "lineNo":"%(lineno)d", "time":"%(msecs)d", "levelName":"%(levelname)s", "message":"%(message)s"}
datefmt=

We have to specify TOKEN specific to our account. With this conf
file, I enable logs in our app, netwatch with following changes:
modified   senic_hub/backend/netwatch.py
@@ -24,6 +24,12 @@ if os.path.isfile('/etc/senic_hub.ini'):
     )

+import logging.config
+import loggly.handlers
+
+BASE_DIR = os.path.dirname(os.path.abspath(__file__))
+logging.config.fileConfig(os.path.join(BASE_DIR, 'logs.conf'))
+
 logger = logging.getLogger(__name__)

And with these changes, here are the sample logs I am able to see on
loggly:
{ "loggerName":"senic_hub.backend.netwatch", "asciTime":"2018-02-13 16:15:47,464", "fileName":"netwatch.py", "logRecordCreationTime":"1518538547.464150", "functionName":"_switch_to_normal_mode", "levelNo":"20", "lineNo":"114", "time":"464", "levelName":"INFO", "message":"Hub connected to the wifi"}

{ "loggerName":"senic_hub.nuimo_app.__main__", "asciTime":"2018-02-13 16:15:33,376", "fileName":"__main__.py", "logRecordCreationTime":"1518538533.376585", "functionName":"main", "levelNo":"20", "lineNo":"85", "time":"376", "levelName":"INFO", "message":"Waiting for /data/senic-hub/nuimo_app.cfg to be created"}

@TheMeaningfulEngineer, @kelada I can setup the same logging system on
one of Hub in our office and maybe that would help us make final
decision on same.

@baali Cool, this looks nice. :)
Checked the web interface also, I'm up for giving it a shot.
Not yet sure how to nicely integrate it into the OS to work with sentry, but
it's a good enough solution that can be hacked for the internal beta testers next.

This PR will enable logs to loggly service. One additional manual step would be needed, I had to edit value of TOKEN to our token in primary and secondary partitions in logs.conf. We can commit the token to repo too if we want to use it for our internal use and later revoke the token.


Improve clipboard compatibility for copyToClipboard function

Description: This PR addresses the issue where the copyToClipboard function was not working in some deployed environments due to browser or environment restrictions on the Clipboard API. The proposed changes provide a fallback method to ensure that the copy functionality works in most environments and browsers.
Changes:
Updated clipboard.ts:

Added try-catch for navigator.clipboard.writeText().
Implemented textarea fallback in catch block.

Testing:

Tested in multiple browsers and environments.

Notes:

No breaking changes.
Additional testing on various devices and browsers is recommended.

Thanks for this! Great catch.


Resolve absolute and relative file paths for t.navigateTo

Need to resolve absolute and relative file paths for navigateTo action.
Same as for a page directive.
See also https://github.com/DevExpress/testcafe-hammerhead/issues/1330

testcafe version: 0.18.0-alpha1

Should something be done, to stop this issue being closed/locked?

@rob4629, we will keep it opened.

According to the following help topic, the issue is fixed: https://testcafe.io/documentation/402695/reference/test-api/testcontroller/navigateto.


construct url-safe url when downloading file onto container

When downloading a file onto the container, we safe-encode the url before downloading the file, e.g. white spaces and other special chars will be encoded etc..
Also, to ensure backward compatibility (for pipelines using older pipeline-ai versions) and to encode any file_urls at the API entry level, we update the RunInput schema to recursively encode any file_url nested within. Note also we ensure that urls are not encoded multiple times.

Looks sensible to me. I have to admit, I don't fully understand the whole flow here but what you've done looks correct and like the fact that you've added tests to cover all the different permutations. I wasn't sure whether calling encode_url which has a pydantic decorator on it would work outside of pydantic validation but it obviously must do :)
Thanks for fixing this 👍

Yeah no worries 👍.  I wasn't sure either about calling the pydantic decorated method from outside either, but it worked. Considered moving the encoding logic to a utility function defined outside the pydantic model, but probably fine as is.


#533: Fix GETKEYS commands failure for wrong number of arguments

fixes #533
have added test case as well

@lucifercr07 - Fixed tests. Please check. cc - @JyotinderSingh

LGTM. Thanks


Add list of header files in file path

Device Shadow library's equivalent of https://github.com/FreeRTOS/coreMQTT/pull/84
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

Closing the PR as we decided to generate the header files list in the amazon-freertos repository programmatically using the SHADOW_INCLUDE_PUBLIC_DIRS list


Enhanced model understanding of return

I added the input key to the return of code execution so that the model can understand what code it has run instead of seeing an unknown return.

I just thought that it's a good idea to display the code in the quotation, I'll go try to implement it


Consider using string rather than String().

In working on a PR #130 I hit mysterious problems on a couple of occasions that I eventually traced back to String vs string.
Which of these one uses almost never matters.  Except when it does, then 'string' will win.
http://stackoverflow.com/questions/14727044/typescript-difference-between-string-and-string
For example, one of the issues I hit was from a type test in colors:
https://github.com/Marak/colors.js/blob/master/lib/extendStringPrototype.js#L79
When I send a String, the code throws.  I suppose the issue is in combination with some other setting special to testing, but there isn't really any advantage to String.

Thanks for raising this point.
IIRC, I had some type issues due to String prototype extension by color.js. Eventually, I kept String.
I will have a deeper look into it.


Fix issue that the viewerID sometimes is undefined

Description
With the latest conviva SDK version the viewerID sometimes was undefined. They changed when attributes should be updated.
Please also do a quick test
Fix
Change session initialization and contentMetadata updates.
Discussion
Please reply to my comments below.

@protyposis please have another look at the added Changelog.


Scale down based on idle workers, not number of scheduled jobs

Slack comment
My understanding of the current scale down policy is that scaling down on ScheduledJobsCount <= 0 means that even if all workers are 100% busy running jobs, that some may still get killed.
I'm thinking that makes more sense to tie scaling down to the # of idle agents (perhaps being above 0 for X number of minutes).

The AWS recommendation is to use the same metric for scaling up and down to avoid livelock situations, this seemed like a simple approach when paired with the lifecycle events which will prevent running agents getting killed. I did change the time frame for the scale down event to be much longer, I'll run some more tests and see how it responds. Let's get #59 sorted and see how this current policy works.

Well, I can't find any mention of aforementioned "AWS Recommendation", so I'm going to say I dreamed that.

The current scale down behaviour is killing instances way too early:

We changed to idle agents == 0 over last 6 minutes, repeating every 2:

Its probably still a bit aggressive scaling up, it would be nice if we could base both scale up and scale down on the percentage of busy agents

Have we fixed this @toolmantim?

Yeah, but we solved it by changed to UnfinishedJobs


Don't try to load job.args for started taks

If you try query doppler for a job status, while inside the actual
callback of that job, job.args will be None. This simply returns the
status as being started and prevents a crash.

👍


YARN-10499. TestRouterWebServiceREST fails (#2490). Contributed by Akira Ajisaka

JIRA: https://issues.apache.org/jira/browse/YARN-10499
In the test, the groupSet is empty and it.next() throws NoSuchElementException.
If the groupSet is empty, skip checking the set.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
1m 42s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s

No case conflicting files found.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:

0m  0s
test4tests
The patch appears to include 1 new or modified test files.

_ trunk Compile Tests _

+0 :ok:
mvndep
13m 31s

Maven dependency ordering for branch

+1 :green_heart:
mvninstall
24m  0s

trunk passed

+1 :green_heart:
compile
4m 10s

trunk passed with JDK Ubuntu-<IP_ADDRESS>+1-Ubuntu-0ubuntu1.18.04

+1 :green_heart:
compile
3m  1s

trunk passed with JDK Private Build-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01

+1 :green_heart:
checkstyle
1m  0s

trunk passed

+1 :green_heart:
mvnsite
1m 20s

trunk passed

+1 :green_heart:
shadedclient
20m 43s

branch has no errors when building and testing our client artifacts.

+1 :green_heart:
javadoc
1m 24s

trunk passed with JDK Ubuntu-<IP_ADDRESS>+1-Ubuntu-0ubuntu1.18.04

+1 :green_heart:
javadoc
1m 13s

trunk passed with JDK Private Build-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01

+0 :ok:
spotbugs
0m 50s

Used deprecated FindBugs config; considering switching to SpotBugs.

+1 :green_heart:
findbugs
2m 58s

trunk passed

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 27s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
1m 34s

the patch passed

+1 :green_heart:
compile
4m 33s

the patch passed with JDK Ubuntu-<IP_ADDRESS>+1-Ubuntu-0ubuntu1.18.04

+1 :green_heart:
javac
4m 33s

the patch passed

+1 :green_heart:
compile
3m 43s

the patch passed with JDK Private Build-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01

+1 :green_heart:
javac
3m 43s

the patch passed

+1 :green_heart:
checkstyle
1m  4s

the patch passed

+1 :green_heart:
mvnsite
1m 28s

the patch passed

+1 :green_heart:
whitespace
0m  0s

The patch has no whitespace issues.

+1 :green_heart:
shadedclient
20m 54s

patch has no errors when building and testing our client artifacts.

+1 :green_heart:
javadoc
1m 16s

the patch passed with JDK Ubuntu-<IP_ADDRESS>+1-Ubuntu-0ubuntu1.18.04

+1 :green_heart:
javadoc
1m 12s

the patch passed with JDK Private Build-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01

+1 :green_heart:
findbugs
3m 37s

the patch passed

_ Other Tests _

-1 :x:
unit
103m 56s
/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
hadoop-yarn-server-resourcemanager in the patch passed.

+1 :green_heart:
unit
3m  3s

hadoop-yarn-server-router in the patch passed.

+1 :green_heart:
asflicense
0m 40s

The patch does not generate ASF License warnings.

224m 22s

Reason
Tests

Failed junit tests
hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesApps

hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesReservation

Subsystem
Report/Notes

Docker
ClientAPI=1.40 ServerAPI=1.40 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2490/1/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/2490

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle

uname
Linux aca12670d3bd 4.15.0-112-generic #113-Ubuntu SMP Thu Jul 9 23:41:39 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / 08b2e285dbd

Default Java
Private Build-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-<IP_ADDRESS>+1-Ubuntu-0ubuntu1.18.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2490/1/testReport/

Max. process+thread count
898 (vs. ulimit of 5500)

modules
C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2490/1/console

versions
git=2.17.1 maven=3.6.0 findbugs=4.0.6

Powered by
Apache Yetus 0.13.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesApps
hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesReservation

These tests failed by OOM in the precommit job. I ran the tests successfully on my local environment:
[INFO] -------------------------------------------------------
[INFO]  T E S T S
[INFO] -------------------------------------------------------
[INFO] Running org.apache.hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesReservation
[INFO] Tests run: 160, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 820.439 s - in org.apache.hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesReservation
[INFO] Running org.apache.hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesApps
[INFO] Tests run: 40, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 31.061 s - in org.apache.hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesApps
[INFO]
[INFO] Results:
[INFO]
[INFO] Tests run: 200, Failures: 0, Errors: 0, Skipped: 0

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 34s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s

No case conflicting files found.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:

0m  0s
test4tests
The patch appears to include 1 new or modified test files.

_ trunk Compile Tests _

+0 :ok:
mvndep
13m 37s

Maven dependency ordering for branch

+1 :green_heart:
mvninstall
21m 49s

trunk passed

+1 :green_heart:
compile
3m 47s

trunk passed with JDK Ubuntu-<IP_ADDRESS>+1-Ubuntu-0ubuntu1.18.04

+1 :green_heart:
compile
2m 56s

trunk passed with JDK Private Build-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01

+1 :green_heart:
checkstyle
0m 59s

trunk passed

+1 :green_heart:
mvnsite
1m 32s

trunk passed

+1 :green_heart:
shadedclient
18m 18s

branch has no errors when building and testing our client artifacts.

+1 :green_heart:
javadoc
1m  9s

trunk passed with JDK Ubuntu-<IP_ADDRESS>+1-Ubuntu-0ubuntu1.18.04

+1 :green_heart:
javadoc
1m  0s

trunk passed with JDK Private Build-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01

+0 :ok:
spotbugs
0m 44s

Used deprecated FindBugs config; considering switching to SpotBugs.

+1 :green_heart:
findbugs
2m 34s

trunk passed

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 27s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
1m 15s

the patch passed

+1 :green_heart:
compile
3m 23s

the patch passed with JDK Ubuntu-<IP_ADDRESS>+1-Ubuntu-0ubuntu1.18.04

+1 :green_heart:
javac
3m 23s

the patch passed

+1 :green_heart:
compile
2m 45s

the patch passed with JDK Private Build-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01

+1 :green_heart:
javac
2m 45s

the patch passed

+1 :green_heart:
checkstyle
0m 51s

the patch passed

+1 :green_heart:
mvnsite
1m 13s

the patch passed

+1 :green_heart:
whitespace
0m  0s

The patch has no whitespace issues.

+1 :green_heart:
shadedclient
15m  3s

patch has no errors when building and testing our client artifacts.

+1 :green_heart:
javadoc
1m  0s

the patch passed with JDK Ubuntu-<IP_ADDRESS>+1-Ubuntu-0ubuntu1.18.04

+1 :green_heart:
javadoc
0m 59s

the patch passed with JDK Private Build-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01

+1 :green_heart:
findbugs
2m 39s

the patch passed

_ Other Tests _

+1 :green_heart:
unit
89m 30s

hadoop-yarn-server-resourcemanager in the patch passed.

+1 :green_heart:
unit
2m 40s

hadoop-yarn-server-router in the patch passed.

+1 :green_heart:
asflicense
0m 33s

The patch does not generate ASF License warnings.

191m 36s

Subsystem
Report/Notes

Docker
ClientAPI=1.40 ServerAPI=1.40 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2490/2/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/2490

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle

uname
Linux ac8de38a9019 4.15.0-112-generic #113-Ubuntu SMP Thu Jul 9 23:41:39 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / 6a1d7d9ed25

Default Java
Private Build-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-<IP_ADDRESS>+1-Ubuntu-0ubuntu1.18.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_275-8u275-b01-0ubuntu1~18.04-b01

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2490/2/testReport/

Max. process+thread count
930 (vs. ulimit of 5500)

modules
C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2490/2/console

versions
git=2.17.1 maven=3.6.0 findbugs=4.0.6

Powered by
Apache Yetus 0.13.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

@pbacsko Would you review this?

@szilard-nemeth or @pbacsko could you take a look at this, and merge if possible, the change is really small, but it fixes a possible NPE in the new placement engine.

Thank you @szilard-nemeth


The instruction of using DynamixelWizard2 to update firmware in Readme will cause firmware update failure.

System Info
lerobot's low cost hardware configuration: Waveshare Serial Bus Servo Driver Board will brick the servo when update the firmware of servo

Information

[X] One of the scripts in the examples/ folder of LeRobot
[ ] My own task or dataset (give details below)

Reproduction
https://forum.robotis.com/t/firmware-transfer-failed-on-new-motor/5819
Expected behavior
The readme (https://github.com/huggingface/lerobot/blob/main/examples/7_get_started_with_real_robot.md)
should not suggest updating firmware in https://github.com/jess-moss/koch-v1-1, the servo board will brick the servo.

same happens here. updating the xl430-w250's firmwares caused that i cant see it anymore.
any solution with buying the U2D2?

i fix it by using Linux version wizard2.0.
On Mon, Sep 30, 2024 at 2:45 PM Sergio Esteban @.***>
wrote:

same happens here. updating the xl430-w250's firmwares caused that i cant
see it anymore.
any solution with buying the U2D2?
—
Reply to this email directly, view it on GitHub
https://github.com/huggingface/lerobot/issues/456#issuecomment-2384019526,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AABJ6PEJCBWXXSIY62HLS3TZZGS6XAVCNFSM6AAAAABPCLE33KVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGOBUGAYTSNJSGY
.
You are receiving this because you authored the thread.Message ID:
@.***>

i fix it by using Linux version wizard2.0.
…
On Mon, Sep 30, 2024 at 2:45 PM Sergio Esteban @.> wrote: same happens here. updating the xl430-w250's firmwares caused that i cant see it anymore. any solution with buying the U2D2? — Reply to this email directly, view it on GitHub <#456 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AABJ6PEJCBWXXSIY62HLS3TZZGS6XAVCNFSM6AAAAABPCLE33KVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGOBUGAYTSNJSGY . You are receiving this because you authored the thread.Message ID: @.>

I just tried and i cant read them either. can i ask u if u did a special config? connected straight to the servo? or anything else?
thanks in advance

@sergesteban I fixed it by using by the U2D2 and doing a firmware recovery with the wizard.


Update request: pandoc 2.19.2 → 3.1.1

Package name: pandoc
Latest released version: 3.1.1

Current version on the unstable channel: 2.19.2
Current version on the stable/release channel: <IP_ADDRESS>

[x ] Checked the nixpkgs pull requests

Notify maintainers
@peti

Note for maintainers: Please tag this issue in your PR.

I would like to preface with "I have no idea what I was doing" but I was able to get it to compile with these changes from master https://github.com/seam345/nixpkgs/commit/89e6e477c8357a087e863db562d2fa8d9fe5ba29
$ nix-shell -p haskellPackages.pandoc-cli -I nixpkgs=https://github.com/seam345/nixpkgs/archive/89e6e477c8357a087e863db562d2fa8d9fe5ba29.tar.gz
$ pandoc --version
pandoc 3.1
Features: +server +lua
Scripting engine: Lua 5.4
User data directory: /home/sean/.local/share/pandoc
Copyright (C) 2006-2023 John MacFarlane. Web:  https://pandoc.org
This is free software; see the source for copying conditions. There is no
warranty, not even for merchantability or fitness for a particular purpose.

This may be helpful to the person who actually understands how all the Haskell things work todo it properly, or if someone just wants to grab it from my branch for now :)

The trouble with https://github.com/seam345/nixpkgs/commit/89e6e477c8357a087e863db562d2fa8d9fe5ba29 is that pkgs/development/haskell-modules/hackage-packages.nix is routinely auto-regenerated, so changes made there by hand will be quickly lost.  pkgs/development/haskell-modules/HACKING.md describes the auto-regeneration process.
The auto-generation pulls version information from stackage.  Pandoc versions in stackage:

Resolver
GHC version
Pandoc version

lts-19.33
9.0.2
<IP_ADDRESS>

lts-20.11
9.2.5
2.19.2

lts-20.12
9.2.6
2.19.2

lts-20.16
9.2.7
2.19.2

nightly-2023-04-02
9.4.4
3.0.1

When i try various ways of following the HACKING.md process, I get these failures:

Method
Target
Failure in
Error message

HEAD
haskellPackages.pandoc_3_1_1
pandoc-3.1.1
Setup: Encountered missing or private dependencies: doctemplates >=0.11 && <0.12, gridtables >=0.1 && <0.2, jira-wiki-markup >=1.5 && <1.6, mime-types >=0.1.1 && <0.2, pandoc-types >=1.23 && <1.24, texmath >=0.12.6 && <0.13

HEAD
haskell.packages.ghc944.pandoc_3_1_1
string-qq-0.0.4
Error: Setup: Encountered missing or private dependencies: text >=1.2 && <1.3

resolver: LTS
haskellPackages.pandoc_3_1_2
pandoc-3.1.2
Setup: Encountered missing or private dependencies: doctemplates >=0.11 && <0.12, gridtables >=0.1 && <0.2, jira-wiki-markup >=1.5.1 && <1.6, mime-types >=0.1.1 && <0.2, pandoc-types >=1.23 && <1.24, texmath >=0.12.7 && <0.13

resolver: LTS
haskell.packages.ghc944.pandoc_3_1_2
evaluation
error: attribute 'lens_5_2_1' missing

resolver: LTS + lens reference fix
haskell.packages.ghc944.pandoc_3_1_2
string-qq
Error: Setup: Encountered missing or private dependencies: text >=1.2 && <1.3

resolver: LTS + drop restrictions in update-stackage.sh
pandoc
pandoc-3.1.2
Setup: Encountered missing or private dependencies: doctemplates >=0.11 && <0.12, gridtables >=0.1 && <0.2, jira-wiki-markup >=1.5.1 && <1.6, mime-types >=0.1.1 && <0.2, pandoc-types >=1.23 && <1.24, texmath >=0.12.7 && <0.13

resolver: LTS + drop restrictions in update-stackage.sh
haskell.packages.ghc944.pandoc
evaluation
error: attribute 'lens_5_2_1' missing

resolver: LTS + drop restrictions in update-stackage.sh + lens reference fix
haskell.packages.ghc944.pandoc
string-qq
Error: Setup: Encountered missing or private dependencies: text >=1.2 && <1.3

resolver: Nightly
pandoc
evaluation
error: infinite recursion encountered

resolver: Nightly
haskellPackages.pandoc_3_1_2
evaluation
error: infinite recursion encountered

resolver: Nightly
haskell.packages.ghc944.pandoc
evaluation
error: attribute 'aeson_2_1_2_1' missing

resolver: Nightly
haskell.packages.ghc944.pandoc_3_1_2
evaluation
error: attribute 'aeson_2_1_2_1' missing

I don't know where to go from here.

History: 2022 Nov: Latest pandoc [2.19.2] does not build
Trying another tack:

Method
Target
Failure in
Error message

HEAD
haskellPackages.pandoc_3_1_1
pandoc-3.1.1
Setup: Encountered missing or private dependencies: doctemplates >=0.11 && <0.12, gridtables >=0.1 && <0.2, jira-wiki-markup >=1.5 && <1.6, mime-types >=0.1.1 && <0.2, pandoc-types >=1.23 && <1.24, texmath >=0.12.6 && <0.13

HEAD
haskell.packages.ghc944.pandoc_3_1_1
string-qq-0.0.4
Error: Setup: Encountered missing or private dependencies: text >=1.2 && <1.3

HEAD + doJailBreak
haskellPackages.pandoc_3_1_1
pandoc-3.1.1
src/Text/Pandoc/Shared.hs:850:17: error: Not in scope: data constructor ‘Figure’

HEAD + doJailBreaks
haskell.packages.ghc944.pandoc_3_1_1
pandoc-3.1.1
src/Text/Pandoc/Shared.hs:850:17: error: Not in scope: data constructor ‘Figure’

HEAD + doJailBreak + pandoc-types_1_23
haskellPackages.pandoc_3_1_1
pandoc-3.1.1
src/Text/Pandoc/Parsing/GridTable.hs:141:16: error: Not in scope: ‘GT.arrayTableFoot’ NB: the module ‘Text.GridTable’ does not export ‘arrayTableFoot’.  Suggested fix: Perhaps use ‘GT.arrayTableHead’ (imported from Text.GridTable)

HEAD + doJailBreaks + pandoc-types_1_23
haskell.packages.ghc944.pandoc_3_1_1
pandoc-3.1.1
src/Text/Pandoc/Parsing/GridTable.hs:141:16: error: Not in scope: ‘GT.arrayTableFoot’ NB: the module ‘Text.GridTable’ does not export ‘arrayTableFoot’.  Suggested fix: Perhaps use ‘GT.arrayTableHead’ (imported from Text.GridTable)

HEAD + doJailBreak + pandoc-types_1_23 + gridtables_0_1_0_0
haskellPackages.pandoc_3_1_1
pandoc-3.1.1
/nix/store/...-binutils-2.40/bin/ranlib: unable to copy file 'dist/build/libHSpandoc-3.1.1-3qgYOMb5A4LEp1wMeZkvJA-ghc9.2.7.a'; reason: Success

HEAD + doJailBreaks + pandoc-types_1_23 + gridtables_0_1_0_0
haskell.packages.ghc944.pandoc_3_1_1
pandoc-3.1.1
/nix/store/...-binutils-2.40/bin/ranlib: unable to copy file 'dist/build/libHSpandoc-3.1.1-3qgYOMb5A4LEp1wMeZkvJA-ghc9.2.7.a'; reason: Success

So this way seems to get much closer, but still doesn't quite get there.

Now it's pandoc 3.1.2 with typst support added :)

I'm completely puzzled by string-qq-0.0.4 and Error: Setup: Encountered missing or private dependencies: text >=1.2 && <1.3. string-qq doesn't even seem to depend on text.

Pandoc's Jgm has updated the flake in repo's root, would that be of any help?
https://github.com/jgm/pandoc/issues/8818

Hi, if like myself you don't want to wait for Pandoc to get updated, this solution works:
https://github.com/camillemndn/nixos-config/blob/main/pkgs/development/tools/pandoc/default.nix

#240387 will contain the update for nixpkgs.


Semantic Kernel reference can be added to custom  rag pattern

[Enter feedback here]
https://learn.microsoft.com/en-us/azure/search/retrieval-augmented-generation-overview#custom-rag-pattern-for-azure-ai-search
The Custom RAG pattern for azure ai search has reference to the Langchain whereas the Semantic kernel is also a potential alternative approach which is missing from the page. I would recommend including that as well.

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: 192b3fff-23d5-0056-5f93-1e3c67924eb1
Version Independent ID: db47048f-fbb1-0eac-8d9a-3f9e6ed342b9
Content: RAG and generative AI - Azure AI Search
Content Source: articles/search/retrieval-augmented-generation-overview.md
Service: cognitive-search
GitHub Login: @HeidiSteen
Microsoft Alias: heidist

@vj-msft
Thanks for your feedback! We will investigate and update as appropriate.

@vj-msft, I added a link to a blog post about SK and search integration.  I believe PMs are developing some additional content. I'll add more references and narrative once we have that in place.
#please-close


added some file extensions

added some file extensions for videos and sorted the list

sorted the list

That should be a separate follow-up PR.

Many of the extensions are incorrect, so I must ask you to go through the list again, and also provide a source for each added extension as proof.


Add miniconda2 for python 2.x

Adds miniconda2 by Continuum Analytics.
This differs from @drzax's miniconda in that it is for python 3.x. miniconda2 is for python 2.x.
Follows the same versioning logic as
If there’s a checkbox you can’t complete for any reason, that's okay, just explain in detail why you weren’t able to do so.
After making all changes to the cask:

[x] brew cask audit --download {{cask_file}} is error-free.
[x] brew cask style --fix {{cask_file}} reports no offenses.
[x] The commit message includes the cask’s name and version.

Additionally, if adding a new cask:

[x] Named the cask according to the token reference.
[x] brew cask install {{cask_file}} worked successfully.
[x] brew cask uninstall {{cask_file}} worked successfully.
[x] Checked there are no open pull requests for the same cask.
[x] Checked the cask was not already refused in closed issues.
[x] Checked the cask is submitted to the correct repo.

Thank you for your contribution.


Create re-arrangeable controls?

For: Allow interfaces to be rearranged
Change: I'm pretty sure some other godot add-ons may already have this. Steal* these if possible.
* Ensure MIT License compatibility :)

https://github.com/PhoenixStroh/transform-container

https://github.com/don-tnowe/godot-extra-controls

No new controls are needed -- native Godot UI supports what is needed. Example scene was added to illustrate this. README updated to refer to additional add-ons that may provide controls that simplify this process.


[move-only] Add copyable_to_moveonlywrapper and moveonlywrapper_to_copyable instructions.

These instructions have the following attributes:

copyably_to_moveonlywrapper takes in a 'T' and maps it to a '@moveOnly
T'. This is semantically used when initializing a new moveOnly binding from a
copyable value. It semantically destroys its input @owned value and returns a
brand new independent @owned @moveOnly value. It also is used to convert a
trivial copyable value with type 'Trivial' into an owned non-trivial value of
type '@moveOnly Trivial'. If one thinks of '@moveOnly' as a monad, this is how
one injects a copyable value into the move only space.

moveonlywrapper_to_copyable takes in a '@moveOnly T' and produces a new 'T'
value. This is a 'forwarding' instruction where at parse time, we only allow for
one to choose it to be [owned] or [guaranteed].

moveonlywrapper_to_copyable [owned] is used to signal the end of lifetime of
the '@moveOnly' wrapper. SILGen inserts these when ever a move only value has
its ownership passed to a situation where a copyable value is needed. Since it
is consuming, we know that the no implicit copy checker will ensure that if we
need a copy for it, the program will emit a diagnostic.

moveonlywrapper_to_copyable [guaranteed] is used to pass a @moveOnly T value
as a copyable guaranteed parameter with type 'T' to a function. In the case of
using no-implicit-copy checking this is always fine since no-implicit-copy is a
local pattern. This would be an error when performing no escape
checking. Importantly, this instruction also is where in the case of an
@moveOnly trivial type, we convert from the non-trivial representation to the
trivial representation.

Some important notes:

In a forthcoming commit, I am going to rebase the no implicit copy checker on
top of these instructions. By using '@moveOnly' in the type system, we can
ensure that later in the SIL pipeline, we can have optimizations easily ignore
the code.

Be aware of is that due to SILGen only emitting '@moveOnly T' along immediate
accesses to the variable and always converts to a copyable representation when
calling other code, we can simply eliminate from the IR all moveonly-ness from
the IR using a lowering pass (that I am going to upstream). In the evil scheme
we are accomplishing here, we perform lowering of trivial values right after
ownership lowering and before diagnostics to simplify the pipeline.

On another note, I also fixed a few things in SILParsing around getASTType() vs
getRawASTType().

Replace this paragraph with a description of your changes and rationale. Provide links to external references/discussions if appropriate.

Resolves SR-NNNN.

@swift-ci test

@swift-ci test

@swift-ci test

I talked with JoeG. We are going to do post-commit review on this since it is just scaffolding infrastructure (the big PR is coming next).


Support name changes in middleware

This would allow us to remove the special logic around the API service cert updating controller.

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
Describe the solution you'd like
A clear and concise description of what you want to happen.
Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.
Are you considering submitting a PR for this feature?

How will this project improvement be tested?
How does this change the current architecture?
How will this change be backwards compatible?
How will this feature be documented?

Additional context
Add any other context or screenshots about the feature request here.

I think this is already done -- is there any additional work left?


Reduce counts of batch-testing specs (except in CI)

Have started working on some changes to counter culture. It's frustrating to have a test run with such long pauses. I'm not 100% sure why such large numbers are needed, but I think the large numbers could only happen in CI where the long pause won't be noticed.
total test run before PR: ~ 30s
total test run after PR: ~ 5s

Yeah; the idea is to test that the batch processing works correctly. Probably doesn't need these big numbers at all but this looks like a good idea. Thank you.


Rails 5.1 support

Is Rails 5.1 still supported with the latest release of this gem (1.2.6)? The current gemspec file specifies rails 5.2.

Yeah probably it should still be supported.


https support

Good Morning,
Now that I got this up and running with the correct python version, it seems the library does not support https for registration urls.  See this line here as an example:
https://github.com/SolarEdgeTech/pyctuator/blob/2536697fab1da3c77f2903f302d02909929903c2/pyctuator/impl/spring_boot_admin_registration.py#L70
Is there a way we can detect https vs http, or port 443 as an example, to change to use the HTTPSConnection connection?
Thanks!
Peter

Hi Peter,
That's a good question...
Will look into this.
Thanks
Michael

Thank you happy to help where possible, it might make more sense to shift and use the requests library, not sure if there is a reason for using the lower level httpconnection over that?  I think it could handle both quite easily.

You are right that using requests would be much easier, however our goal and requirement was to avoid using any library that's not really really really required.
I'm sure we'll find reasonable solution without requests - i'll probably get to dive into this later this week, however if you have a reasonable workaround that doesn't require adding a dependency, please issue a PR.
Thanks again,
Michael

Fixed in v0.13.2


Push changes to Staging In Preparation for Final Submission

Description

Let's move to push changes from the Dev branches to staging for actual testing in preparation of the final submission.
Additional information

N/A

CI is failing as there is an invalid file name with : in it.


DIM-Integration into MXD

Reverse engineer IATP integration to learn and map to MIW
TODO:
upload bug report

@hemantxpatel encountered a failure while integrating the DIM with EDC 0.7.0 and we forwarded the attached report to the DIM team.
DIM Wallet Integration.docx

Response from the DIM team:
Hi Alex,
Short update regarding point 10 from the feedback you shared.
Indepenendent of the timezone that has been specified at creation time (for both issuanceDate and expirationDate), the issued VC will always present these 2 dates with UTC time. And this will be available with our next release.
Kind regards,
Stefan

MIW team has provided a fix for content type issue.

Hi,
We’ve released a new development version of the MIW which fixes the accepted content-type. Please re-test using it and let us know if all goes as planned. Thanks!

SAP DIM integration changes are present in sts-dim-int-v2 branch.


Add Ewald and PME tutorial

Description
A tutorial detailing the derivation of classical electrostatics and Ewald summation.
What are your new additions? Please provide a brief list.

New Features

[x] Ewald and PME tutorial, with complete derivation.

Any questions for the community?

[ ] Where does this belong in the folder structure, and which .md files need to reference it?
[ ] Does this even belong in this notebook collection? It's far more derivation-heavy than the contribution guidelines request, so feel free to reject this PR.

Status

[ ] Click when ready for review-and-merge

Codecov Report

Merging #35 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master      #35   +/-   ##
=======================================
  Coverage   94.69%   94.69%
=======================================
  Files          35       35
  Lines        4185     4185
=======================================
  Hits         3963     3963
  Misses        222      222

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 6747b7e...ab54ba5. Read the comment docs.

Looks like a great notebook to me. Thanks, @andysim.
When I run it, get this. Ring any bells?
Traceback (most recent call last):
  File "/tmp/tmpm1ryen23/12a_ewald.py", line 644, in <module>
    Uvals = np.array([efunc(*p) for p in params])
  File "/tmp/tmpm1ryen23/12a_ewald.py", line 644, in <listcomp>
    Uvals = np.array([efunc(*p) for p in params])
  File "/tmp/tmpm1ryen23/12a_ewald.py", line 637, in PME_energy
    Urec = PME_rec_energy(alpha, maxm, splineorder)
  File "/tmp/tmpm1ryen23/12a_ewald.py", line 580, in PME_rec_energy
    gridstart[atom,:] = map(int, mdim*coord-1e-8)
TypeError: int() argument must be a string, a bytes-like object or a number, not 'map'

Oops, my jupyter setup is configured for 2.7.  Let me run it in 3 and push a fix.  Thanks for the heads-up.

np, we test in 2.7 and a 3.6 just to catch stuff like this. I'll PR to your PR with the testing set up after your fix. thanks.

Super awesome, thanks Any!

Should be fixed now.  I had a rogue miniconda2 that sneaked into my environment somehow.  Didn't know before, but map(int, [0.1, 0.2]) returns a map object in py3, not a list of ints.

Python3: Anything that can return an iterator will. Try list( map(int, [0.1, 0.2])).

Thanks for the info; your suggestion is what I did in the last commit.  Seems to be working now.

Thanks for the testing setup, @loriab; I just saw the guidelines in contributing.md that I somehow overlooked before.  Absolute values are a little tricky to test in this case, because the random number generator is used to build coordinates.  I can do value comparisons of the energies of different alpha values at the end, however.

This definitely belongs here -- the point of including derivations within tutorial notebooks is to bring the reader up-to-speed enough with the underlying theory to grasp the intricacies of the code, which I think this tutorial does very nicely.
I dunno about anyone else, but I think this should be in its own subdirectory within the Tutorials/ folder, like 12_Classical-Mechanics and perhaps even a subdirectory within that, if we ever add more MD/MC/etc. tutorials.    Thoughts, @dgasmith & @loriab?
In any event, the main Tutorials/README.md could use an update...I'll work on that now.

np, that was a fairly recent addition. Basically, any test you can add that provides moderate assurance that upon software update the notebook is generating steady values and not jibberish will be helpful.
Go ahead and add @using_scipy here (in addition to @using_matplotlib). And please add scipy to this line as I think it's more important to test all contributions for py27 than to catch test that need scipy.

I think that a more general subdirectory is a great idea, @dsirianni.  I have another tutorial that needs a lot of polishing, but introduces some basics like Verlet integration (already covered elsewhere in psi4numpy) and cutoff methods to conserve energy.  Perhaps if I clean that up, and move it to 12a, with Ewald being 12b, subdirectory 12 can serve as a basic intro to MD for us QM folks?

@dsirianni, this is in its own dir w/i the Tutorials/ folder? I'm not keen on further subfoldering – would need to adjust the tests structure. In fact, in the absence of some nice Dewey Decimal System for quantum chemistry, I was wondering if we wanted to (aside from chapter 0. Intro) just register all notebooks by number in order or receipt so they had a firm identity outside of folder organization.

@andysim Can you use np.random.seed(0)?
I wouldn't mind a QM_Tutorials/MD_Tutorials folder?

To be clear, I'm perfectly happy with ~Tutorials/12_MD/[058|12a|12b]ewald.ipynb. I'd just rather not see Tutorials/12_MD/ClassicalElst/Ewald.ipynb, at least not unless p4n swells by an order of magnitude. (Speaking as one who lost a tutorial for a while in the existing dir structure.)

I had to look, but it seems p4n doesn't regularly do ValidationErrors. Probably plain print and sys.exit(1) instead.

I think everything is ready, any remaining issues?

Thanks Andy! This is really awesome stuff. Lets get this in now and I might have a few more comments during a cleanup pass in a bit.


[TH2-4231] Update dependencies with vulnerabilities

Hello, need to update minor version (due kotlin update, i think so at last) of codec-open-api. Add please description to readme change log and version in head of file too


[5.4] Queues listen class timeout

Laravel Version: 5.4.22
PHP Version: 7.0.13

Description:
When variable public $timeout = 5; is placed in the job class, then running the queue:work or queue:listen and processing the job with timeout variable doesn't affect the job. If timeout is set as option (queue:listen database --timeout=5) it affects the job and timeout. Basically, ignore timeout variable in the job class.
Steps To Reproduce:

php artisan make:job NameJob
add public $timeout = 5; variable to created job class
php artisan queue:listen database

When the job is to begin processing, it does not timeout as it should be.
Looking at the code, it doesn't read that variable anywhere.

As far as I know, the public $timeout property works only in PHP 7.1+ with Process Control extension(pcntl) and for queue:work command(not queue:listen).

That is correct, timeouts in Laravel 5.4 are based on async signals introduced in PHP 7.1. The check is done in Worker::supportsAsyncSignals and the handling of timeouts in Worker::registerTimeoutHandler.

I've upgraded PHP Version => 7.1.5 and the result is the same. It should timeout in 5 seconds, but instead, it continues to work when it reach 60 seconds timeout.

First guess would be that Windows does not support pcntl. Laravel checks for support for pcntl in Worker::supportsAsyncSignals, can you tell us what extension_loaded('pcntl') returns?

You are right. Windows is not supported

Note:
Currently, this module will not function on non-Unix platforms (Windows).

I guess I should keep in mind that on local development (windows) it won't work, but it will be fine on Linux host. Anyway extension_loaded('pcntl') return false.


added friend Pavel

Your pull request seems good, but must be checked by a human maintainer for the following reason(s):

This contains potentially hazardous tags that need manual review.

Please be patient until a maintainer has time to look over your contribution.
This is an automated response, beep boop.
if you think there is a mistake, contact a maintainer

f3fc44c0fe32698e516670adafa98c4a14776f41

hex colour values are a dangerous animal, it can make things look too good :D

LGTM


[Editor] Create a simplified view

In earlier version of Midden, the number of fields displayed/required was related to the data zone the metadata is for. Now that Midden allows custom data zones, it's difficult to assign required fields (unless this is customizable in the app-config.json file, but that would be a beast to deal with). Now all metadata fields are displayed at all times. This is overwhelming and goes against one of the tenants of Midden (which is basically, get some metadata, with low barrier, even if it's just a one sentence description).
As a (temporary?) fix, implement a "complex view" toggle that shows all fields. The default view just shows name, zone, project, description, contact, variables (which only includes name, description, units).

@riemino suggested we implement tabs for groups of information; a tab for temporal metadata, spatial metadata, methods, etc. This shouldn't require any additional logic as it can just be grouped under tab tags (see: https://antblazor.com/en-US/components/tabs).
Similarly, we could use collapsible areas: https://antblazor.com/en-US/components/collapse
Or, hide areas entirely until the user clicks a button to show the area. e.g. "Add temporal metadata".


release: update v2.7.2 release notes

add backported bugfixes
add backported fix for CVE-2021-3966

fixed typo
removed last remaining [Backport..] prefix

ordered closed issues numerically


Broken scaling of vkdt on wayland / high dpi / KDE

Since the move to the  Nuklear GUI framework, the scaling of the interface is off (the screen is set to 200% scaling, but the interface looks in part at 400%, while still being blurry)

The build is vkdt-rawler-glfw3.4-0.8.99-106-gb47c911d-x86_64.AppImage
KDE Plasma 6.0.5 on Wayland

heya, thanks for reporting. this is going to be hard for me to reproduce, because nvidia on wayland does not even run vulkaninfo.
are you sure vkdt is running with wayland on your system? can you  start it from a shell with vkdt -d all to see which extensions glfw actually loads?
i never understood the logic of this 200% scaling thing. vkdt scales its own gui in proportion to window height, this 2x scaling seems very legacy to me. i suppose this is a matter of carefully replacing glfwGetWindowSize by glfwGetFramebufferSize, context: https://stackoverflow.com/questions/44719635/what-is-the-difference-between-glfwgetwindowsize-and-glfwgetframebuffersize

.. just for adventurous people who have laptops with mixed intel + nvidia, running this in foot/weston seems to work and at least start something vulkan:
XDG_SESSION_TYPE=wayland VK_DRIVER_FILES=/usr/share/vulkan/icd.d/intel_icd.x86_64.json vkdt

of course only using the intel GPU. while slightly painful, i think i don't see any more scaling/dpi issues on a 4k laptop with intel/wayland. let me know if that fixed it for you too.

I unfortunately have only nVidia on this computer, no intel. This is what  vkdt -d all returns
[gui] vkdt 0.8.99-106-gb47c911d (c) 2020--2024 johannes hanika
[gui] glfwGetVersionString() : 3.4.0 Wayland X11 GLX Null EGL OSMesa monotonic
[gui] monitor [0] DP-4 at 0 0
[gui] vk extension required by GLFW:
[gui]   VK_KHR_surface
[gui]   VK_KHR_wayland_surface
[gui] no joysticks found
[gui] no display profile file display.DP-4, using sRGB!

The 200% refers to the scaling settings of the window manager and are per-monitor, AFAIK it comes originally from Apple's method of implementing high DPI support which involved doubling the resolution of the displays and then introducing logical pixels which correspond to 4 device pixels. Will have a look at the GLFW code

is the scaling still off for you after https://github.com/hanatos/vkdt/commit/f8abd5a9c6ef70d3209d2035804f8d6bd3983e40 ?

i encountered something similar on a macintosh computer when trying this out. 22b2a46f fixed it there, i wonder if the issue here was the same?

I tried the new appimage now (0.9), the interface is sharp but very large, and the mouse is mapped at 2x the distance.

works here with weston / intel. do you know what is your content scale factor? probably some user setting in some kde dialog?

Standard 200%, no fractional scaling, KDE 6.1

vkdt prints
[gui] vkdt 0.9.99-1-g84e48df8 (c) 2020--2024 johannes hanika
[gui] glfwGetVersionString() : 3.4.0 Wayland X11 GLX Null EGL OSMesa monotonic shared
[gui] monitor [0] DP-4 at 0 0
[gui] vk extension required by GLFW:
[gui]   VK_KHR_surface
[gui]   VK_KHR_wayland_surface
[gui] no joysticks found
[gui] no display profile file display.DP-4, using sRGB!
[ERR] module o-bc1 main connector input has uninited size!
[ERR] module display main connector input has uninited size!
...

okay thanks.. i suppose i will have to find a machine where i can install wayland/kde to see what's going on. there seem to be quite a few possible combinations of scaling and scaling of input event coordinates.. tested the same scaling factor on a 4k display and here it worked.

Can you give me a pointer where to look in the code? I can compile vkdt, so am happy to try things out myself. Another hint might be is that when vkdt starts, the window is twice big as the screen

great! okay so here is the deal: glfw knows window size and framebuffer size. for legacy reasons, the window size and framebuffer size may differ by some factor, this content scale factor. what i've seen on macos is that the window size is like half of the framebuffer size and the content scale factors are (2,2) (x and y).
this stuff is inited for a glfw window around here: https://github.com/hanatos/vkdt/blob/master/src/gui/gui.c#L54
which is where i would start digging by printing out the results of glfwGetFramebufferSize glfwGetWindowSize and glfwGetWindowContentScaleFactor. see https://www.glfw.org/docs/latest/window_guide.html for context.
on x11 window and framebuffer are all the same, as it happens to be on my wayland too, regardless of content scale factor, which is 200% on my wayland too.
to make things worse/more interesting, on macos window is half framebuffer size but mouse events are reported on window scale and vkdt expects them on framebuffer/highres scale. this is why you'll find a lot of #ifdef __APPLE__ such as this occasion https://github.com/hanatos/vkdt/blob/master/src/gui/main.c#L160 to scale the mouse coordinates appropriately.

Thanks for 0ee0cb3, now hovering and clicking works at the expected location.
However, sliders (for e.g. adjusting exposure) are extremely sensitive and almost impossible to use, the bar accelerates immediately in the direction of movement.

progress. i can confirm your findings (using some wacky weston --scale=2 that happens to not crash on me today).

https://gitlab.gnome.org/GNOME/mutter/-/issues/3696 for the record i think this is the same issue. probably have to code some crazy stuff around it.

The latest commit indeed fixes the issue for me, thank you! The only remaining thing is the oversized window at program start, but it's quite minor

unfortunately the scaling logic is still broken. on hyprland, this crazy dance is not required, so i'm assuming something in the KDE stack might have been too old to work correctly (something fractional scaling?).
i just pushed a commit that removes the input coordinate scaling on wayland so i can work on hyprland. is this working on KDE now too?

Version 0.9.1 works on KDE with wayland, at least in terms of the mouse position and I think the sliders are OK. Version 0.9.0 does not. I take it that 0.9.1 includes the change? (I'm using nixpkgs builds.)

okay thanks for confirming, so it seems the release is fine. there is one more scaling fix in the queue, but this is only relevant for xwayland/older glfw (which i don't think is an issue for nix). i should probably release more often if people really use the releases...

If you're not in a rush, I can draft PR a github release pipeline?

oh, thanks for the offer! that sounds great! i'm in no rush at all. there
are github workflows for nightly packages, but they pull from master and
not the release-XX branch.
On Mon, Dec 9, 2024 at 11:51 AM David Baynard @.***>
wrote:

If you're not in a rush, I can draft PR a github release pipeline?
—
Reply to this email directly, view it on GitHub
https://github.com/hanatos/vkdt/issues/137#issuecomment-2527576459, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AAMAKKJT6SZXI3XL2EVUTZD2EVY2LAVCNFSM6AAAAABNLHWI3CVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDKMRXGU3TMNBVHE
.
You are receiving this because you commented.Message ID:
@.***>


fix: push new view on reset

closes #618

I bonked my main branch somehow, will try to fix later.


Update function support page for 0.9.0-alpha2

Remember, the function support page is a stand-along file. If you want to see how it renders, you can just download it and take a look.

@ronkok thanks for updating this.  I like how you have "direct input" sections for each of the existing groups.


Support for changes to Swift 2.0 in Xcode 7 beta 4.

Specifically, Swift 2.0 now supports nested recursive functions.

Thanks!


Break out a shared library for terminal emulation

I have created https://crates.io/crates/terminal-emulator which consists of the code from alacritty related to terminal emulation but packaged as a standalone library solely for that.  The idea is that this library does no IO on its own, but can be used in conjunction with a pty and UI to build a terminal emulator.
It would be great if alacritty could switch over to using this library for terminal emulation to separate a few concerns and increase re-use.  The terminal emulator does for example not support configuration right now; this is seen as a concern that should live outside of that library.
Right now, the emulator library lives in a "mini-mono-repo" together with https://github.com/dflemstr/mux, which uses the library in a real world application to ensure correctness and to test any changes.
If this is a good idea, the next steps would be to clean up the API of the library (now it's more or less ripped out directly) and add more tests etc. I can grant direct contributor access or break out the library into a separate repository if necessary.

While this is fundamentally something that Alacritty aims to provide, there are some problems with the process taken here.
First of all, this issue is a duplicate of #450.
There's also already an open PR which attempted to make this work better here: #1023.
It is not an option to maintain a library like this out of tree. This is a fundamental part of Alacritty which was specifically written for Alacritty and needs to be maintained by the Alacritty project. That is why the #1023 PR aims to separate the library and binary in the Alacritty repository, making it easy to manage the project in a centralized fashion.
There also is some issue with spearheading into one direction without any clear guidelines as to what the goal is. People have wanted to extract several features of Alacritty into libraries for various different reasons and these have to be unified in advance to make a cut that is logical for the project. It should also be explicitly stated that Alacritty will always be the primary focus of Alacritty. Functionality which is not desired in Alacritty, would not make it into a library Alacritty uses internally.

@chrisduerr thanks for the reply and apologies for not linking to the existing issues (which I still think are different but related)! I will keep using the broken out library until a better option is available, and if the "alacritty library" fills the same use-case I'd be willing to relinquish the terminal-emulator crate name if necessary.
For now I prefer shipping code over participating in a design discussion about this, especially since it would seem like the discussion you linked to has stagnated.  Please consider re-opening this issue if your purist stance on alacritty dependencies changes.


Fix styling on module timetable warning

Eg: https://ntumoons.vercel.app/modules/2023/2/BA3205
With the Saturday column hidden it shows as below

Fix by changing width to max-content and min-width to 2/3 instead. Add some x padding if necessary for the bullet points

Closed by https://github.com/Benjababe/ntumoons/pull/69


[homework] 🐖 EA, Corporate Piglets 🐷 & Linear Regression

Think

[x] Read the Kissinger-Schmidt-Huttenlocher thinkpiece on how ChatGPT heralds an intellectual revolution on a grand scale: Wall Street Journal Link or non-paywalled link
[x] Read Sam Altman's plan for ChatGPT here: https://openai.com/blog/planning-for-agi-and-beyond
[x] Watch John Oliver's special on ChatGPT and AI: https://www.youtube.com/watch?v=Sqa8Zo2XWc4
[x] Watch Abigail Thorn's special on Effective Altruism: https://youtu.be/Lm0vHQYKI-Y - Effective Altruism has influenced folks like:

Elon Musk and Peter Thiel, who co-founded OpenAI (who created ChatGPT) - Wired link or non-paywalled link
Jaan Tallinn (https://en.wikipedia.org/wiki/Jaan_Tallinn#Other_tenures)
Shane Legg and Demis Hassabis who created DeepMind (New York Times link and non-paywalled link)

[x] Read https://www.bbc.com/news/world-asia-china-57268111 -- and reflect on how this was one of the first three data journeys we covered in the first lecture on data thinking.

As you read, ask:

Can you back up every statement they make?
Can you clearly define every word written?
How might data thinking principles apply?
Do you agree or disagree? Why?
How do you feel about what is happening now? Feel free to share reflections on Zulip :)

See an example of such critiques here or here.

[x] Read or watch this introduction to the command line or shell: https://missing.csail.mit.edu/2020/course-shell/

Ask

[x] Ask ChatGPT for help completing this homework (ask it to summarize any of the above articles or videos, ask for help understanding, ask to explain lines of code, etc!)

Do

[x] Watch the lecture recording from March 2, 2023
[x] Review the whiteboard from class: https://www.figma.com/file/5o0fDhQuOBnKAd3gyFi6Ty/230302-logistic-regression-and-version-control-and-latex
[x] Review the GitHub codespace repository: https://github.com/onefact/datathinking.org-codespace/ (e.g. try running it using the same environment.yml file we created!)
[x] Review the Jupyter notebook from lecture and rerun it in your codespace: https://github.com/onefact/datathinking.org-codespace/blob/main/notebooks/230302-logistic-regression-math-equation-and-code.ipynb
[x] use linear regression to analyze the data you visualized in the first homework. You will need to follow the same steps (e.g. ask ChatGPT, write the equation, translate the equation to code, run and debug the code -- all vital data thinking skills :).
[x] Post a visualization on Zulip of a plot illustrating your linear regression on the data you used for the first homework.
[x] Post the permalink to the jupyter notebook you created as a comment on this homework here in GitHub issues

https://devadeut-ubiquitous-yodel-7j9v6qvxgx92p6x9.github.dev/