Checking current boot device... detected mount: No such file or directory , mount failed

One of my machines is still not working with the latest release. Here's what diskinfo shows (it should be finding the SanDisk Curzer Orbit usb stick):

[root@smartos ~]# diskinfo -pH
ATA     c1d0    -       -<PHONE_NUMBER>928   no      no
ATA     c2d0    -       -<PHONE_NUMBER>928   no      no
SCSI    c3t0d0  SanDisk Cruzer Orbit<PHONE_NUMBER>8     no      no

I'm not sure why SmartOS is marking is as non removable, but i think that's why it's broken for this script.

That disk has removable=no which means platform-upgrade will not consider it. This is as designed. However It’s arguable that this is a bug in diskinfo or SmartOS to cause the change. In the meantime,
platform-upgrade /dev/dsk/c3t0d0p1

On 24 Nov 2017, at 02:54, Greg Dietsche<EMAIL_ADDRESS>wrote:
One of my machines is still not working with the latest release. Here's what diskinfo shows (it should be finding the SanDisk Curzer Orbit usb stick):
[root@smartos ~]# diskinfo -pH
ATA c1d0 - -<PHONE_NUMBER>928 no no
ATA c2d0 - -<PHONE_NUMBER>928 no no
SCSI c3t0d0 SanDisk Cruzer Orbit<PHONE_NUMBER>8 no no
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub, or mute the thread.


0.21.2 exports two symbols without psl_ prefix

I'm trying to get 0.21.2 in shape for debian packaging, and i notice that the shared object from 0.21.2 exports two symbols that  which don't have a psl_ prefix:

GetUtfMode
LookupStringInFixedSet

I'm assuming that these are only accidentally exposed.  I haven't been able to trace why they're being exposed now, but they were not exposed in 0.21.1.

i notice a6397a0d62992d5e73be9071c86a746c32fdac4e, which looks relevant, but it happened before 0.21.1 (before 0.20.2, actually)
So it's possible that this is due to some sort of toolchain issue, i'm not sure.
I do notice that if i try to build from the git tags directly with ./autogen.sh && ./configure && make that  i cannot deliberately replicate the problem.  So maybe there are some options that debian build infrastructure are using that make it possible to accidentally export these symbols?

It seems it is conditional on gnulib providing gl_VISIBILITY which causes configure to test whether -fvisibility=hidden works, and if so, provide that as CFLAGS_VISIBILITY. Building from a freshly autoreconf'ed source tree I see this in the ./configure output:
./configure: 13558: gl_VISIBILITY: not found

#206 solves this for meson, as it seems to be an oversight that it is missing there.

i agree with this assessment, @eli-schwartz  -- thanks for looking into it so promptly!  it looks to  me like the gnulib macro m4/visibility.m4 isn't included in the git repository, which is why gl_VISIBILITY is missing.  I'll prepare a patch for that, since i believe the expectation for gnulib is that it is copied into projects where it is used.

That was my assumption too -- I had to download a copy from gnulib.git with wget and copy it into place, after which it worked, but I have no clue how gnulib works in general.


[KYUUBI #4106][FOLLOWUP] Rename conf key of uploaded batch resource

Why are the changes needed?

As discussed https://github.com/apache/kyuubi/pull/4144#discussion_r1112957149, we should put the conf key into namespace kyuubi.batch.
How was this patch tested?

[ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

[ ] Add screenshots for manual tests if appropriate

[x] Run test locally before make a pull request

Thanks, merged to master/1.7


Fix: namespaces

Renames namespace configs so that they are picked up first.
This prevents kubectl from applying them in the wrong order
when recursively applying a directory.

i.e. kubectl apply -f addons/prometheus/ -R
would fail with namespace not available errors.  This should not happen now.

Testing
deployed all of the addons successfully.

damn, somehow got it in the wrong place.


Trying to install fresh and having issues with Stored Procedure creation

I'm not sure where the issue lies here. But when trying to create the first Stored Procedure I get the following error:
Creating [dbo].[Create_HMACSHA256]...
Msg 6505, Level 16, State 2, Procedure Create_HMACSHA256, Line 1 [Batch Start Line 3]
Could not find Type 'UserDefinedFunctions' in assembly 'APIConsumer'.
I had to copy the System.Net.Http.dll from the Microsoft Framework (which is 4.0.30319) because when I tried using the one provided here it was giving me an error about the Policy.
Assembly 'System.Net.Http' could not be installed because existing policy would keep it from being used.
So this was a fresh install on a test server to try and work out what may be wrong. Thank you in advance for any help.

Got this working. So closing. Still having some issues getting a token from the Auth. But that's proably user error at this point.

Hey @iamoop I'm having this exact same problem, exact same scenario. What did you do to get it working?

Never mind @iamoop  same problem as issue #10
Didn't pay enough attention on step 5

Hi @cgeswein & @iamoop,
Greatly appreciated if you can tell me the steps to work out this problem in detail?


Added Background generator project

Description 📜
Added a new project: Background Generator
Fixes #286

-Add a new project

Domain of Contribution 📊

[Project using HTML, CSS & JS

Checklist ✅

[x] I'm GSSoC'22 contributor

Screenshots / Gif (Optional) 📸

I have made the required changes


Updated Bootstrap-wysihtml5 to 0.3.3

This update fixes the warning message:

Also the repository https://github.com/Waxolunist/bootstrap3-wysihtml5-bower is deprecated in favor of https://github.com/bootstrap-wysiwyg/bootstrap3-wysiwyg.

Did you check to make sure that the fix for the "checkbox out of bounds issue #257" has been resolved in this update? Thanks!

Hey Abdullah,
I colud not reproduce the bug from issue #257. The checkbox looks fine both before and after applying this PR. Looks like it was fixed earlier.

Tested and confirmed the fix for the aforementioned issue. Thanks!


ProtoActor cluster members stop talking to eachother

We've used this ProtoActor library in one of our systems and despite setting CPU requests and memory requests/limits we do see a cluster of 4-8 ProtoActor member suddenly stop talking to eachother. It feels like this is happening during times of little to no traffic.
We're using AKS (k8s v1.29.4). What concerns me is that our devs hardcoded the ClusterName and we have multiple instances of this service running in different Namespaces (is there namespace isolation done in protoactor code?).

is there namespace isolation done in protoactor code?

Yes.
Do you see anything else, e.g. gossip starts timing out?
Any logs from when it happens?

There is no quorum mechanism as we fully rely on Kubernetes in this case to know what is running and what is healthy.
Do you by any chance have some form of service mesh? e.g. Traefik, Istio, or something similar running?
Have you tried booting up some empty dummy proto cluster in the same environment? e.g. just a cluster, no actors to see if that cluster manages to form?
What happens if you reboot all nodes at the same time, does it still disconnect after some time?

Yes restarting all actors at the same time seems to be more successful and usually fixes the issue. Do you have an idea what in the logic would prevent a regular kubernetes deployment rollout with 4-8 replicas where each member leaves/joins within 30-60 seconds to be functional?

how often do running cluster nodes refresh their discovery of the metadata labels?

It is using the "watch" feature, so it is as soon as Kubernetes announces it.
Do you by any chance have some custom settings applied to e.g. gossip interval or anything special for the Proto.Cluster configurations?


Can deserialization patterns use the property name?

I'm trying to use a custom deserialization to type check CSS in my JSON objects.
I'm using a CSS type fromcsstype:
import type * as CSS from "csstype";
type CustomStyle = CSS.Properties<string | number>;

And have the CSS as a property called "customStyle" in my schemas:
const schemaWithCustomStyle =  {
  type: "object",
  properties: {
    customStyle: {
      type: "object",
    },
  },
  additionalProperties: false,
} as const;

The type I would like to get from this is something like
type TypeWithCustomStyle = {
    customStyle?: CustomStyle;
}

However since there's not enough information in the type to match a pattern:
type TypeWithCustomStyle = FromSchema<
  typeof schemaWithCustomStyle,
  {
    deserialize: [
      {
        pattern: {
          type: "object";
        };
        output: CustomStyle;
      }
    ];
  }
>;

matches the outer schema:
type TypeWithCustomStyle = CSS.Properties<string | number, string & {}>

Is there a way to pattern match based on the name of the property, e.g.
type TypeWithCustomStyle = FromSchema<
  typeof schemaWithCustomStyle,
  {
    deserialize: [
      {
        pattern: {
          propertyName: "customStyle";
        };
        output: CustomStyle;
      }
    ];
  }
>;

type TypeWithCustomStyle = {
    customStyle?: CustomStyle;
}

I took a look at the deserialize.ts  file:
type RecurseOnDeserializationPatterns<
  S extends JSONSchema7,
  P extends DeserializationPattern[],
  R = M.Any
> = {
  stop: R;
  continue: RecurseOnDeserializationPatterns<
    S,
    L.Tail<P>,
    S extends L.Head<P>["pattern"]
      ? M.$Intersect<M.Any<true, L.Head<P>["output"]>, R>
      : R
  >;
}[P extends [any, ...any[]] ? "continue" : "stop"];

but don't understand how exactly it's working.

Hi @halfcadence !
You are right, it's not possible right now to use the property name in deserialization patterns. I'll look into that, it could be an interesting feature.
Meanwhile, there's a very simple trick you can use (that may even be cleaner than using the property name): JSON schemas are extensible, so you can use a custom internalId prop:
const schemaWithCustomStyle =  {
  type: "object",
  properties: {
    customStyle: {
      internalId: "customStyle",
      type: "object",
    },
  },
  additionalProperties: false,
} as const;

type TypeWithCustomStyle = FromSchema<
  typeof schemaWithCustomStyle,
  {
    deserialize: [
      {
        pattern: {
          internalId: "customStyle";
        };
        output: CustomStyle;
      }
    ];
  }
>;

Thanks for the comment, that makes sense and I think would solve this problem.
(As a different issue, I realized that the schema I'm working with is recursive and so isn't supported for that reason)


Some questions about parameter transform between functions

After reading the example, I have two questions.

How to dynamically update related logical functions？I found the FaaS logical function associated actual function (e.g. AvgStuScore, PrintStuAvgScore) is statically compiled.
Is there a method to define a parameter transformation relationship.This method will convert the output parameter of the previous function into the input parameter of the next function according to the conversion relationship. The keys of the two arguments may not be the same, and the structure locations may be different.

I am a rookie, maybe my questions are stupid, and I hope to get answers.

@nebulaoc
1.The first question. You understood correctly; functions cannot be dynamically added. They can only be modified through changes in configuration and code followed by recompilation. Currently, KisFlow does not have the capability to dynamically schedule functions via RPC or other distributed mechanisms. This is a feature planned for future iterations of KisFlow to support distributed scheduling of FaaS.
2.For the second question, the input and output of a function are entirely customizable. You can freely configure the input and output parameters. No transformation is needed; you just need to define your output structure within the FaaS. The downstream function can then parse this structure. However, the downstream function needs to be aware of the upstream data structure definition at the business logic level.

Thanks for your reply. After you explained my first question, I understood the second question.


examples folder in release zip does not have binaries

The release zip file includes source files under "examples" folder. Source files need to be replaced with binaries that can be run directly without the need to build.
https://github.com/Microsoft/SparkCLR/releases/download/v1.5.200/spark-clr_2.10-1.5.200.zip

With https://github.com/Microsoft/SparkCLR/pull/294 example projects are built. Need to include them in "runtime" folder that will be used for release.

Checked in #400

@hebinhuang - the latest release https://github.com/Microsoft/Mobius/releases/tag/v1.6.100-PREVIEW-1 does not seem to have example binaries. Can you take a look? You can refer to the logs of build 1.6.1-SNAPSHOT.685 in AppVeyor to troubleshoot.

It caused by the failure of compiling Examples.
HdfsWordCount -> C:\projects\sparkclr\examples\Streaming\HdfsWordCount\bin\Debug\SparkClrHdfsWordCount.exe
1204C:\windows\Microsoft.NET\Framework\v4.0.30319\Microsoft.Common.targets(1605,5): warning MSB3245: Could not resolve this reference. Could not locate the assembly "CSharpWorker". Check to make sure the assembly exists on disk. If this reference is required by your code, you may get compilation errors. [C:\projects\sparkclr\examples\Sql\JdbcDataFrame\JdbcDataFrame.csproj]
1205C:\windows\Microsoft.NET\Framework\v4.0.30319\Microsoft.Common.targets(1605,5): warning MSB3245: Could not resolve this reference. Could not locate the assembly "Microsoft.Spark.CSharp.Adapter". Check to make sure the assembly exists on disk. If this reference is required by your code, you may get compilation errors. [C:\projects\sparkclr\examples\Sql\JdbcDataFrame\JdbcDataFrame.csproj]
1206Program.cs(6,30): error CS0234: The type or namespace name 'Core' does not exist in the namespace 'Microsoft.Spark.CSharp' (are you missing an assembly reference?) [C:\projects\sparkclr\examples\Sql\JdbcDataFrame\JdbcDataFrame.csproj]
1207Program.cs(7,30): error CS0234: The type or namespace name 'Services' does not exist in the namespace 'Microsoft.Spark.CSharp' (are you missing an assembly reference?) [C:\projects\sparkclr\examples\Sql\JdbcDataFrame\JdbcDataFrame.csproj]
1208Program.cs(8,30): error CS0234: The type or namespace name 'Sql' does not exist in the namespace 'Microsoft.Spark.CSharp' (are you missing an assembly reference?) [C:\projects\sparkclr\examples\Sql\JdbcDataFrame\JdbcDataFrame.csproj]
1209C:\projects\sparkclr\examples\Sql\SparkXml\SparkXml.csproj(43,5): error MSB4067: The element <#text> beneath element  is unrecognized.
1210C:\windows\Microsoft.NET\Framework\v4.0.30319\Microsoft.Common.targets(1605,5): warning MSB3245: Could not resolve this reference. Could not locate the assembly "CSharpWorker". Check to make sure the assembly exists on disk. If this reference is required by your code, you may get compilation errors. [C:\projects\sparkclr\examples\Streaming\EventHub\EventHub.csproj]
1211  EventHub -> C:\projects\sparkclr\examples\Streaming\EventHub\bin\Debug\SparkClrEventHub.exe
1212  Pi -> C:\projects\sparkclr\examples\Batch\Pi\bin\Debug\SparkClrPi.exe
1213  WordCount -> C:\projects\sparkclr\examples\Batch\WordCount\bin\Debug\SparkClrWordCount.exe
1214MessagePublisher.cs(40,17): warning CS0219: The variable 'topicName' is assigned but its value is never used [C:\projects\sparkclr\examples\Streaming\Kafka\Kafka.csproj]
1215  Kafka -> C:\projects\sparkclr\examples\Streaming\Kafka\bin\Debug\SparkClrKafka.exe
1216===== Build FAILED for C:\projects\sparkclr\examples\Examples.sln -- Debug with error 1 - CANNOT CONTINUE =====


Can we get un update for fvtt core 12?

Can we get un update for fvtt core 12?

Sure sorry for the delay , this week end i will do a new release


[Autocomplete] renderInput is using an old api

Steps to reproduce
The props passed through renderInput use the old API InputProps and InputLabelProps.

Current behavior
No response
Expected behavior
No response
Context
No response
Your environment

  System:
    OS: Windows 11 10.0.22621
  Binaries:
    Node: 20.17.0 - C:\Program Files\nodejs\node.EXE
    npm: 9.8.1 - C:\Program Files\nodejs\npm.CMD
    pnpm: 9.9.0 - C:\Program Files\nodejs\pnpm.CMD
  Browsers:
    Chrome: Not Found
    Edge: Chromium (127.0.2651.74)
  npmPackages:
    @emotion/react: ^11.11.4 => 11.13.3
    @emotion/styled: ^11.11.5 => 11.13.0
    @mui/icons-material: ^6.1.3 => 6.1.3
    @mui/lab: 6.0.0-beta.11 => 6.0.0-beta.11
    @mui/material: ^6.1.3 => 6.1.3
    @mui/material-nextjs: ^6.1.3 => 6.1.3
    @mui/styled-engine-sc: ^6.1.3 => 6.1.3
    @mui/system: ^6.1.3 => 6.1.3
    @mui/utils: ^6.1.3 => 6.1.3
    @mui/x-data-grid-pro: ^7.20.0 => 7.20.0
    @mui/x-date-pickers: ^7.20.0 => 7.20.0
    @mui/x-date-pickers-pro: ^7.20.0 => 7.20.0
    @mui/x-license: ^7.20.0 => 7.20.0
    @types/react: ^18.2.66 => 18.3.5
    react: ^18.2.0 => 18.3.1
    react-dom: ^18.2.0 => 18.3.1
    typescript: ^5.2.2 => 5.5.4

Search keywords: autocomplete, api

It makes sense to be consistent and move the InputProps, inputProps and InputLabelProps into a slotProps key in the options object, but this would be a breaking change. As a first step we could provide both APIs and deprecate the current ones, with the thought of removing them in a future major release.

@sai6855 would https://github.com/mui/material-ui/pull/43606 also address this issue?


Set hostname per MAC address

Enable the ability to declare a static hostname attached to a MAC address.  This way we don't have to do a static IP assignment simply because we want a static hostname assignment.  It allows us to disregard the client-provided hostname when doing DNS registrations, or could allow us to regard both our statically assigned hostname along with the client-provided one.

Note: This issue was migrated from https://bitbucket.org/dustywilson/netcore/issues/10 originally created on 2015-07-23 by Dusty Wilson.  It was not evaluated in any way for freshness and validity.

So far all values are FQDN.  Is there a reasonable way to allow this value to be non-FQDN (appending the DHCP domain) while also allowing FQDN (not appending, no matter where they're at)?  Usually folks would put a dot at the end to indicate FQDN.  We haven't been doing that.  Maybe we assume no dots at all means non-FQDN and any dots at all means FQDN?  That seems inconsistent with other systems.  But for the moment, I'm going to go that route.  When we make a decision here, we should adjust.

Note: This issue was migrated from https://bitbucket.org/dustywilson/netcore/issues/10 originally created on 2015-07-28 by Dusty Wilson.  It was not evaluated in any way for freshness and validity.

Is it possible that we're already covered by dhcp.go:317?

Note: This issue was migrated from https://bitbucket.org/dustywilson/netcore/issues/10 originally created on 2015-07-28 by Dusty Wilson.  It was not evaluated in any way for freshness and validity.


StartAsync() returns 404 from Azure SignalR Service

Please see all details there:
https://github.com/aspnet/SignalR/issues/2791#issuecomment-413609478

Thanks @cnlogistics for reporting the issue. I will take a look from the service side and get back to you.

@cnlogistics as your log screenshot indicates, the timestamp is Local Time, could you provide the UTC time for the Local Time 2018-08-15T12:07:28 for me to narrow down the log?
With a first glance, it looks like the WebSockets connection fails to start, according to the log.

Just subtract 2 hours than you are on UTC time. UTC+2 is my local time in Vienna / Austria.

@vicancy If helpful here the AI Analytics query from 5 minutes before the 404 and 5 minutes after and the new CSV as ZIP
union (traces), (requests), (pageViews), (dependencies), (customEvents), (availabilityResults), (exceptions)
| extend itemType = iif(itemType == 'availabilityResult',itemType,iif(itemType == 'customEvent',itemType,iif(itemType == 'dependency',itemType,iif(itemType == 'pageView',itemType,iif(itemType == 'request',itemType,iif(itemType == 'trace',itemType,iif(itemType == 'exception',itemType,"")))))))
| where ((itemType == 'request' or (itemType == 'trace' or (itemType == 'exception' or (itemType == 'dependency' or (itemType == 'availabilityResult' or (itemType == 'pageView' or itemType == 'customEvent')))))) and (timestamp >= datetime(2018-08-16T20:11:21.046Z) and timestamp <= datetime(2018-08-16T20:21:21.046Z)))
| top 101 by timestamp desc

query_data (1).zip

Client side: on 2018-08-15T10:07:28.753Z 404 response with SSE request ?hub=hubname&id=xGk...
Service side: on 2018-08-15T10:07:28.7598884Z an Handshake error occurs:

Microsoft.Azure.SignalR.HandshakeFailedException: Handshake failed: Connection closed before handshake complete.

This error happens when the HttpConnectionContext.Transport.Input IsCompleted before handshake request message completed. Code logic similar to
var connection = CreateConnection(connectionId);
while (true) {
   var result = await HttpConnectionContext.Transport.Input.ReadAsync();
   var buffer = result.Buffer;
   if (TryParseHandshakeRequest(ref buffer, out _)) {
      return;
   }
   if (result.IsCompleted) {
      // This is where it runs into
       throw new HandshakeFailedException();
   }
}

As the log shows, the connection is connected, however during handshake, the Pipe input is completed somehow. (creating the connection and handshake happens in the same service instance)
So @anurse , is it possible that the underlying HttpConnectionContext made it happen somehow?

@vicancy maybe related to that https://github.com/aspnet/SignalR/issues/2791#issuecomment-413790378

@vicancy Regarding

Service side: on 2018-08-15T10:07:28.7598884Z an Handshake error occurs:
Microsoft.Azure.SignalR.HandshakeFailedException: Handshake failed: Connection closed before handshake com

Where can I see that Azure SignalR Service log messages. Would somehow help. Even help you when I could provide that with an issue? I Azure Portal I see only that, but it is not ready and shows wrong metrics.

@ericbrunner Currently Azure SignalR Service log messages are not exposed to the portal. We are considering publishing error/warning logs to portal, however that would be after GA. cc @chenkennt For now, you can provide the time range and your instance ID, and we can help getting service logs for you.

@ericbrunner I was looking at your azure function and it looks like you're initializing a shared instance of the hubConnection (it's static) without locking. That might explain some of the weird behaviors you're seeing.

@davidfowl you are propably right. I will surround my own SendAsync method invocation with a SemaphoreSlim wait lock (only 1 concurrent invocation allowed) or what's much better than locks, I start the hubConnection only ONCE and invoke hubConnection.StartAsync ONCE. Only in case of an exception that occurs on hubConnection.SendAsync I would attempt to invoke hubConnection.StartAsync until it succeeds. Either way works for me.

@davidfowl  Maybe you consider making StartAsync and StopAsync thread safe in future. Analog to HttpClient thread safe methods

The client is thread safe but that’s not your issue. You start and stop the connection from overlapping requests. You have a shared state problem.
Why do you stop the connection after sending?

You can close that issue. I described 2 way of code improvements above. Why I close? Well that was the first code draft and playing around with Az Fx and SignalR.


gRPC client gets a "settings timeout" when accessing an older server

What version of gRPC and what language are you using?
gRPC 1.60.0 against 1.36.1
C++ (cmake build)
What operating system (Linux, Windows,...) and version?
Redhat Enterprise Linux 9.3
What runtime / compiler are you using (e.g. python version or version of gcc)
clang 17.0.6
What did you do?
Issued a call to the remote server (1.36.1) which waits 2 Minutes, then returns.
What did you expect to see?
The call returns successfully.
What did you see instead?
After 1 Minute:
    Server side error message:
    settings timeout

    gRPC error 'unavailable' (status code 14) received in MyProgram on host myHost

Anything else we should know about your project / environment?
Configuration
We set

channelArguments.SetInt(GRPC_ARG_KEEPALIVE_TIME_MS, 10 * 60 * 1000); // 10 minutes
but do not set GRPC_ARG_KEEPALIVE_TIMEOUT_MS (to keep the default value)

Seems to me, that the Server using gRPC Version 1.36.1 does not send a settings ACK back and thus the 'settings timeout' is triggered on the client side.
Workaround
we set "grpc.http2.settings_timeout" to a sufficiently high value, effectively disabling it.
channelArguments.SetInt("grpc.http2.settings_timeout", 1000U * 60U * 60U * 48U); // deactivate 'setting timeout' error: using 2 days

It's actually waiting for the initial SETTINGS frame itself, not the ACK.  The server is supposed to send that immediately as soon as the client connects, and all gRPC versions should be doing that.
That having been said, 1.36.1 is a very old version of gRPC, so even if there was a bug there, we're not going to patch it at this point.  Can you please try with the most recent version and see if this problem is still occurring?

Sorry, I take back part of what I said there -- I was initially thinking that this was related to the changes we made a while back to wait for the initial SETTINGS frame before we considered the connection establishment to be successful, but it looks like you are actually talking about code that was added more recently to impose a timeout on the SETTINGS ACK.
@ctiller, can you think of any reason why an older version of gRPC would not be sending a SETTINGS ACK?
Either way, I think upgrading from 1.36.1 is appropriate at this point, since it's really old.  But it would be good to know if we expect this to be a problem.

I'm unaware of any bugs relating to not sending settings ack (though I could believe it), but we have seen cases where very low-bandwidth connections can queue ping acks (and likely settings acks) for quite a long period of time with older versions of gRPC.
The settings ack enforcement is a necessary part of our HTTP/2 Rapid Reset mitigations so I can't see us dropping it, and so if it's causing trouble I'd also encourage upgrading.

Well if a newer client contacts an older one (the 1.36.1 version for example - we did not test for other versions) then it will get disconnected after 2 minutes. As the caller does not always have a say, which gRPC version is unsed on the server, there has to be some mechanims to prevent that disconnect on the client side. Maybe that mechanism is setting the "grpc.http2.settings_timeout" to a very high value and thereby deactivating the feature...
For us its an issue where we have to provide backward compatibility.

Thanks for pointing us to the rapid-reset attack, btw. I can see why you can't just deactivate the feature.

We could consider exposing the "grpc.http2.settings_timeout" channel arg for others to use (i.e., defining the arg in an include file instead of in the src tree).  But I don't think there's anything else we can really do about this.
And I do think you should upgrade from 1.36.1 on that server.  That version is extremely old and probably has quite a few bugs.

Doesn't look like there's anything immediately actionable here, so I'm going to close.  Please reopen if needed.


Optimize size of Concerto parser

The JS for the CTO parser is currently very large and should be optimised to make the web packed version of Concerto much smaller. The parser currently includes many pegjs rules inherited from JS that could be removed.
[74] ./lib/introspect/parser.js 545 KiB {0} [depth 3] [built]
This is also an opportunity to take a step back and evaluate other parser generators. I am particularly interested in being able to generate a CTO parser for other languages. E.g. Canopy supports Java, JS, Ruby and Python. ANLR4 (while written in Java) can also generate JS amongst many other languages: https://github.com/antlr/antlr4
http://canopy.jcoglan.com/
References:
https://tomassetti.me/parsing-in-javascript/
https://en.wikipedia.org/wiki/Comparison_of_parser_generators

I've tried to modify the script that creates the parser, with optimize option set to size the size of parser.js is 132kb instead of 558kb
"prepare": "pegjs --optimize size ./lib/introspect/parser.pegjs"

I've tried to modify the script that creates the parser, with optimize option set to size the size of parser.js is 132kb instead of 558kb
"prepare": "pegjs --optimize size ./lib/introspect/parser.pegjs"

@j4m3sb0mb Nice! Does that optimize version pass the tests?

@jeromesimeon yes it does

Thanks @j4m3sb0mb It's a relatively significant improvement. I don't see why we wouldn't do this for the time being. @dselman is traveling, but I can review a PR if you make one.
I would still leave this issue open for the other reasons listed (clean up of parser itself, investigate other parser generator technologies).

yes

@j4m3sb0mb
I have just seen this in the pegjs documentation:
--optimize
Selects between optimizing the generated parser for parsing speed (speed) or code size (size) (default: speed)

Do you have any experience with performance related to this?
I haven't done much testing with pegjs myself, so I'll probably want to get some feedback on this from either @dselman or @mttrbrts

@jeromesimeon no experience, sorry

Thanks @j4m3sb0mb, the speed vs size tradeoffs aren't well understood for this library as far as I know.
The last time that I looked at this, I saw a similar improvement in compile-time for the speed optimized version, which is great for CLI use and online-use (post-loading). However, this is in contrast to the size optimized version, where allow faster page loads for online-use and smaller bundles when using concerto as a node dependency.
Perhaps this question helps?

Is an extra 100ms acceptable for Template Studio recompiles between edits in exchange for a 75% reduction in bundle size?

Unless there is a clear consensus on this question, I suggest instead focussing on remove unused rules from this file (there are a lot of them!), https://github.com/accordproject/concerto/blob/master/packages/concerto-core/lib/introspect/parser.pegjs
That way we get a size reduction but still optimize for speed. 🏆

I'll add two cents since @mttrbrts 's review really helped me understand what the questions are. I think I agree that speed during use matters more, even if that means the page initially loads a little slower (not sure how much slower really it's not that bad in Template Studio for instance). This is a one-time cost compared to the constant run-time cost when parsing.

To be a little more specific about parser.pegjs. This file was originally a copy of a parser for JavaScript which we added new rules to capture the structure for Concerto (The new rules are here, https://github.com/accordproject/concerto/blob/master/packages/concerto-core/lib/introspect/parser.pegjs#L1555).
However, most of the original rules are still there unused (for example more of sections A.3 and A.4, Lines 540-1260). However, simply removing these lines is likely to break other rules that depend on these lines.
So refactoring will require some incremental changes and lots of testing to remove unused code.
The good news is that we have excellent code coverage, so running unit tests should flag issues quicky.

@mttrbrts
I've tried to remove all lines from 540 to 1260, it doesn't break the parser and it pass all tests.
parser.js size is then 356,2kb with speed optimization

Excellent! That's a nice surprise.
I suspect that there are lots of other rules that aren't used too. For example:

URI definition, is much more advanced than we need. I'm sure that that could be simplified.
Tokens, L476
Keywords, L210

Have some fun!

Excellent! That's a nice surprise.
I suspect that there are lots of other rules that aren't used too. For example:

URI definition, is much more advanced than we need. I'm sure that that could be simplified.
Tokens, L476
Keywords, L210

Have some fun!

Did a bit more in #154
The current parser looks pretty clean now. Tokens and Keywords have been cleaned up.
I'm unclear on the definition of what "more advanced than we need" is for URIs. Shouldn't we comply with some kind of URI spec? What would we remove?
Another area that might be simplified are Unicode character sets, but that's the same questions what do we believe the behaviour should be?

@dselman  @jeromesimeon It appears that pegjs is no-longer maintained https://github.com/pegjs/pegjs/issues/667
There is a fork (https://github.com/peggyjs/peggy), however it is fairly nascent.
It this the opportunity to switch to a new technology entirely, perhaps standardise with a parser lib that we use in ergo or markdown-transform

@dselman @jeromesimeon It appears that pegjs is no-longer maintained pegjs/pegjs#667
There is a fork (https://github.com/peggyjs/peggy), however it is fairly nascent.
It this the opportunity to switch to a new technology entirely, perhaps standardise with a parser lib that we use in ergo or markdown-transform

Markdown transform uses: https://github.com/jneen/parsimmon
Ergo uses: http://gallium.inria.fr/~fpottier/menhir/

This issue is partially address by the introduction of the new concerto-cto package which makes the parser an optional dependency. Closing this issue until there is new context for reviewing it again.


heightAtLine or any line's top position which out of viewport might not accurate

Sorry it's a bit complicated, I will try to explain it all.

you need set wrapLine true and viewport not Infinity and also use simplescrollbar
pre-make some lines that will be wrapped over and many enough to out of viewport.
don't even scroll to those lines and check the heightAtLine on the lines that out of the viewport.
You will find out that their height are not very accurate, may lack 1 or 2 lines height.

I don't know how CodeMIrror measure the line height which out of the viewport (not loaded into the DOM yet), but this API is really important to me.
Thanks for helping!

This is by design -- until a line is actually rendered, its height is an approximation of its real height. There's no way around this except for rendering all lines right away, which would completely defeat the lazy-rendering optimization.

Thanks for explanation :smile:


(maint) Add the ability to exclude paths from index generation

This will allow us to clean up the look of our download sites without
making backwards incompatible changes (links to download packages will
still work, the directory is just not browsable).

testing locally on this directory structure:
/tmp/repotest
/tmp/repotest/puppetlabs-release
/tmp/repotest/puppetlabs-pc1-release
/tmp/repotest/puppet6
/tmp/repotest/el
/tmp/repotest/sles
/tmp/repotest/sles/11
/tmp/repotest/sles/12
/tmp/repotest/puppet5
/tmp/repotest/windows
/tmp/repotest/windows/puppet6
/tmp/repotest/windows/foo.msi
/tmp/repotest/windows/bar.msi
/tmp/repotest/windows/puppet5
/tmp/repotest/windows/puppet
/tmp/repotest/windows/puppet/puppet.msi
/tmp/repotest/windows/puppet/dang.msi
/tmp/repotest/windows/puppet/aaaaah.msi
/tmp/repotest/puppet
/tmp/repotest/puppet/puppetlabs-test

running:
./generate_directory_indexes.py -x el -x sles/11 -x "windows/[^/]*.msi" -x puppetlabs -vvv /tmp/repotest
gives the following logs about exclusions (filtered to just excluding:):
output:generate_directory_indexes.py: DEBUG excluding: /tmp/repotest/puppetlabs-release
output:generate_directory_indexes.py: DEBUG excluding: /tmp/repotest/puppetlabs-pc1-release
output:generate_directory_indexes.py: DEBUG excluding: /tmp/repotest/el
output:generate_directory_indexes.py: DEBUG excluding: /tmp/repotest/el
output:generate_directory_indexes.py: DEBUG excluding: /tmp/repotest/sles/11
output:generate_directory_indexes.py: DEBUG excluding: /tmp/repotest/sles/11
output:generate_directory_indexes.py: DEBUG excluding: /tmp/repotest/windows/foo.msi
output:generate_directory_indexes.py: DEBUG excluding: /tmp/repotest/windows/bar.msi

And I was able to confirm that /tmp/repotest/index_by_name.html is in fact missing the 'el' directory, /tmp/repotest/sles/index_by_name.html is missing the '11' directory, other msi files under subdirectories of 'windows' are still there, and files starting with 'puppetlabs' but not at the top level are still there.

Please feel free to leave python style comments....


feedbackd: 0.0.0+git20211018 -> 0.0.0+git20220520

Description of changes

https://source.puri.sm/Librem5/feedbackd/-/releases#v0.0.0+git20220520
I bumped the data repo https://source.puri.sm/Librem5/feedbackd-device-themes too, to include PinePhone Pro support.

Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
22.05 Release Notes (or backporting 21.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module
[ ] (Release notes changes) Ran nixos/doc/manual/md-to-db.sh to update generated release notes

[ ] Fits CONTRIBUTING.md.

Result of nixpkgs-review pr 173815 run on x86_64-linux 1

5 packages built:

calls
chatty
feedbackd
phosh
squeekboard


Pip install error

I am trying to install mpire in one of my environments, but it's throwing Errno -3 Temporary failure in name resolution.  I see a new version just got released (2.8.0) today 2023-8-16. I have 2.7.1 installed in other environments so I tried specifying that version on the install, but getting same error.  Thanks.

My apologies, it looks like my server has a dns config issue.

No worries. I'm glad it works now :)


Cell Fragments Related Issue

I ran into the following problem while trying to work with Simple. Here are the relevant details:
Consider the following configuration:
<T>
    <a> <b> .List </b> <c> .List </c> </a>
</T>

A pattern of the form <a> <b> X </b> Y:ACellFragment </a> compiles to: `<T>`(`<a>`(`<b>`(X), Y)) requires __andBool__(isList(X), isACellFragment(Y)).
A match on any configuration using this pattern fails as the inferred sort of Y during the match is CCell, and isACellFragment(Y) fails as CCell isn't a cell subsort of ACellFragment.

@msaxena2, is this still failing?


Getting SV length in dysgu output vcf

Hi there,
I'm trying to plot the lenght of the SVs detected by dysgu. I noticed there is a specific paramenter in the INFO column in the output .vcf (SVLEN) but it only appears to be accurate for DEL, DUP and INV types.
I calculated the SV lenght by doing END in the INFO column - POS column
For INS cases the actual length is always different from SVLEN.
Also, I was wondering...why is the SVLEN parameter missing completely in TRA variants?
How do I calculate the variant length in these two cases? And is it correct to look at 'SVLEN' in general?
Also, is there a lower/upper limit for the variants detected by the software? My lowest value is SVLEN=30, my highest... 47,303,837 (almost like a whole chromosome? I think it's quite unlikely for this SV to be an actual one... but I do have a few variants exceeding SVLEN > 1.000.000).
Thank you in advance.

Hi @TizianaS92,
As you have identified, the SVLEN is generally not accurate for INS type events using paired-end reads. This is because paired-end reads do not span the whole insertion SV, so the size is estimated from the insert-size metrics. However, there are some cases when INS events are accurate in their SV length, although these are usually shorter in length.
SVLEN for insertions is quite accurate when the SV is spanned by an alignment (SVs usually less than 50bp), or there were supplementary mappings used in calculating the SVLEN parameter. You can tell if this was the case if the metric WR > 0 (Within-Read), or the parameter LPREC=1 (length precise from supplementary mapping). If you want accurate SVLEN for insertions, you can try another caller like manta which will try and assemble the full insertion, although will have lower sensitivity.
Translocations events are not labelled with an sv length as there is no clear way to label them as such.
The lower limit for sv length detection is 30 bp, controlled using the --min-length parameter.
Hope that helps

Hello, thank you for your reply.
Yes, I suspected INS length wasn't accurate, because the longest I found (according to SVLEN) was just 523 bp (suspiciously short).
As I said before, I also found abnormally long DUP, INV and DEL variants.
I'm working on Solanum lycopersicum (whose longest chromosome is around 90,000 Kb) ... and there are some variants exceeding 100 Kb (200 out of about 85.000) with some (70) even longer than 1,000 Kb or even longer than 10,000 Kb (22 variants).
Here are the 5 longest ones:
INV | 30377893
DUP | 31411671
INV | 33061041
DEL | 47303837
DUP | 47303962
What do you think about this? We expect individuals showing this variant not to be viable at all or have severely compromised phenotypes, so we were wondering if these findings may be a bug or something.

Hi @TizianaS92 , here are some thoughts:
It is possible, perhaps likely, that the larger variants are false positives, but it is difficult to tell without being able to see the raw data. You can generate some images of the variant breakpoints using gw and share them here if you wish https://github.com/kcleal/gw
Having a large SVLEN does not always mean the whole chromosome is affected, for example the SV could be a copy-and-paste kind of event of a mobile element - this could give the appearance of a whole chromosome being affected but only a small amount of DNA has been copied.
It might be wise to filter your SVs against another control sample (if available), or possibly look at removing lower quality events around repeats. The SU and PROB fields in the vcf output can help here, as well as the FCC (fold-coverage-change)


Where are the roles?

Heyho,
did you deleted all roles?
Best Tom

Hey @tzabbi, nothing is deleted. :smiley:
Check out https://github.com/dschier-wtd/fedora-workstation/blob/main/ansible/requirements.yml

Ahh thanks! I don't know this works in ansible^^


docs: fix link issues

Coverage remained the same at 100.0% when pulling a5f372df524c0d8d7ce879fd82150e05cfe748a6 on fix-markdown-issues into f0e3da996542210af3146a02c57593a34293e185 on main.


State of the project

I would like to use neutron in an upcoming project and was wondering if it is still supported / in active development because there has not been much activity in the recent months.

it's dead ...

Sorry for the late reply, but yes. Neutron is no longer in active development.
I'd be happy to merge in any bugfixes that get submitted but with the widespread support of flexbox, and upcoming wider support for display:grid, which are both superior to bootstrap-style layout frameworks, I don't feel Neutron has much to offer that isn't provided natively.


[C++][Parquet] Limit size of min, max or disable stats for long binary types

Other Parquet implementations like parquet-mr disable min/max values for long binary types > 4KB. For known logical types comparisons, we could approximate min/max values. We need to implement this.
Reporter: Deepak Majeti / @majetideepak
Assignee: Deepak Majeti](https://issues.apache.org/jira/secure/ViewProfile.jspa?name=mdeepak) / @majetideepak
PRs and other links:

GitHub Pull Request #465

Note: This issue was originally created as PARQUET-979. Please see the migration documentation for further details.

Deepak Majeti / @majetideepak:
Issue resolved by pull request 465
https://github.com/apache/parquet-cpp/pull/465


Add templateUrl to the DeliverablePayload

Current dependencies on/for this PR:

#1704  👈
main

This stack of pull requests is managed by Graphite.


Possible feature: validation of data coming from the API to prevent looping

Related to #520

Would actually be possible to validate the data coming from the API to prevent situations like #520 where gqty is not the one at fault?

We definitely don't want to validate too much (ajv as an extreme case), that defeats the benefits of TypeScript.
I suggest minimal assertions, e.g. invariant or assert, with a message containing enough information for users to start looking at server side.
invariant(data.allMfes0, "Response with alias `allMfes0` expected.");


gtkwave: 3.3.94 -> 3.3.95

Semi-automatic update generated by https://github.com/ryantm/nixpkgs-update tools. This update was made based on information from https://repology.org/metapackage/gtkwave/versions.
meta.description for gtkwave is: '"VCD/Waveform viewer for Unix and Win32"'.

Checks done (click to expand)

built on NixOS
/nix/store/ys90rr55avssvh1kzr5xahfraqchf5qk-gtkwave-3.3.95/bin/evcd2vcd passed the binary check.
/nix/store/ys90rr55avssvh1kzr5xahfraqchf5qk-gtkwave-3.3.95/bin/fst2vcd passed the binary check.
/nix/store/ys90rr55avssvh1kzr5xahfraqchf5qk-gtkwave-3.3.95/bin/vcd2fst passed the binary check.
/nix/store/ys90rr55avssvh1kzr5xahfraqchf5qk-gtkwave-3.3.95/bin/fstminer passed the binary check.
Warning: no invocation of /nix/store/ys90rr55avssvh1kzr5xahfraqchf5qk-gtkwave-3.3.95/bin/ghwdump had a zero exit code or showed the expected version
/nix/store/ys90rr55avssvh1kzr5xahfraqchf5qk-gtkwave-3.3.95/bin/lxt2miner passed the binary check.
/nix/store/ys90rr55avssvh1kzr5xahfraqchf5qk-gtkwave-3.3.95/bin/lxt2vcd passed the binary check.
Warning: no invocation of /nix/store/ys90rr55avssvh1kzr5xahfraqchf5qk-gtkwave-3.3.95/bin/shmidcat had a zero exit code or showed the expected version
/nix/store/ys90rr55avssvh1kzr5xahfraqchf5qk-gtkwave-3.3.95/bin/vcd2lxt passed the binary check.
/nix/store/ys90rr55avssvh1kzr5xahfraqchf5qk-gtkwave-3.3.95/bin/vcd2lxt2 passed the binary check.
/nix/store/ys90rr55avssvh1kzr5xahfraqchf5qk-gtkwave-3.3.95/bin/vcd2vzt passed the binary check.
/nix/store/ys90rr55avssvh1kzr5xahfraqchf5qk-gtkwave-3.3.95/bin/vzt2vcd passed the binary check.
/nix/store/ys90rr55avssvh1kzr5xahfraqchf5qk-gtkwave-3.3.95/bin/vztminer passed the binary check.
/nix/store/ys90rr55avssvh1kzr5xahfraqchf5qk-gtkwave-3.3.95/bin/gtkwave passed the binary check.
Warning: no invocation of /nix/store/ys90rr55avssvh1kzr5xahfraqchf5qk-gtkwave-3.3.95/bin/twinwave had a zero exit code or showed the expected version
Warning: no invocation of /nix/store/ys90rr55avssvh1kzr5xahfraqchf5qk-gtkwave-3.3.95/bin/rtlbrowse had a zero exit code or showed the expected version
/nix/store/ys90rr55avssvh1kzr5xahfraqchf5qk-gtkwave-3.3.95/bin/vermin passed the binary check.
/nix/store/ys90rr55avssvh1kzr5xahfraqchf5qk-gtkwave-3.3.95/bin/xml2stems passed the binary check.
14 of 18 passed binary check by having a zero exit code.
0 of 18 passed binary check by having the new version present in output.
found 3.3.95 with grep in /nix/store/ys90rr55avssvh1kzr5xahfraqchf5qk-gtkwave-3.3.95
directory tree listing: https://gist.github.com/ddaf6d866a82c72a58580f6d22fd3bab
du listing: https://gist.github.com/f243d4a8b127132aca3ddca46ebf97d9

Instructions to test this update (click to expand)

One-time optional setup to skip building using Cachix:
nix-shell -p cachix --run 'cachix use r-ryantm'

Test this update by entering a nix shell, seeing what is inside the
result, and if applicable, running some binaries:
nix-shell --pure -I nixpkgs=https://github.com/r-ryantm/nixpkgs/archive/a721411239605496b8fe8e53a6b5bbd1b618b3f1.tar.gz -p gtkwave
ls -la /nix/store/ys90rr55avssvh1kzr5xahfraqchf5qk-gtkwave-3.3.95

cc @thoughtpolice for testing.

No attempt on x86_64-darwin (full log)
The following builds were skipped because they don't evaluate on x86_64-darwin: gtkwave
Partial log (click to expand)

a) For `nixos-rebuild` you can set
  { nixpkgs.config.allowUnsupportedSystem = true; }
in configuration.nix to override this.

b) For `nix-env`, `nix-build`, `nix-shell` or any other Nix command you can add
  { allowUnsupportedSystem = true; }
to ~/.config/nixpkgs/config.nix.

Success on x86_64-linux (full log)
Attempted: gtkwave
Partial log (click to expand)
shrinking /nix/store/ys90rr55avssvh1kzr5xahfraqchf5qk-gtkwave-3.3.95/bin/vzt2vcd
shrinking /nix/store/ys90rr55avssvh1kzr5xahfraqchf5qk-gtkwave-3.3.95/bin/vermin
shrinking /nix/store/ys90rr55avssvh1kzr5xahfraqchf5qk-gtkwave-3.3.95/bin/vztminer
shrinking /nix/store/ys90rr55avssvh1kzr5xahfraqchf5qk-gtkwave-3.3.95/bin/fst2vcd
shrinking /nix/store/ys90rr55avssvh1kzr5xahfraqchf5qk-gtkwave-3.3.95/bin/fstminer
gzipping man pages under /nix/store/ys90rr55avssvh1kzr5xahfraqchf5qk-gtkwave-3.3.95/share/man/
strip is /nix/store/vcc4svb8gy29g4pam2zja6llkbcwsyiq-binutils-2.30/bin/strip
stripping (with command strip and flags -S) in /nix/store/ys90rr55avssvh1kzr5xahfraqchf5qk-gtkwave-3.3.95/bin
patching script interpreter paths in /nix/store/ys90rr55avssvh1kzr5xahfraqchf5qk-gtkwave-3.3.95
checking for references to /build in /nix/store/ys90rr55avssvh1kzr5xahfraqchf5qk-gtkwave-3.3.95...

Success on aarch64-linux (full log)
Attempted: gtkwave
Partial log (click to expand)
shrinking /nix/store/chfmqn7jzw3s24nznf9dw1mzpsm9h4a1-gtkwave-3.3.95/bin/ghwdump
shrinking /nix/store/chfmqn7jzw3s24nznf9dw1mzpsm9h4a1-gtkwave-3.3.95/bin/fstminer
shrinking /nix/store/chfmqn7jzw3s24nznf9dw1mzpsm9h4a1-gtkwave-3.3.95/bin/vcd2fst
shrinking /nix/store/chfmqn7jzw3s24nznf9dw1mzpsm9h4a1-gtkwave-3.3.95/bin/fst2vcd
shrinking /nix/store/chfmqn7jzw3s24nznf9dw1mzpsm9h4a1-gtkwave-3.3.95/bin/evcd2vcd
gzipping man pages under /nix/store/chfmqn7jzw3s24nznf9dw1mzpsm9h4a1-gtkwave-3.3.95/share/man/
strip is /nix/store/p9akxn2sfy4wkhqdqa3li97pc6jaz3r1-binutils-2.30/bin/strip
stripping (with command strip and flags -S) in /nix/store/chfmqn7jzw3s24nznf9dw1mzpsm9h4a1-gtkwave-3.3.95/bin
patching script interpreter paths in /nix/store/chfmqn7jzw3s24nznf9dw1mzpsm9h4a1-gtkwave-3.3.95
checking for references to /build in /nix/store/chfmqn7jzw3s24nznf9dw1mzpsm9h4a1-gtkwave-3.3.95...


assembly_stats_txt.xml still at v1.0.1

https://github.com/phac-nml/galaxy_tools/blob/master/tools/assemblystats/assembly_stats_txt.xml starts:
<tool id="assemblystats" name="assemblystats" version="1.0.1">
	<description>Summarise an assembly (e.g. N50 metrics)</description>
	<requirements>
...

This is the exact same version number as Konrad's original which is also still on the tool shed, which makes it very confusing as your version has a number of changes:
https://toolshed.g2.bx.psu.edu/view/nml/assemblystats/
https://toolshed.g2.bx.psu.edu/view/konradpaszkiewicz/assemblystats/

Updated to 1.1.0 in PR #193


Project Search API

Is there any API to search for projects by name? If not, could this be added?
Alternatively, is it ok if I cache the list of projects (as returned by https://read-the-docs.readthedocs.io/en/latest/api.html#projects) on my servers and implement my own search?
This is related to: https://github.com/rtfd/readthedocs.org/issues/662#issuecomment-141514217.

If I read https://github.com/rtfd/readthedocs.org/blob/master/readthedocs/restapi/views/search_views.py correctly, it's not possible to search for projects by name. You'll need to provide both q and project (project slug) parameters. Perhaps we can make project_search to search for project name or slug.
(Note that API v1 is being replaced by API v2.)

@Kapeli you can search project by name using this endpoint:
http "https://readthedocs.org/api/v2/search/project/?q=turtle"

I'm closing this issue since I think it's solved. Please, re open if you consider.


Unity plugin should include a working visemes 3d character demo

https://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-speech-synthesis-viseme?tabs=3dblendshapes&pivots=programming-language-csharp

@yosun Thank you for using Speech SDK, and for writing this issue up. How detailed of a demo would accelerate learning our viseme features in Unity? Could you point to a great example demo that another SDK includes for their Unity plugin?

@yosun Are you asking a new sample for Unity which contains visemes 3d feature or are you hoping that Unity Speech SDK package would contain some demos inside?


allow anonymous login to be set per listener, not globally

Is your feature request related to a problem? Please describe.
I see that there is a property to allow anonymous login, which could be interesting to enable per listener .
This way we could define something like:
<IP_ADDRESS>:1883 allow_anonymous=true
<IP_ADDRESS>:8883 allow_anonymous=false
which seems to be more secure.
Describe the solution you'd like
I would like to be able to set this feature per listener.
Describe alternatives you've considered
I know as work around, ACL can be set to allow localhost connections, but this would require allow anonymous connections globally
				## Allow connections from Localhost
				{"permit": "allow", "ipaddr": "<IP_ADDRESS>", "action": "pubsub", "topics": ["$SYS/#", "#"]}

By the way, the ACL {"permit": "allow", "ipaddr": "<IP_ADDRESS>", "action": "pubsub", "topics": ["#"]} is not working as expected. Seems like the ipaddr field is not present when evaluating an incoming pub msg.

Understood. Currently "ipaddr" takes no effect in ACL rules, the IP of client is not exposed to APP layer yet. Will add this feature in 0.17

Thanks. Please, consider as well tuning mqtt properties such as allow_anonymous per listener and not only global.


Integrating 2 ODEs in parallel using torch.vmap

I hope this message finds you well. I wanted to express my gratitude for your amazing repository. I was hoping to get some help with solving two ODEs in parallel using torchode and vmap class in functorch.
Below, I have attached a modified version of the example given in 'torchode/docs/jit.ipynb'. The code runs a for-loop and produces the desired output. However, when attempting to define an ensemble of models using vmap, it raises an error: "NotImplementedError: Module [AutoDiffAdjoint] is missing the required "forward" function".
import torch
import torch.nn as nn
import torchode as to
from functorch import combine_state_for_ensemble, vmap

torch.random.manual_seed(180819023)

class Model(nn.Module):
    def __init__(self, n_features, n_hidden):
        super().__init__()
        self.layers = nn.Sequential(
            nn.Linear(n_features, n_hidden),
            nn.Softplus(),
            nn.Linear(n_hidden, n_hidden),
            nn.Softplus(),
            nn.Linear(n_hidden, n_features)
        )

    def forward(self, t, y):
        return self.layers(y)

n_features = 5
model1 = Model(n_features=n_features, n_hidden=32)
model2 = Model(n_features=n_features, n_hidden=32)

dev = torch.device("cuda")

term1 = to.ODETerm(model1)
step_method1 = to.Dopri5(term=term1)
step_size_controller1 = to.IntegralController(atol=1e-6, rtol=1e-3, term=term1)
adjoint1 = to.AutoDiffAdjoint(step_method1, step_size_controller1).to(dev)

term2 = to.ODETerm(model2)
step_method2 = to.Dopri5(term=term2)
step_size_controller2 = to.IntegralController(atol=1e-6, rtol=1e-3, term=term2)
adjoint2 = to.AutoDiffAdjoint(step_method2, step_size_controller2).to(dev)

adjoint_jit1 = torch.compile(adjoint1)
adjoint_jit2 = torch.compile(adjoint2)

batch_size = 3
t_eval = torch.tile(torch.linspace(0.0, 3.0, 10), (batch_size, 1)).to(dev)
y0 = torch.zeros((batch_size, 5)).to(dev)
problem = to.InitialValueProblem(y0=y0, t_eval=t_eval)

# running a simple for-loop
models = [adjoint_jit1, adjoint_jit2]
sol = [model.solve(problem) for model in models] # Works fine

# defining an ensemble of models
fmodel, params, buffers = combine_state_for_ensemble(models)
[p.requires_grad_() for p in params]

sol_vmap = vmap(fmodel, in_dims=(0, 0, None))(params, buffers, problem)
# raises the error
# NotImplementedError: Module [AutoDiffAdjoint] is missing the required "forward" function

I would appreciate any guidance on how I can move forward from here.
Thank you for your time and expertise.

Thank you for your kind words. I am sorry to disappoint you but torchode is not compatible with torch.vmap. If you see a way to make them work together, I am open for a contribution but I don't have the capacity at the moment to take care of this myself.


Question: Is it possible to override or monkey patch validations?

Good afternoon,
I'm using stupidedi-1.4.0. My config is setup like this:
config = Stupidedi::Config.contrib.customize do |c|
  c.transaction_set.customize do |x|
    x.register("004010", "PO", "850") { Stupidedi::TransactionSets::FortyTen::Standards::PO850 }
  end
end

The b.PO1 line looks like this, which is how the vendor requires it to be sent.
b.PO1 "0001", "2", "CS", "18.93", nil, nil, "3516A", nil, "ZIPTOP2"

When I run my test, I see this error:
Stupidedi::Exceptions::ParseError: for segment PO1 Baseline Item Data, elements 6 must be present when elements 7 are present

The next vendor might require element 6 to be present. How can I modify the validations to be unique per vendor?
Thanks,
Frank

Hi Frank,
I think @irobayna may have more experience with PO-850, but to answer your question generally: the best way to go about customizing the grammar for a particular vendor is to make a copy of the definition and put it in your own namespace. In your case, you can copy the source for Stupidedi::TransactionSets::FortyTen::Standards::PO850 and name it MyApp::VendorABC::PO850.
Then you would change your configuration line accordingly. You should know those parameters to x.register are matched to elements in the input in a one-to-one relationship. That means if you have multiple vendors that all use the same GS01, GS08, ST03, you will need some other way to determine which grammar to use, and then use #configure for that vendor's grammar.
One other thing I should mention is there are two types of grammars. The first is TransactionSetDefs which only list all the segments, loops, and tables. Whether an element is required or not is assumed from the definition of each segment, it's not specified by the TransactionSetDef.
The other kind of grammar is an implementation Guide, which starts where the TransactionSetDef leaves off. It specifies element-level details like which are required or not. It also can decrease the number of occurrences of a segment or loop, and it can remove segments and loops so long as they aren't marked required by the TransactionSetDef. You can think of Guides as a subset of TransactionSetDefs because any input accepted by the former will be accepted by the ladder but not the other way around.
My suggestion is to copy an existing Guide for PO-850, rather than use a TransactionSetDef, and then make the changes you want. If there isn't already a Guide, you dont have to create one from scratch -- you can start by pasting the TransactionSetDefand then editing. There are many examples ofGuidesand you can compare them to their correspondingTransactionSetDef` to get an idea of what's involved in defining one.
Let me know if you have further questions and good luck!

Thank you for your detailed response, @kputnam!


fix typo in README.md

Replacing https://github.com/resque/resque-scheduler/pull/595

Arg, why is this not skipping?


rvgl-launcher: Add version <IP_ADDRESS>4a1

Closes https://github.com/ScoopInstaller/Extras/issues/10298

[x] I have read the Contributing Guide.

/verify

Thanks!

I looked at the tests and saw that the racelab manifest has a trailing white space in it. Could you fix it please?

I looked at the tests and saw that the racelab manifest has a trailing white space in it. Could you fix it please?

Should be fixed by https://github.com/Calinou/scoop-games/commit/9d90c9549e62bde4b44490a41b5d294bf5754a09 (if having no installer line is equivalent to an empty one… I don't remember).

Your welcome.


GitHub summary line of project is not correct

Mentions two languages - there are already more. "Very" might also be misleading.
Proposal: "Basic setup for the Anagrams kata"

Well spotted. Thx.
BR


GCM: check err when parsing config URL

In CreateGCMSink function, check err when parsing raw query string, make sure the opts is valid.
Like in NewKafkaClient, CreateElasticSearchService.
Signed-off-by: yupengzte<EMAIL_ADDRESS>

This change is

Thanks @DirectXMan12 .

Please do so for the commit message as well. Otherwise LGTM :+1:

/lgtm


fix translation error

Fix an important translation error

hi @vincent99 , this is an important Chinese translation error that needs to be merged before cut V2.6.3 version.  thanks.


Public domain license

A LICENSE file has been added to explicitly dedicate this work to the public domain. The Creative Commons Zero dedication is used: https://creativecommons.org/publicdomain/zero/1.0/legalcode.

Something weird is happening with Travis CI builds. The current master branch is now failing, and it is failing on the travis-sphinx build command. See https://travis-ci.org/tdenewiler/statick/builds/427989168. There are no statick issues reported. I'm going to approve this PR since it has the same cause for failure as the master branch.


[New Port Request] Vector Class Library  (x86_x64 SIMD abstraction layer)

Library name: Vector Class Library
Library description: It's the most comprehensive  c++ abstraction layer for SIMD (SSE...AVX512) on x86_x64 .  Written by Agner Fog , which means a lot.
Source repository URL:  https://github.com/vectorclass
It has 2 versions , version 2 requires c++17 support which is fair enough. v1 is legacy and unnecessary.
In same repository , it has an Add-on folder with extra functions for some common applications of vector processing  : vector3d, quaternion, decimal, complex and random.

PR #7573

Hi @am-randomBit
Thanks for posting this request.
Since this port has been added. please update vcpkg and try to use it. I'm closing this issue for now.


Tend to Solr 7.7+ upgrade

https://github.com/OpenSextant/Xponents/network/alert/pom.xml/org.apache.solr:solr-core/open

Solr 7.7 appears to be working.


Fix typo in FALSE_STRINGS and add their test

N is doubly defined. It should be F.

@takuti Thanks! The fix looks correct... can you just confirm, @muga?

oh, good catch.. 👍

Thanks. Merging...


Update the 'abstract' Section of PEP 458

Modify the abstract to target non-specialists and skip details of security concepts.

@r1chardj0n3s Would you prefer to review and merge the PEP updates as they come in yourself? I merged the title change, but realised it may be better for you to do it as a marker of "Yes, I've seen this change".

I'm not the only one who needs to see the changes, so I don't think it matters who merges them. I'll do this one tho :)


chore: update nimbus 23.6.1 -> 23.8.0

I also faced with some problems during nimbus upgrade to a new version, i'll try to investigate that in a separate branch

Found out that it maybe some bugs in nim from comments here. After switching to the latest nim version, it builds successfully.


Feature request: Screen re-/storing

I've been playing around with rich as of late and I am really enjoying it. :+1:
But there is one thing I wish was also in this wonderful chuck of code and that would be the ability to programmatically store and restore the terminal view (Like how less and other common commandline utilities do). I've got a somewhat working version of a decorator that I am using in my current project which I think some other people might find fairly useful. ;)
from contextlib import contextmanager
import subprocess

@contextmanager
def second_screen():
    try:
        r_code, s_code = (
            subprocess.getoutput(
                r"infocmp -1 | grep 'rmcup\|smcup' | sed 's/.*=\(.*\),/\1/'"
            )
            .replace("\\E", "\033")
            .split("\n")
        )
        try:
            print(s_code + "\033[0;0H", end="")
            yield
        finally:
            print(r_code, end="")
            return
    except:
        yield

I tried my hand at making it work with multiple different terminals by using infocmp to findout the proper escape sequence.
I am unsure if this is something that is considered inside the scope of this library, but imho I think it would by a great addition. I think the best way to integrate this into the API would be to add it as a member of the Console-class to enable the following usage:
from rich.console import Console

console = Console()

with console.second_screen():
    console.print("It works!", style="bold green")

EDIT: For me the escape sequences turn out to be:
s_code = '\033[?1049h\033[22;0;0t'
r_code = '\033[?1049l\033[23;0;0t'

So switch to secondary/primary buffer and re-/store icon and window title from/to stack respectively.

Hi @tim-fi
Glad you like Rich. I was planning on implementing a pager like less, so I would need something along these lines. Thanks for doing the research on that.

Yeah I saw that issue and was wondering to myself if I should simply give my two cents there, but I think the nicest way would be expose this kind of functionality to the user and then simply also use it for the pager.
Additionally I just did some digging, trying to find out if something like this could work on windows. (Obviously my implementation above does not due to the use of *nix commands to find out the control sequences…) And it turns out their Windows Console actually support at least the important sequences, at least according to their docs.

I was wondering how some other project (though in other languages) achieve a similar effect in terminals that don't support ANSI escape sequences and stumbled upon version of less that works on windows. They seem to either create a new ConsoleScreenBuffer using windows.h or simply print new lines until the screen is full.
PS: @willmcgugan I'm looking further into this on my own volition with no strings attached. I'm simply curious myself atm and thought that you might find some of the things I find use since have to some lengths to make rich as cross-platform as possible. :+1:

I'd probably not bother with legacy windows now that there is the option of the new Windows Terminal. Unless there is a low cost compatibility layer, like colorama.
Let me know what your research turns up!

So my final verdict is that this is only possible in cmd.exe if you use the low-level windows c api, as such I think the legacy support isn't really an option.
(This may not be 100% accurate but some people with a lot of points on SO seemed to come to this conclusion.)

I feared as much!

Closing this to tidy issues, but keeping a note of it.


make the buttons look clickable

the cursor should turn into a pointer when it's over the buttons

Great, thank you very much!


.eth support: submit application to ICANN for newgTLD round in 2020

Hi,
There are too many issues of cybersquatting and copyright infringments with Ethereum Name Service.
The ENS & Ethereum Foundations should apply for .eth support in the newgTLD ICANN round in 2020.
It would cost around 180K$ to submit it, and will allow to reduce cybersquatting thanks to improved UDRP requests customized for Ethereum blockchain use-case.
Thank you,
HLFH

We've already considered this; unfortunately 'eth' is the three letter ISO code for Ethiopia, so ICANN will not consider allocating it as a gTLD.

humm while many ccTLD of countries been subsidized or sponsored corporate and rebranded as of .Co and .Tv etc (Colombia, and Tuvalu) there might be something to be done here with Ethiopia, ... do they have control over it already?
maybe alternatively Ethereum Foundation should consider applications for .ether, .ethereum and .crypto


Create a Card component as discussed in #35. Also modify AppComponent…

… to be able to demo the Card.
This currently uses Snap.svg but I'm going to switch to plain SVG.
I still need to add the canvas and a service that handles the canvas actions and data.
I'm not going to merge this branch into master yet. For now, I'm going to keep working on this branch to avoid merge conflicts with Nati's changes.

But you have no tests!

LGTM

LGTM


[FatalFrameProjectZero][JPN]Resolution Issue

I've got the newest graphic packs and tested Fatal Frame. When I run US version, everything is OK, but when I run JPN version, there is a grid like thing on the screen. And I see there is a patches.txt, something like [USAFatalFrameV0], [EuropeFatalFrameV0] in it, but no JPN content. Can we get this fixed ~~~
THX a lot !

Can you try going to Debug> View RPL modules and send the Checksum please?

This is the resolution I set.

This is the GRID.

And this is debug info
The checksum there I see is
0xA86AA5B2

Hi, here is the updated patches.txt file. Hopefully it works out. :)

Unfortunately its not that simple, we also need the offsets to patch for the Japan Version. I don't have access to it yet. Perhaps sometime in the near future.

Is there anything I can do for help ?

I just found the offsets for the Japan version. Patching it as I write this. Almost done.


use fish_indent to indent files

Would be fantastic if this plugin supported using fish_indent

Leveraging fish_indent for automatic prettification of code is a pretty good idea. Setting it up as a build system option that comes with this package would be really straightforward, and I'll look into that
Unfortunately, fish_indent does not have an option to choose the indent: it's hardcoded to be 4 spaces. Great for people who indent their personal fish scripts with 4 spaces, no good for everyone else (eg, tabs, 2 spaces, etc). Passing a flag to fish_indent to use tabs would probably be ideal, as that would be the right output for tab users and for space users ST would autoconvert back to the internally-preferred number of spaces when it reloads the file. I'll open an issue asking about this

Never mind, fish-shell/fish-shell#3055 explicitly chose not to add such a feature as it has the potential to introduce inconsistent formatting within the project
Instead, we might still be able to leverage fish_indent, but pipe the output into something like sed (or write a short Python script; probably better for portability), to convert every 4 spaces from the start of a line into a tab character, then write that back over the original file

Nice! Sounds great to me.

Is it possible to make it run every time the file is saved instead of a build system? Or can you make the build run on every file save?

I think that can be done! I'll look into it as well

Thank you so much :)

On Jul 16, 2018, at 1:15 AM, Violet<EMAIL_ADDRESS>wrote:
I think that can be done! I'll look into it as well
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub https://github.com/Phidica/sublime-fish/issues/16#issuecomment-405150816, or mute the thread https://github.com/notifications/unsubscribe-auth/AJtY-bjQrkDdjNQEYeZhHCAjq0BAo04Pks5uHCFfgaJpZM4VQMZ-.

Hey, if you're interested in testing this feature I've pushed it to a new devel branch. You can follow the manual install instructions from the readme (to prevent a conflict, you may need to uninstall from Package Control if that's how you have the package currently), then git checkout devel to switch to the development version. See the changelog for details on what's in the current version, but it's basically keyboard shortcut, build system, and at-save execution options
I'm working on testing the feature on Windows, but it should work smoothly on both macOS and Linux. Let me know if you find any issues!

Awesome, thank you so much. Works great for me.
One thing I did notice is the example config doesn't include an extensions key but sublime text adds this field in into the config when you set it to use the fish syntax for all *.fish files (see #18 for why I did this)
	"extensions":
	[
		"fish"
	]

Is that a part of this plugin or something sublime specific? If sublime configuration, seems weird for it to be mixed in with with the rest of the config.

Yes, I believe Sublime does this. It is how it achieves the result of overriding the file extension preferences of other packages

Closed by the official release of 2.3.0 (dbe0df4)


Ultimate vm

Fixes and adds new features for use in the Volcanic Mine mini game.
See the ReadMe for a more detailed description.

Is this config group the same as any other vm plugin? Can you make it more specific to your plugin instead? (ex. "ultimate-volcanic-mine")
LGTM otherwise

Thanks, I've fixed the issue that you found. There were also bugs that I found and fixed since I first made this PR so
those changes are now in as well.


bug: if metadata isn't sent json sets it to null

Problem
meta data serialized incorrectly when set to None
Set it to an empty object

I don't know where this error is. Can you give more detail?

Yeah let me try to remember. I think it was in the was the data collection was serializing the metadata.


Requesting against LDAP

Hi team,
I am new on this site ... and very happy to have found it because it is very, very interesting.
but not sure it is the right place to ask this question but ... i read the guide and i didn't find a solution for that.
So ... i go ...
I am looking for a solution (VBA coded) in order to be sure only authorized people give me back the right data.
I want to send each of them an excel Workbook with instructions to use it and after completion, they should send it back to me.
EXCEL is required here because many calculations must be made.
AND HERE THE POINT ... this WB should only open if they give their current LDAP credentials = TheirUniqueOrganisationID/PW
This is the best solution i have imagined to be sure only people i need details from, will enter them in EXCEL.
Of course, i know UniqueOrganisationID of each and all of them.
So i have built Skelet of my WB and i am ready to send it to each of them ... with the UniqueOrganisationID set inside according to the recipient.
I only need the solution "to be sure my WB will be opened ONLY by the right person".
I have prepared the workbook_open proc : it asks for credentials:
Entered UniqueOrganisationID is compared with the one set inside.
If the same ... i need to know how :
1°) to send LDAP request containing this UniqueOrganisationID and entered PW (i have ONLY details concerning IP address and TCP port of my organisation LDAP)
2°) to get response from LDAP : if 1 = these credentials are currently operational ==> the provided username exist in my organisation and the provided PW is his current one (PW change every 90 days)
If these conditions are completed ==> WB will open and be under operation to be used by the right person.
Hope it is clear.
Hope you could help me.
In advance, many thanks for your assistance.
Regards
Pilou

Don't believe you can query LDAP with this HTTP library.
A person receiving your workbook will just disable VBA and none of your security will run.

Host the workbook in IIS with security set and send them the URL. They will have to authenticate against IIS (which will authenticate against your Active Directory) and if successful the workbook will be delivered to them.


Add build variation with std C++ iterator debugging disabled

iterator debugging has a bug that triggers a call to std::abort under low memory conditions.
Specifically, the default constructor for std::vector is marked as "noexcept" according to the C++ standard, but when iterator debugging is enabled, std::vector's default constructor calls new, which can throw std::bad_alloc. This triggers a call to std::abort, which breaks the low memory simulation.
Setting #define _ITERATOR_DEBUG_LEVEL 0 disables iterator debugging, but this shouldn't be the default for out tests.
The proposal is to only disable iterator debugging in a build used for low memory simulation.

Note:
It appears as if this might have been fixed in VS2022.

Fixed in VS2022 as far as I can tell. No need for this workaround anylonger.


[SPARK-25079][python] update python3 executable to 3.6.x

What changes were proposed in this pull request?
have jenkins test against python3.6 (instead of 3.4).
How was this patch tested?
extensive testing on both the centos and ubuntu jenkins workers.
NOTE:  this will need to be backported to all active branches.
PLEASE DO NOT MERGE

Test build #104173 has started for PR 24266 at commit 1d14800.

Thanks for taking a look for this @shaneknapp!

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/9513/
Test PASSed.

Test build #104173 has finished for PR 24266 at commit 1d14800.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/104173/
Test PASSed.

huh.  looks like pandas got downgraded for python2.7...  i'll check the versions installed on the jenkins workers tomorrow.
we've never supported pandas for pypy, so those skipped tests are expected.
however, all of the 3.6 tests passed!  woo!

Yea, that sounds all good. If I haven't missed something, Pandas of Python 2.7 was already low version too. Nice to see Python 3.6 got all passed. We have picked one version of Python 3.x so far so I don't think it matters the test coverage by this change - should be fine.

ok, fixed the centos workers' python2.7/pandas versioning:
$ pssh -h centos_workers.txt -t 0 -i "export PATH=/home/anaconda/bin:$PATH; python2.7 -c 'import pandas; print pandas.__version__'"
[1] 11:10:37 [SUCCESS] amp-jenkins-worker-03
0.19.2
[2] 11:10:37 [SUCCESS] amp-jenkins-worker-02
0.19.2
[3] 11:10:37 [SUCCESS] amp-jenkins-worker-05
0.19.2
[4] 11:10:37 [SUCCESS] amp-jenkins-worker-04
0.19.2
[5] 11:10:37 [SUCCESS] amp-jenkins-worker-06
0.19.2
[6] 11:10:37 [SUCCESS] amp-jenkins-worker-01
0.19.2

will retrigger a test now.

test this please

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/9558/
Test PASSed.

Merged build finished. Test PASSed.

Test build #104220 has started for PR 24266 at commit 1d14800.

Test build #104220 has finished for PR 24266 at commit 1d14800.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/104220/
Test FAILed.

argh...  spurious non-python failure.

test this please

Test build #104222 has started for PR 24266 at commit 1d14800.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/9560/
Test PASSed.

Merged build finished. Test PASSed.

Test build #104223 has started for PR 24266 at commit 1d14800.

Test build #104223 has finished for PR 24266 at commit 1d14800.

This patch fails PySpark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/104223/
Test FAILed.

Test build #104222 has finished for PR 24266 at commit 1d14800.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/104222/
Test PASSed.

Hi, @shaneknapp . Looks nice~
Finished test(python3.6): pyspark.sql.dataframe (50s)
Finished test(python3.6): pyspark.sql.functions (47s)
Tests passed in 1088 seconds

BTW, from the log, I'm wondering if we can change pip installation test together. It's using python 3.5. If it's beyond of the scope of this PR, it's okay for me.
...
Testing pip installation with python 3.5
Using /tmp/tmp.yP79vT0xxQ for virtualenv
Fetching package metadata ...........
Solving package specifications: .

Package plan for installation in environment /tmp/tmp.yP79vT0xxQ/3.5:

Hi, @shaneknapp . Looks nice~
Finished test(python3.6): pyspark.sql.dataframe (50s)
Finished test(python3.6): pyspark.sql.functions (47s)
Tests passed in 1088 seconds

BTW, from the log, I'm wondering if we can change pip installation test together. It's using python 3.5. If it's beyond of the scope of this PR, it's okay for me.

yep, definitely beyond the scope of this PR.

Test build #104223 has finished for PR 24266 at commit 1d14800.

This patch fails PySpark unit tests.
This patch merges cleanly.
This patch adds no public classes.

i'm really curious why this is suddenly popping up (from the console output of this build):
UnknownTimeZoneError: 'US/Pacific-New'

i noticed this yesterday, and went through and made sure that pytz was installed and at the same version across all workers...  which it is.  this failed on amp-jenkins-worker-05, but the next build passed on amp-jenkins-worker-02.
i'll poke around a bit more and see if i can't get to the bottom of things today...  if not today, then next week as i'm out thursday-sunday.

test this please

Test build #104256 has started for PR 24266 at commit 1d14800.

Oh, the test failure are on the master branch. I guess it's pytz issue.
UnknownTimeZoneError: 'US/Pacific-New'

@HyukjinKwon , @BryanCutler . Could you take a look on the master branch Python UT failures (5692 ~ 5696)?

https://amplab.cs.berkeley.edu/jenkins/view/Spark QA Test (Dashboard)/job/spark-master-test-sbt-hadoop-2.7/5696/console
https://amplab.cs.berkeley.edu/jenkins/view/Spark QA Test (Dashboard)/job/spark-master-test-sbt-hadoop-2.7/5692/console

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/9591/
Test PASSed.

Oh, it fails on branch-2.4, too.

https://amplab.cs.berkeley.edu/jenkins/view/Spark QA Test (Dashboard)/job/spark-branch-2.4-test-sbt-hadoop-2.7/356/console

Test build #104256 has finished for PR 24266 at commit 1d14800.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/104256/
Test PASSed.

So, hm, are all the tests failing already due to a Python update? I don't necessarily want to roll that back but is it a matter of updating pytz too everywhere? does it need to be updated separately for Python 2 vs 3?

btw I filed a separate jira on the US/Pacific-New thing: https://issues.apache.org/jira/browse/SPARK-27389.  I couldn't figure out what was going on either ...  It does seem like US/Pacific-New is some weird TZ that should never have really existed and isn't supported everywhere, but I can't figure out what has changed that is causing it to suddenly fail this.

Retest this please.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/9681/
Test PASSed.

Test build #104349 has started for PR 24266 at commit 1d14800.

Test build #104349 has finished for PR 24266 at commit 1d14800.

This patch fails PySpark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/104349/
Test FAILed.

So, hm, are all the tests failing already due to a Python update? I don't necessarily want to roll that back but is it a matter of updating pytz too everywhere? does it need to be updated separately for Python 2 vs 3?

see my comments here:  https://issues.apache.org/jira/browse/SPARK-27389
nothing has updated on the python2.7 side of things, and regardless, we're running the latest version of pytz (2018.9).  i can hack pytz's ___init.py___ as a work-around but that seems...  sad and frightening.

test this please

Test build #104439 has started for PR 24266 at commit 1d14800.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/9772/
Test PASSed.

Merged build finished. Test FAILed.

test this please

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/9777/
Test PASSed.

Test build #104446 has started for PR 24266 at commit 1d14800.

Test build #104446 has finished for PR 24266 at commit 1d14800.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/104446/
Test FAILed.

FFS, sbt is being flaky.
test this please

test this please

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/9784/
Test PASSed.

Test build #104455 has started for PR 24266 at commit 1d14800.

@shaneknapp , Arrow 0.12.1 is already available. Once this passes tests, I think you could install pyarrow 0.12.1 in the py3k env and that should also pass the current tests. After all that, changes in #24298 are ready and can be verified.

Test build #104455 has finished for PR 24266 at commit 1d14800.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/104455/
Test FAILed.

retest this please

Test build #104466 has started for PR 24266 at commit 1d14800.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/9796/
Test PASSed.

Test build #104466 has finished for PR 24266 at commit 1d14800.

This patch fails due to an unknown error code, -9.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/104466/
Test FAILed.

retest this please

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/9803/
Test PASSed.

Test build #104473 has started for PR 24266 at commit 1d14800.

Test build #104473 has finished for PR 24266 at commit 1d14800.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/104473/
Test PASSed.

@shaneknapp , Arrow 0.12.1 is already available. Once this passes tests, I think you could install pyarrow 0.12.1 in the py3k env and that should also pass the current tests. After all that, changes in #24298 are ready and can be verified.

okie dokie...  jenkins workers updated w/the new pyarrow:
$ pssh -h jenkins_workers.txt -t 0 -i "export PATH=/home/anaconda/bin:$PATH; source activate py36; conda list --explicit | grep pyarrow"
[1] 10:38:53 [SUCCESS] amp-jenkins-worker-05
https://conda.anaconda.org/conda-forge/linux-64/pyarrow-0.12.1-py36hbbcf98d_0.tar.bz2
[2] 10:38:54 [SUCCESS] amp-jenkins-worker-04
https://conda.anaconda.org/conda-forge/linux-64/pyarrow-0.12.1-py36hbbcf98d_0.tar.bz2
[3] 10:38:54 [SUCCESS] amp-jenkins-worker-06
https://conda.anaconda.org/conda-forge/linux-64/pyarrow-0.12.1-py36hbbcf98d_0.tar.bz2
[4] 10:38:54 [SUCCESS] amp-jenkins-worker-03
https://conda.anaconda.org/conda-forge/linux-64/pyarrow-0.12.1-py36hbbcf98d_0.tar.bz2
[5] 10:38:54 [SUCCESS] amp-jenkins-worker-01
https://conda.anaconda.org/conda-forge/linux-64/pyarrow-0.12.1-py36hbbcf98d_0.tar.bz2
[6] 10:38:54 [SUCCESS] amp-jenkins-worker-02
https://conda.anaconda.org/conda-forge/linux-64/pyarrow-0.12.1-py36hbbcf98d_0.tar.bz2

test this please

Test build #104490 has started for PR 24266 at commit 1d14800.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/9820/
Test PASSed.

Test build #104490 has finished for PR 24266 at commit 1d14800.

This patch fails PySpark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/104490/
Test FAILed.

omfg lol:
pytz.exceptions.UnknownTimeZoneError: 'US/Pacific-New'

(˚Õ˚)ر ~~~~╚╩╩╝

did this worker revolt against the fix?!  I guess lets try this again

retest this please

Test build #104521 has started for PR 24266 at commit 1d14800.

python3.6 revolted.  this is a "new" failure...  did something change in the tests?

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/9849/
Test PASSed.

did something change in the tests?

Only https://github.com/apache/spark/pull/24306 but it has nothing to do with timestamps or timezones..

did something change in the tests?

Only #24306 but it has nothing to do with timestamps or timezones..

the tests pass when i run them manually on the ubuntu workers...  i can't wait to reimage the centos boxes.
anyways, i'll patch up the centos workers later today and this should go away.

Test build #104521 has finished for PR 24266 at commit 1d14800.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/104521/
Test PASSed.

Test build #104521 has finished for PR 24266 at commit 1d14800.

so, this build passed on amp-jenkins-worker-02, and failed on -05 (which was one of the workers that initially had this issue).
i just finished manually running these tests on both of these workers, and 02 passed while 05 failed (as expected).
the python 3.6 envs on both machines are identical, which i confirmed by checking conda list --explicit and pip list.
i'm now resorting to strace to see if i can spot any system-level differences.  :(

Thank you so much for spending much time on this, @shaneknapp !

well, i got the tests to pass on worker-05:
sknapp@amp-jenkins-worker-05 US]$ sudo mv /usr/share/zoneinfo/USPacific-New /tmp

however, that tzdata file is present and in the same location on the other workers that AREN'T failing tests.
¯_(ツ)_/¯

well, i got the tests to pass on worker-05:
sknapp@amp-jenkins-worker-05 US]$ sudo mv /usr/share/zoneinfo/US/Pacific-New /tmp

however, that tzdata file is present and in the same location on the other workers that AREN'T failing tests.
¯_(ツ)_/¯

so, to test whether or not (re)moving the Pacific-New timezone data file to /tmp actually works on all machines, i did the same thing on -03:
sknapp@amp-jenkins-worker-03 US]$ sudo mv /usr/share/zoneinfo/US/Pacific-New /tmp
i then ran the python tests, and they failed.
seriously, i think my brain is about to (im|ex)plode.

test this please

Test build #104561 has started for PR 24266 at commit 1d14800.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/9885/
Test PASSed.

Test build #104561 has finished for PR 24266 at commit 1d14800.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/104561/
Test PASSed.

ok, i think this is ready to be merge/deployed next week.  i'll send out an
email to dev@ and get this scheduled.
On Fri, Apr 12, 2019 at 6:30 PM UCB AMPLab<EMAIL_ADDRESS>wrote:

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/104561/
Test PASSed.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/apache/spark/pull/24266#issuecomment-482764990, or mute
the thread
https://github.com/notifications/unsubscribe-auth/ABiDrJ8WxD9o9CqWeMUkCJFMUD_ey-Dxks5vgTMugaJpZM4cWyjH
.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/9991/
Test PASSed.

Test build #104671 has started for PR 24266 at commit ba77b41.

Test build #104671 has finished for PR 24266 at commit ba77b41.

This patch fails PySpark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/104671/
Test FAILed.

test this please

Test build #104680 has started for PR 24266 at commit ba77b41.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/9998/
Test PASSed.

Test build #104680 has finished for PR 24266 at commit ba77b41.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/104680/
Test PASSed.

retest this please

I think it's good to go

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/10018/
Test PASSed.

Test build #104700 has started for PR 24266 at commit ba77b41.

I think it's good to go

yep, i think so too!  let's wait for the build to finish...

Test build #104700 has finished for PR 24266 at commit ba77b41.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/104700/
Test PASSed.

Merged to master.
Thank you so much, @shaneknapp

Thank you, @shaneknapp and @HyukjinKwon .
Since this is an official Python 3.6 community support, can we have this on branch-2.4/2.3 too?
I monitored #24379 and #24380 , but I'm not sure which one will land on branch-2.4/2.3.
cc @dbtsai and @mattf-apache

Thank you, @shaneknapp and @HyukjinKwon .
Since this is an official Python 3.6 community support, can we have this on branch-2.4/2.3 too?
I monitored #24379 and #24380 , but I'm not sure which one will land on branch-2.4/2.3.
cc @dbtsai and @mattf-apache

since @HyukjinKwon jumped the gun a little bit and merged this to master, i'm going to try and accelerate the schedule and deploy the new python envs for these two branches today.  if not today, then monday.

Thank you!


Feature details should be an empty page when landing on the registry page

Dont load detail page view if there is not selected-name or new-feature set
Added some more loading and extracted to a helper function to not repeat code
After save a new feature set it as selected feature

👍


Learn: Build tools: add 'The SCons build system' section

This request offers the extension of Learn - Building programs - Build Tools with information about SCons build system. I don't use this build system (I see it only on packaging of Cantera), but the information about it might be interesting. Maybe the info about additional syntax of source files list representation is excessive.
The language of text definitely needs editing.
P.S.
Additional commit is to fix URLs.

Thanks for this submission @band-a-prend . I've never used SCons and don't know anybody that uses it, but it seems to be still maintained/developed. It's likely that it will be useful for some readers. If there are no objections, let's review it, edit it, and merged to main when ready.

I think I need to extrude the "typo" fixes to external PR.
As for this PR: if info about source list stays then it could be placed as tip and info about documentation could be made just as common text.

I move URL fixes for other sections to another pull request.

#build_preview

@band-a-prend , Do you think this PR is good to merge as it seems to be a useful addition to the webpage.

@henilp105
Yes, I think it's ready.
If it's needed I could rebase the commit against current state but it seems there shouldn't be conflicts.

Great thanks!


What is the purpose of an array?

What is the purpose of an array?
A. To store data in an organized fashion.
B. To store data only of the same type.
C. To organize data at lettered positions.
D. To organize data into key-value pairs.

Answer: A. To store data in an organized fashion.