Heap memory limit error

Hi Pylance team,
Thank you so much for providing this great extension. It significantly improves my python development performance. How can I increase the heap memory limit for the extension so that I can prevent the error logged below?
Environment data

Language Server version: 2020.7.2
OS and version: macOS 10.14.6
Python version (& distribution if applicable, e.g. Anaconda): 3.7

Logs

FATAL ERROR: Ineffective mark-compacts near heap limit Allocation failed - JavaScript heap out of memory
 1: 0x10cd3e7d5 node::Abort() [/Applications/Visual Studio Code - Insiders.app/Contents/Frameworks/Electron Framework.framework/Versions/A/Electron Framework]
 2: 0x10cd3e844 node::Abort() [/Applications/Visual Studio Code - Insiders.app/Contents/Frameworks/Electron Framework.framework/Versions/A/Electron Framework]
 3: 0x108b39097 v8::internal::FatalProcessOutOfMemory(v8::internal::Isolate*, char const*) [/Applications/Visual Studio Code - Insiders.app/Contents/Frameworks/Electron Framework.framework/Versions/A/Electron Framework]
 4: 0x108b39037 v8::internal::FatalProcessOutOfMemory(v8::internal::Isolate*, char const*) [/Applications/Visual Studio Code - Insiders.app/Contents/Frameworks/Electron Framework.framework/Versions/A/Electron Framework]
 5: 0x108cc84a5 v8::internal::Heap::StartIdleIncrementalMarking(v8::internal::GarbageCollectionReason, v8::GCCallbackFlags) [/Applications/Visual Studio Code - Insiders.app/Contents/Frameworks/Electron Framework.framework/Versions/A/Electron Framework]
 6: 0x108cc9b3d v8::internal::Heap::StartIdleIncrementalMarking(v8::internal::GarbageCollectionReason, v8::GCCallbackFlags) [/Applications/Visual Studio Code - Insiders.app/Contents/Frameworks/Electron Framework.framework/Versions/A/Electron Framework]
 7: 0x108cc6239 v8::internal::Heap::CreateFillerObjectAt(unsigned long, int, v8::internal::ClearRecordedSlots, v8::internal::ClearFreedMemoryMode) [/Applications/Visual Studio Code - Insiders.app/Contents/Frameworks/Electron Framework.framework/Versions/A/Electron Framework]
 8: 0x108cc3a8a v8::internal::Heap::CollectGarbage(v8::internal::AllocationSpace, v8::internal::GarbageCollectionReason, v8::GCCallbackFlags) [/Applications/Visual Studio Code - Insiders.app/Contents/Frameworks/Electron Framework.framework/Versions/A/Electron Framework]
 9: 0x108ccf83a v8::internal::Heap::PromotedExternalMemorySize() [/Applications/Visual Studio Code - Insiders.app/Contents/Frameworks/Electron Framework.framework/Versions/A/Electron Framework]
10: 0x108ccf8c1 v8::internal::Heap::PromotedExternalMemorySize() [/Applications/Visual Studio Code - Insiders.app/Contents/Frameworks/Electron Framework.framework/Versions/A/Electron Framework]
11: 0x108ca293d v8::internal::Factory::NewContext(v8::internal::Handle<v8::internal::Map>, int, int, v8::internal::AllocationType) [/Applications/Visual Studio Code - Insiders.app/Contents/Frameworks/Electron Framework.framework/Versions/A/Electron Framework]
12: 0x108ca3beb v8::internal::Factory::NewBlockContext(v8::internal::Handle<v8::internal::Context>, v8::internal::Handle<v8::internal::ScopeInfo>) [/Applications/Visual Studio Code - Insiders.app/Contents/Frameworks/Electron Framework.framework/Versions/A/Electron Framework]
13: 0x10903c213 v8::internal::Runtime::SetObjectProperty(v8::internal::Isolate*, v8::internal::Handle<v8::internal::Object>, v8::internal::Handle<v8::internal::Object>, v8::internal::Handle<v8::internal::Object>, v8::internal::StoreOrigin, v8::Maybe<v8::internal::ShouldThrow>) [/Applications/Visual Studio Code - Insiders.app/Contents/Frameworks/Electron Framework.framework/Versions/A/Electron Framework]
14: 0x1095aab59 v8::internal::SetupIsolateDelegate::SetupHeap(v8::internal::Heap*) [/Applications/Visual Studio Code - Insiders.app/Contents/Frameworks/Electron Framework.framework/Versions/A/Electron Framework]<--- Last few GCs --->[96760:0x1074d9000]   127420 ms: Scavenge 4090.4 (4100.8) -> 4089.9 (4101.3) MB, 3.7 / 0.0 ms  (average mu = 0.234, current mu = 0.169) allocation failure
[96760:0x1074d9000]   130555 ms: Mark-sweep 4090.8 (4101.3) -> 4088.4 (4100.5) MB, 3129.4 / 0.0 ms  (+ 0.0 ms in 11 steps since start of marking, biggest step 0.0 ms, walltime since start of marking 3135 ms) (average mu = 0.144, current mu = 0.043) alloca<--- JS stacktrace --->==== JS stack trace =========================================    0: ExitFrame [pc: 0x1095aab59]
    1: StubFrame [pc: 0x109627f49]
Security context: 0x16a73ac19581 <JSObject>
    2: _consumeTokensUntilType [0x16a7bc7f1f01] [/Users/mohammad/.vscode-insiders/extensions/ms-python.vscode-pylance-2020.7.2/server/pyright.bundle.js:1] [bytecode=0x16a8460f8629 offset=2](this=0x16a7ef0d10f9 <g map = 0x16a79e2e1191>,0x16a7ef0d4831 <JSArray[1]>)
    3: _parseSimpleStatement [0x16a7bc7f1251] [/Users/mohammad...

[Info  - 7:17:54 AM] Connection to server got closed. Server will restart.
[Error - 7:17:54 AM] Request textDocument/references failed.
Error: Connection got disposed.
	at Object.dispose (/Users/mohammad/.vscode-insiders/extensions/ms-python.python-2020.7.94776/out/client/extension.js:46:82126)
	at Object.dispose (/Users/mohammad/.vscode-insiders/extensions/ms-python.python-2020.7.94776/out/client/extension.js:1:285194)
	at v.handleConnectionClosed (/Users/mohammad/.vscode-insiders/extensions/ms-python.python-2020.7.94776/out/client/extension.js:1:285406)
	at v.handleConnectionClosed (/Users/mohammad/.vscode-insiders/extensions/ms-python.python-2020.7.94776/out/client/extension.js:46:33706)
	at t (/Users/mohammad/.vscode-insiders/extensions/ms-python.python-2020.7.94776/out/client/extension.js:1:283515)
	at invoke (/Users/mohammad/.vscode-insiders/extensions/ms-python.python-2020.7.94776/out/client/extension.js:1:437528)
	at s.fire (/Users/mohammad/.vscode-insiders/extensions/ms-python.python-2020.7.94776/out/client/extension.js:1:438289)
	at Q (/Users/mohammad/.vscode-insiders/extensions/ms-python.python-2020.7.94776/out/client/extension.js:46:71691)
	at invoke (/Users/mohammad/.vscode-insiders/extensions/ms-python.python-2020.7.94776/out/client/extension.js:1:437528)
	at s.fire (/Users/mohammad/.vscode-insiders/extensions/ms-python.python-2020.7.94776/out/client/extension.js:1:438289)
	at l.fireClose (/Users/mohammad/.vscode-insiders/extensions/ms-python.python-2020.7.94776/out/client/extension.js:46:62144)
	at ChildProcess.<anonymous> (/Users/mohammad/.vscode-insiders/extensions/ms-python.python-2020.7.94776/out/client/extension.js:1:223765)
	at ChildProcess.emit (events.js:215:7)
	at maybeClose (internal/child_process.js:1021:16)
	at Socket.<anonymous> (internal/child_process.js:430:11)
	at Socket.emit (events.js:210:5)
	at Pipe.<anonymous> (net.js:658:12)
[Error - 7:17:54 AM] Request textDocument/codeAction failed.
Error: Connection got disposed.
	at Object.dispose (/Users/mohammad/.vscode-insiders/extensions/ms-python.python-2020.7.94776/out/client/extension.js:46:82126)
	at Object.dispose (/Users/mohammad/.vscode-insiders/extensions/ms-python.python-2020.7.94776/out/client/extension.js:1:285194)
	at v.handleConnectionClosed (/Users/mohammad/.vscode-insiders/extensions/ms-python.python-2020.7.94776/out/client/extension.js:1:285406)
	at v.handleConnectionClosed (/Users/mohammad/.vscode-insiders/extensions/ms-python.python-2020.7.94776/out/client/extension.js:46:33706)
	at t (/Users/mohammad/.vscode-insiders/extensions/ms-python.python-2020.7.94776/out/client/extension.js:1:283515)
	at invoke (/Users/mohammad/.vscode-insiders/extensions/ms-python.python-2020.7.94776/out/client/extension.js:1:437528)
	at s.fire (/Users/mohammad/.vscode-insiders/extensions/ms-python.python-2020.7.94776/out/client/extension.js:1:438289)
	at Q (/Users/mohammad/.vscode-insiders/extensions/ms-python.python-2020.7.94776/out/client/extension.js:46:71691)
	at invoke (/Users/mohammad/.vscode-insiders/extensions/ms-python.python-2020.7.94776/out/client/extension.js:1:437528)
	at s.fire (/Users/mohammad/.vscode-insiders/extensions/ms-python.python-2020.7.94776/out/client/extension.js:1:438289)
	at l.fireClose (/Users/mohammad/.vscode-insiders/extensions/ms-python.python-2020.7.94776/out/client/extension.js:46:62144)
	at ChildProcess.<anonymous> (/Users/mohammad/.vscode-insiders/extensions/ms-python.python-2020.7.94776/out/client/extension.js:1:223765)
	at ChildProcess.emit (events.js:215:7)
	at maybeClose (internal/child_process.js:1021:16)
	at Socket.<anonymous> (internal/child_process.js:430:11)
	at Socket.emit (events.js:210:5)
	at Pipe.<anonymous> (net.js:658:12)
[Info  - 7:17:54 AM] Pylance language server 2020.7.2 starting
[Info  - 7:17:54 AM] Server root directory: /Users/mohammad/.vscode-insiders/extensions/ms-python.vscode-pylance-2020.7.2/server
[Info  - 7:17:54 AM] No configuration file found.
[Info  - 7:17:54 AM] Setting pythonPath for service "tracking": "/Users/mohammad/miniconda3/envs/tracking/bin/python"
[Info  - 7:17:54 AM] stubPath /Users/mohammad/workspace/tracking/typings is not a valid directory.
[Info  - 7:17:54 AM] Assuming Python version 3.7
[Info  - 7:17:54 AM] Assuming Python platform Darwin
[Info  - 7:17:54 AM] Searching for source files
[Info  - 7:17:54 AM] Found 377 source files

I have tried opening vscode using code-insiders --max-memory 16000 too, but I got the same results.

I've been seeing similar right when pylance starts with a workspace containing several different python package folders. It goes through several loops of the following, then dies. I've had to uninstall the extension since it fails on every start.
vscode: 1.48.2
pylance: 2020.9.0
[Info  - 2:06:56 PM] Pylance language server 2020.9.0 (pyright 60eb2cca) starting
[Info  - 2:06:56 PM] Server root directory: /home/jkatz/.vscode-server/extensions/ms-python.vscode-pylance-2020.9.0/dist
[Error - 2:06:57 PM] stubPath typings is not a valid directory.
[Error - 2:06:58 PM] stubPath typings is not a valid directory.
[Error - 2:06:58 PM] stubPath typings is not a valid directory.
[Error - 2:06:58 PM] stubPath typings is not a valid directory.

<--- Last few GCs --->

[3628:0x7f9604000ad0]    34935 ms: Mark-sweep 2025.9 (2064.9) -> 2020.6 (2065.9) MB, 1888.4 / 0.0 ms  (average mu = 0.119, current mu = 0.042) allocation failure scavenge might not succeed
[3628:0x7f9604000ad0]    36729 ms: Mark-sweep 2024.0 (2065.9) -> 2021.8 (2083.4) MB, 1738.1 / 0.0 ms  (average mu = 0.074, current mu = 0.032) allocation failure GC in old space requested

<--- JS stacktrace --->

==== JS stack trace =========================================

    0: ExitFrame [pc: 0x1a93942]
    1: StubFrame [pc: 0x1aed1dc]
Security context: 0x0e43eec9a2f1 <JSObject>
    2: _handleNewLine [0x1a974bc16de9] [/home/jkatz/.vscode-server/extensions/ms-python.vscode-pylance-2020.9.0/dist/pyright.bundle.js:1] [bytecode=0x21a4efafe401 offset=0](this=0x35483e59daf9 <JSObject>,1,1)
    3: _handleCharacter [0x1a974bc16d79] [/home/jkatz/.vscode-server/extensions/ms-python.vscode-pylance-2020.9.0/dist/pyri...

FATAL ERROR: Ineffective mark-compacts near heap limit Allocation failed - JavaScript heap out of memory
 1: 0x98edf0 node::Abort() [/home/jkatz/.vscode-server/bin/a0479759d6e9ea56afa657e454193f72aef85bd0/node]
 2: 0x98fe56 node::OnFatalError(char const*, char const*) [/home/jkatz/.vscode-server/bin/a0479759d6e9ea56afa657e454193f72aef85bd0/node]
 3: 0xb1552e v8::Utils::ReportOOMFailure(v8::internal::Isolate*, char const*, bool) [/home/jkatz/.vscode-server/bin/a0479759d6e9ea56afa657e454193f72aef85bd0/node]
 4: 0xb158a9 v8::internal::V8::FatalProcessOutOfMemory(v8::internal::Isolate*, char const*, bool) [/home/jkatz/.vscode-server/bin/a0479759d6e9ea56afa657e454193f72aef85bd0/node]
 5: 0xf20105  [/home/jkatz/.vscode-server/bin/a0479759d6e9ea56afa657e454193f72aef85bd0/node]
 6: 0xf2aa6b v8::internal::Heap::PerformGarbageCollection(v8::internal::GarbageCollector, v8::GCCallbackFlags) [/home/jkatz/.vscode-server/bin/a0479759d6e9ea56afa657e454193f72aef85bd0/node]
 7: 0xf2b787 v8::internal::Heap::CollectGarbage(v8::internal::AllocationSpace, v8::internal::GarbageCollectionReason, v8::GCCallbackFlags) [/home/jkatz/.vscode-server/bin/a0479759d6e9ea56afa657e454193f72aef85bd0/node]
 8: 0xf2df44 v8::internal::Heap::AllocateRawWithLightRetry(int, v8::internal::AllocationType, v8::internal::AllocationAlignment) [/home/jkatz/.vscode-server/bin/a0479759d6e9ea56afa657e454193f72aef85bd0/node]
 9: 0xf036ab v8::internal::Factory::TryNewCode(v8::internal::CodeDesc const&, v8::internal::Code::Kind, v8::internal::Handle<v8::internal::Object>, int, v8::internal::MaybeHandle<v8::internal::ByteArray>, v8::internal::MaybeHandle<v8::internal::DeoptimizationData>, v8::internal::Movability, bool, int) [/home/jkatz/.vscode-server/bin/a0479759d6e9ea56afa657e454193f72aef85bd0/node]
10: 0xc25d43 v8::internal::compiler::CodeGenerator::FinalizeCode() [/home/jkatz/.vscode-server/bin/a0479759d6e9ea56afa657e454193f72aef85bd0/node]
11: 0xd9ffef v8::internal::compiler::PipelineImpl::FinalizeCode(bool) [/home/jkatz/.vscode-server/bin/a0479759d6e9ea56afa657e454193f72aef85bd0/node]
12: 0xda0ff6 v8::internal::compiler::PipelineCompilationJob::FinalizeJobImpl(v8::internal::Isolate*) [/home/jkatz/.vscode-server/bin/a0479759d6e9ea56afa657e454193f72aef85bd0/node]
13: 0xc16d50 v8::internal::Compiler::FinalizeOptimizedCompilationJob(v8::internal::OptimizedCompilationJob*, v8::internal::Isolate*) [/home/jkatz/.vscode-server/bin/a0479759d6e9ea56afa657e454193f72aef85bd0/node]
14: 0xc1090b v8::internal::OptimizingCompileDispatcher::InstallOptimizedFunctions() [/home/jkatz/.vscode-server/bin/a0479759d6e9ea56afa657e454193f72aef85bd0/node]
15: 0xec78be v8::internal::StackGuard::HandleInterrupts() [/home/jkatz/.vscode-server/bin/a0479759d6e9ea56afa657e454193f72aef85bd0/node]
16: 0x11cb005 v8::internal::Runtime_StackGuard(int, unsigned long*, v8::internal::Isolate*) [/home/jkatz/.vscode-server/bin/a0479759d6e9ea56afa657e454193f72aef85bd0/node]
17: 0x1a93942  [/home/jkatz/.vscode-server/bin/a0479759d6e9ea56afa657e454193f72aef85bd0/node]
[Info  - 2:07:35 PM] Connection to server got closed. Server will restart.

should be fixed in 2020.9.4

Does anyone know what exactly was fixed here? I am also trying to load a massive python project with Pylance and getting the same error. Maybe @heejaechang ? (sorry I know this issue is extremely old)
The pylance server loads files until it hits 2GB of memory and then crashes with a JavaScript heap out of memory error.

so, we added something that will dump caches if memory hit certain threshold. but sounds like it didn't work out as we hope in certain cases.
Can you provide us some logs as described in the troubleshooting guide?
that will give us some idea on how our cache management hook worked.

Also, please file a new bug. This one was closed nearly three years ago. The problem you're seeing may have similar symptoms, but it's almost definitely not the same underlying issue as this one.

Created a new issue: https://github.com/microsoft/pylance-release/issues/4121


Maliamungu Richard profile

Name
Maliamungu Richard
Languages
English - very good, Arabic - perfect, Kakwa- perfect , Pojulu - good  , Kiswahili- fair
Skill 1
Web and software
Qualifications for Skill 1
I learned Arduino programming , software installation by myself and guidance from the #ASKnet team members and had
an Open tech Introduction event in Cameroon in Dec, 2021 , The participants had there first hands-on practice on software Installation and Arduino programming.
Skill 2
Hardware and repair
Qualifications for Skill 2
The first hands-on repair cafe was conducted by r0g agency in partnership with Cten Uganda in Eden Rhino camp refugee settlement in 2018 where I had my first repair cafe experience . Later on, organized a community repair cafe event and fixed a good  number of Electronics and mechanical devices . In the tech and repair skills for livelyhood project, I including a great team members, we trained 20 participants in basic mechanical and electronic repair. And set up a community repair space  which now is used for training young men on repair culture and open source hardware and software
Skill 3
Open source and knowledge
Qualifications for Skill 3
In 2019 media event in organized by Youth empowerment foundation in adjumany , I had my first experience in git hub repo + issues creation by Timm wille, I was doubling up as a participant and same time Adjuct trainer . Later on helped some #ASKnet teams to create profiles up-to-date.
Skill 4
Media and art
Qualifications for Skill 4
Have a good knowledge on GIMP, Audacity and kdenlive. created number of contents using the software
LinkedIn
https://www.linkedin.com/in/maliamungu-richard-5b14b114b
Facebook
https://m.me/MaliamunguRich
Email.
<EMAIL_ADDRESS>###Telegram
@malia6066
###Instagram
@maliamungurichard

Hi @maliarich we all know you so I'm pretty sure if we go for the verification process as mentioned in #85 many will testify but for some activities you got certificates right? I can look for them too but you might have them quicker at hand :)

Also your activity in the past trainings 2019 and 2020 as co-trainer are relevant to mention as experience. you might want to link to some repositories or the respective issue section where your activity can be seen...

Hi @timmwille  thanks for the reminder ... I'll definitely add soonest

Hi @timmwille thanks for the reminder ... I'll definitely add soonest

I have been following this @maliarich  but ur response is over due . what's up?

Hi @timmwille
Help me upload the certificates, I did some slight changes.

@chardso I had been involved in series of trainings from the past 1/2 months upto today where i have limited access to power and good internet ( can't open links )
I am in Arua today but had to go back today 😁 for the lab mobile tour in the camp for the whole week +
@chardso  feel free to remind me through direct phone calls sometimes
Cheers.

@maliarich any online material you would like to link here? for Upload contact me via Chat again, I might have missed this somewhere?
in best case also reference repositories or even Facebook or Telegram news you shared or other reference URLs to link where one can see some material/action

Okay. @timmwille

yeah, Timm.

I suggest this as a description,  Maliamungu Richard is a highly motivated and driven South Sudanese individual, currently residing in the Eden Rhino Camp refugee settlement in Uganda. His passion for technology and the environment stems from the adverse effects of the civil war that erupted in South Sudan in 2016. Despite the challenges, Maliamungu took initiative and pursued self-education by reading open-source books, which led him to participate in numerous open tech events and later become an Adjunct Trainer for the r0g agency during the 2020 ASKnet project.
With a strong commitment to his community, Maliamungu is dedicated to promoting environmentally responsible practices through the creation of repair cafes in the Rhino Camp refugee settlement. He is focused on transforming broken devices and plastic materials into useful resources, ultimately building a community that prioritizes sustainability and waste reduction.

I like the description @romeoplat , CC4D should surface somewhere instead of the E- waste.  I can't easily subtract or add, your grammar reads like a ChatGPT translate 😂.


Cache Doesn't Appear to Flush After SaveChanges()

Summary of the issue
We are running into what appears to be a cache flush issue when a new record is added.  In our case we query a table for a record something simple:
var debugger = new EFCacheDebugInfo();
(IQueryable).Where(x=>x.Column1 == "ABC" && x.Column2="XYZ").Cacheable(debugger).FirstOrDefault()

The result is null which is expected, since the result is null we go to another table and load the record.  SaveChanges is called and InvalidateCacheDependencies(changedEntityNames); fires as expected, changedEntityNames contains the changed entity.  We even tried using ClearAllCachedEntries() but the result was the same.
Later when we query for that record again the we are getting null back still and debugger.IsCacheHit == true.  We are expecting IsCacheHit to be false and the query to go back to the database and get the newly added entity.
If we restart the app after the record is added everything works correctly, which is why we are leaning towards the cache flushing.
The app in question is a .Net Core Console app (v.2.2) using a .Net Standard 2.0 library dll where the caching takes place.  The dll is a plugin, and loaded via MEF.
We have configured the second level cache in ConfigureServices like so:
// Add an in-memory cache service provider
services.AddEFSecondLevelCache();
services.AddSingleton(typeof(ICacheManager<>), typeof(BaseCacheManager<>));
services.AddSingleton(typeof(ICacheManagerConfiguration),
   new CacheManager.Core.ConfigurationBuilder("Mx.DataLoad")
      .WithJsonSerializer()
      .WithMicrosoftLogging(loggerFactory)
      .WithMicrosoftMemoryCacheHandle()
      .WithExpiration(ExpirationMode.Absolute, TimeSpan.FromMinutes(Configuration.GetValue("Caching:ExpirationInMinutes", 60)))
   .Build());

// Additional code to spin up our ServiceProvider
var serviceProvider = services.BuildServiceProvider();
EFServiceProvider.ApplicationServices = serviceProvider;

Environment
The in-use version: 1.7.1
Operating system: Windows 10
IDE: VS 2017

Packages
<PackageReference Include="EFSecondLevelCache.Core" Version="1.7.1" />
<PackageReference Include="CacheManager.Core" Version="1.2.0" />
<PackageReference Include="CacheManager.Microsoft.Extensions.Caching.Memory" Version="1.2.0" />
<PackageReference Include="CacheManager.Serialization.Json" Version="1.2.0" />
<PackageReference Include="CacheManager.Microsoft.Extensions.Logging" Version="1.2.0" />

Questions
Is there a way to visualize the cache so we can see what is going on at each step?
Any suggestions on where to look to isolate the issue?

Hopefuly V1.8.1 fixes this issue. Now caching mechanism acts as a true singleton!


[WIP] Spark cassandra

This PR introduces a new connector called spark-cassandra. This connector is based on sparkcore and it gives ability to mount Quasar to Cassandra instance.
Keyspaces are representing folders, tables are representing files.
Current limitation: connector works with single column tables that hold JSON String as a value.
TODO:

[ ]  All tests (unit & integration) are passing except for one: QueryFilesSpec."executing query to an existing file overwrites with results"
[ ]  Cassandra's keyspaces (here folders in FS) work only with alphanumeric characters - we need to handle errors when user provides a character out of the alphanumeric set

Possible further improvements:

[ ] Remove the "single JSON column" limitation & be able to represent any Cassandra table
[ ]  cassandra.common should be represented as algebra (e.g CassandraDDL[A]) so that it can be later used and interpreted as Free[CassandraDDL, A]

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.1 out of 2 committers have signed the CLA.:white_check_mark: rabbitonweb:x: marekklisYou have signed the CLA already but the status is still pending? Let us recheck it.

This PR has to be closed (and reopened under new PR https://github.com/quasar-analytics/quasar/pull/2582) because of Travis bug (Travis is somehow reading old configuration trying to execute script (initConnector) that no longer exists). https://github.com/quasar-analytics/quasar/pull/2582 is the same PR as this one, but is not effected by the Trvis bug


Meteor integration

Hey guys,
This PR lets you publish Bootstrap to Atmosphere, the package repository for Meteor.js. Between Meteor's 21k stars and Bootstrap's 75k, we hope to get even more users to both projects.
I've included the Meteor publishing task in Grunt's dist task, and have already published the current version, so there's nothing to do for now.
Best regards,
Dan & a bunch of Meteor 3rd party library maintainers

@twbs/team Pinging for more opinions. We should try to come to a decision on this.

@dandv Based on https://groups.google.com/forum/m/#!topic/meteor-core/DPd6XK4Ow-w , sounds like the Meteor devs are against non-native-Meteor Atmosphere packages, like this would be?

@cvrebert The Nov 2014 Google Groups thread is rather old; the current consensus is at https://github.com/percolatestudio/atmosphere/issues/297#issuecomment-67787990. TL;DR - if this PR isn't accepted, it's no big deal; we'll host the integration in the MeteorPackaging repo. Meteor are for Meteor integrations on Atmosphere for non-native-Meteor (i.e. 3rd party) packages like Bootstrap.

I think I'm a pass on this unfortunately. It's not something most of us on the Bootstrap team use at this time and as we're trying to keep things super lightweight on our end (especially as we head into v4), this would be a bit of a step in the opposite direction. I understand the usefulness though, and deeply appreciate your level of commitment to this effort. That goes a long way in my book :).
Let us know how we can help put some attention from others on this. We have the Expo resources page, but if this is a separate package, feel free to ask for a tweet or two about this down the line.
<3


Conflict with featherlight

I'm using featherlight (https://github.com/noelboss/featherlight/) to popup dialogs and I was planning on using tooltipster inside of one.
When the tooltip first pops up, however, the featherlight background disappears.
.featherlight:last-of-type {
	background: rgba(0, 0, 0, 0.8);
}

What's weird is that once the tooltip is hidden the background reappears but the tooltip doesn't break the background if it is redisplayed.

Hi, I guess that's because your featherlight div is not the last div anymore when the tooltip has been appended to the body.

I didn't realise ":last-of-type" was element rather than class specific. How come the effect is not repeated after the tooltip is hidden? would it be possible to append the tooltip to the dom in some other way (say right after the element that gets the tip)?

You don't want to do that. Just set a class on your featherlight and that class to customize its background.

The problem is that there are nested featherlights and to avoid having the screen get darker and darker ":last-of-type" is used.
I am still confused about why the bug only happens on the initial display - perhaps there's a way to fake that so that it never affects the user's display.

I'm not sure either why it happens the first time only, it would require investigating. Do you see this happen on all browsers ?
Maybe you could put all your featherlights in a one div, not directly as a child of body, so your :last-of-type directive would still work.

Ahh no, Firefox repeats the issue - in Chrome it only happens the first time.
Putting them in a div is nifty idea... Thanks I'll consider this resolved; it seems to be more of a featherlight issue. I am interested in why you say it "You don't want to do that" to the idea of inserting somewhere random in the DOM...

Well you could, actually there's even that option in the upcoming v4. The thing is, it raises more issues : imagine that the tooltip must overflow its container and that the container has overflow:hidden => the tooltip will not be displayed entirely to the user. So I said you don't want to do that because it's actually more risky than other solutions you can find to solve this featherlight issue.

Just to note, my solution has indeed been to add

to the end of my  and then setting the default root has solved this bug
$.featherlight.defaults.root = $(".featherlight-holder")


Windows debug builds for PR artifacts

Summary
With this PR, Windows debug build artifacts are created. This should make it easier to find errors.
What kind of change does this PR introduce? (check at least one)

[ ] Bugfix
[ ] Feature
[ ] Code style update
[ ] Refactor
[ ] Docs
[x] Build-related changes
[ ] Other, please describe:

If changing the UI of web configuration, please provide the before/after screenshot:
Does this PR introduce a breaking change? (check one)

[ ] Yes
[x] No

If yes, please describe the impact and migration path for existing setups:
The PR fulfills these requirements:

[ ] When resolving a specific issue, it's referenced in the PR's body (e.g. Fixes: #xxx[,#xxx], where "xxx" is the issue number)

If adding a new feature, the PR's description includes:

[ ] A convincing reason for adding this feature
[ ] Related documents have been updated (docs/docs/en)
[ ] Related tests have been updated

To avoid wasting your time, it's best to open a feature request issue first and wait for approval before working on it.
Other information:

Cool :)
Hint: https://github.com/actions/setup-python/issues/86

@brindosch
Über jegliche Hilfe bin ich sehr dankbar. 👍

I will put this PR on hold for now. Since some debug dependencies are not available in vcredist, debugging under Windows without VS proves difficult.


JavaScript runtime error: Wrong usage of FILE() function Error

HTML :
<input`  id="readfile" type="file" data-bind="event: { change: function() { $parent.loadFileTest($element.files[0]) }  }"/>

JS :
 alasql('SELECT * FROM FILE(?,{headers:true})', [file], function (data) {
 // Process data here
 });

I get  0x800a139e - JavaScript runtime error: Wrong usage of FILE() function . Error.
Please help.

Please provide full code. I cant see how $parent is connected to the the alasql code
What kind of file are you reading?

I have a tab control where I have the <input type . So I need to use $parent . When I click browse I am able to select the file ( XLSX) and then the loadFileTest funciton is triggered. I get the mentioned error in the alasql statement.
loadFileTest: function (file) {
alasql('SELECT * FROM FILE(?,{headers:true})', [file], function (data) {
if (data != null) {
}
// Process data here
});
        }

Attaching the snapshot for your reference.

Please reopen this issue when you have provided full html + js code to replicate the problem.

Please try this:
Javascript code:
function loadFileTest (event) {
alasql('SELECT * FROM FILE(?,{headers:true})', [event], function (data) {
if (data != null) {
}
// Process data here
});
}
HTML Code:

note: provide alasql js references..

I was able to get past that error by using [event.originalEvent] instead of event, but I encountered a new error: xlsx.js:11363 Uncaught TypeError: f.charCodeAt is not a function(…)
I am importing an xlsx file via  in Chrome.


add SDL_RenderIsClipEnabled on v0.4.x

need SDL_RenderIsClipEnabled, missing on v0.4.x branch.

Hi @firodj, thanks for the pull request! I have merged it and tagged it with v0.4.30.

Thanks it works 👍


[OneDNN] Rename ig_amx_xxx to onednn_amx_xxx.

Do we also need to update the library?

Do we also need to update the library?

No, it only focus on oneDNN library.


Create color.html

Here is the code. Please do let me know if any changes are required.
Kindly , merge it after your verification.

Here is the code. Kindly let me know if any changes are required.
Please merge it.


Can't work with robots.ts and sitemap.ts files

Here is my folder structure and whenever I tried to open sitemap or robots path it gives error, how to fix this error

Hello!
There's no relation with the package here, only with the peculiarities of route processing in Next.js. Specifically, it processes approximately in the following order:

Rewrites and redirects;
Static routes (including sitemap);
Dynamic routes;

In your case, it reached the dynamic routes and an error throwed up there. To prevent the error from occurring, you should add a check for the locale:
if (!validLanguages.includes(lang)) return notFound();
Also, the sitemap file is located at /sitemap.xml, and robots at /robots.txt


Unable to call wasm_get_sys_tick_ms from WASM Module

I'm trying to make use of the WAMR Api inside my WASM Module. However, whenever I try to run the module, I get the following error during Runtime:
I (316) WAMR-P1: Instantiate WASM runtime
[00:00:00:056 - 3FCDCB6C]: warning: failed to link import function (env, wasm_get_sys_tick_ms)
I (326) WAMR-P1: run main() of the application
Exception: failed to call unlinked import function (env, wasm_get_sys_tick_ms)
I (336) WAMR-P1: Deinstantiate WASM runtime

When I'm building my WASM Module I'm using core/app-framework/base/app/timer_api.h during compilation which is done like this:
/opt/wasi-sdk/bin/clang  --target=wasm32        \
        --sysroot=${WAMR_DIR}/wamr-sdk/app/libc-builtin-sysroot   \
        -O3 -z stack-size=4096      \
        -Wl,--initial-memory=65536 \
        -Wl,--allow-undefined-file=${WAMR_DIR}/wamr-sdk/app/libc-builtin-sysroot/share/defined-symbols.txt \
        -Wl,--no-entry -Wl,--export=main                \
        -Wl,--export=__heap_base,--export=__data_end    \
        -Wl,--export=__wasm_call_ctors  \
        -nostdlib \
        -I ${WAMR_DIR}/core/app-framework/base/app/ \
        ping.c -o ping.wasm \

From my understanding this error comes from not adding this function to the native symbols via wasm_runtime_register_natives. However this should already be done within WAMR itself, right?
Any ideas why this function might be unable to link?

Hi, wasm_get_sys_tick_ms is implemented the base lib of app framework, it isn't compiled into iwasm by default, could you please build iwasm with command below:
cmake .. -DWAMR_BUILD_APP_FRAMEWORK=1 -DWAMR_BUILD_APP_LIST="WAMR_APP_BUILD_BASE"

Thanks for your help! That worked!
I was missing the build flags because they are not documented anywhere. Maybe updating this Website https://wamr.gitbook.io/document/wamr-in-practice/tutorial/build-tutorial/build_wamr might be in order.


Beta 4 1.2.0 [Merge Pending Stability Check]

Flags
-Added /Flags/Frequent Explosions.png
-Added /Flags/Kerbal Academy Graduation.png
-Added /Flags/Kerbal Academy.png
-Renamed /Flags/Legacy Kerbal Academy.png

Added /Flags/Use Caution.png

Current Beta 4 v1.2.0 Changes
Flag Changes
-Added /Flags/Frequent Explosions.png
-Added /Flags/Kerbal Academy Graduation.png
-Added /Flags/Kerbal Academy.png
-Renamed /Flags/Legacy Kerbal Academy.png
-Added /Flags/Use Caution.png
Updated Advanced Piloting Config
-Reworked Description
-Fixed Spelling Errors
Updated Fight School Config
-Reworked Description
-Cleaned Up Spelling Issues

Current Beta 4 v1.2.0 Changes
Flag Changes
-Added /Flags/Frequent Explosions.png
-Added /Flags/Kerbal Academy Graduation.png
-Added /Flags/Kerbal Academy.png
-Renamed /Flags/Legacy Kerbal Academy.png
-Added /Flags/Use Caution.png
Updated Advanced Piloting Config
-Reworked Description
-Fixed Spelling Errors
Updated Fight School Config
-Reworked Description
-Cleaned Up Spelling Issues
Updated Scientific Principles Config
-Rework Description
-Rebalanced Cost
-Fixed Spelling Issues
-Cost Now Generated Based On Trainee Level
Updated Field Science Config
-Rework Description
-Rebalanced Cost
-Fixed Spelling Issues
-Cost Now Generated Based On Trainee Level
-Fixed Parameter Error

Current Beta 4 v1.2.0 Changes
Flag Changes
-Added /Flags/Frequent Explosions.png
-Added /Flags/Kerbal Academy Graduation.png
-Added /Flags/Kerbal Academy.png
-Renamed /Flags/Legacy Kerbal Academy.png
-Added /Flags/Use Caution.png
Updated Advanced Piloting Config
-Reworked Description
-Fixed Spelling Errors
-Spelling Fix Again
-Rebalanced Cost
-Cost Now Generated Based On Level
Updated Fight School Config
-Reworked Description
-Cleaned Up Spelling Issues
Updated Engineering 101 Config
-Reworked Description
-Fixed Spelling Issues
-Rebalanced Cost
-Cost Now Generated Based On Trainee Level
Updated Engineering School Config
-Rework Description
-Rebalanced Cost
-Fixed Spelling Issues
-Cost Now Generated Based On Trainee Level
Updated Scientific Principles Config
-Rework Description
-Rebalanced Cost
-Fixed Spelling Issues
-Cost Now Generated Based On Trainee Level
Updated Field Science Config
-Rework Description
-Rebalanced Cost
-Fixed Spelling Issues
-Cost Now Generated Based On Trainee Level
-Fixed Parameter Error
Updated ReadMe File
-Added Current Version Info
Updated Kerbal Academy Boot Camp Config
-Reworked Description
-Fixed Spelling Errors
-Fixed Drill Craft Kraken (?)
-Contract Cost Now Generated Based On Current Hire Cost
-Contract Cost Now Takes Funds
-Added Refund If Training Fails
Updated Agent
-Fixed Name
-Changed Logo To Reflect New Flags
Updated Version File
-Version File Now Reflects Build Version
Added Training Drill Mk2
-Added Training Drill Mk2
Integrated New Training Drill
-Adjusted Boot Camp Config
-Copied Some Flags For Use In Contracts
-Updated A Few Other Things Here And There.
-Spelling Errors
-General Bugfixes


added the link for saic website

The link on the navbar now redirects to  saic.iitmandi.co.in

@Milind712000 @kartik1000


org.apache.nifi.processor.exception.ProcessException: java.lang.IllegalStateException: This instance has been stopped

NiFi 1.11.x - been working fine for at least a year, then starts throwing this message continually, to the point of filling up the logs over and over.
Tried restarting NiFi, MarkLogic, clearing the NiFi repository, etc.
Any idea what causes this error?
2022-01-10 08:41:42,338 ERROR [Timer-Driven Process Thread-2] o.a.n.marklogic.processor.PutMarkLogic PutMarkLogic[id=016b101a-d65a-1ba4-4618-c500a674cb9d] Failed to process session due to org.apache.nifi.processor.exception.ProcessException: java.lang.IllegalStateException: This instance has been stopped: org.apache.nifi.processor.exception.ProcessException: java.lang.IllegalStateException: This instance has been stopped
org.apache.nifi.processor.exception.ProcessException: java.lang.IllegalStateException: This instance has been stopped
at org.apache.nifi.marklogic.processor.AbstractMarkLogicProcessor.logErrorAndRollbackSession(AbstractMarkLogicProcessor.java:215)
at org.apache.nifi.marklogic.processor.PutMarkLogic.onTrigger(PutMarkLogic.java:394)
at org.apache.nifi.marklogic.processor.PutMarkLogic.onTrigger(PutMarkLogic.java:329)
at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1176)
at org.apache.nifi.controller.tasks.ConnectableTask.invoke(ConnectableTask.java:213)
at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:117)
at org.apache.nifi.engine.FlowEngine$2.run(FlowEngine.java:110)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.IllegalStateException: This instance has been stopped
at com.marklogic.client.datamovement.impl.WriteBatcherImpl.requireNotStopped(WriteBatcherImpl.java:283)
at com.marklogic.client.datamovement.impl.WriteBatcherImpl.flush(WriteBatcherImpl.java:395)
at com.marklogic.client.datamovement.impl.WriteBatcherImpl.flushAsync(WriteBatcherImpl.java:385)
at org.apache.nifi.marklogic.processor.PutMarkLogic.flushWriteBatcherAsync(PutMarkLogic.java:401)
at org.apache.nifi.marklogic.processor.PutMarkLogic.onTrigger(PutMarkLogic.java:346)
... 12 common frames omitted

I believe the actual error is coming from the flushWriteBatcherAsync(this.writeBatcher); call.
In the output, I can see the "Flushing the WriteBatcher asynchronously..." message, but not the following (in the code) message of "Calling yield() on the ProcessContext".

This looks like it might be kicked off by a transient networking problem when communicating with the ML server.  Still, this kicks off 14 gigabytes of logging per minute until somebody notices the processor is in error and restarts it or the disk fills up and everything goes into the toilet.
2022-01-17 03:59:04,180 ERROR [Timer-Driven Process Thread-6] c.m.c.d.HostAvailabilityListener Encountered [com.marklogic.client.MarkLogicIOException: Failed to serialize metadata] on host "gclcnappvhl0073.gdc0.chevron.net" but black-listing it would drop job below minHosts (1), so stopping job "null"
com.marklogic.client.MarkLogicIOException: Failed to serialize metadata
        at com.marklogic.client.io.DocumentMetadataHandle.sendMetadataImpl(DocumentMetadataHandle.java:791)
        at com.marklogic.client.io.DocumentMetadataHandle.write(DocumentMetadataHandle.java:569)
        at com.marklogic.client.impl.StreamingOutputImpl.writeTo(StreamingOutputImpl.java:58)
        at okhttp3.MultipartBody.writeOrCountBytes(MultipartBody.kt:157)
        at okhttp3.MultipartBody.writeTo(MultipartBody.kt:93)
        at okhttp3.internal.http.CallServerInterceptor.intercept(CallServerInterceptor.kt:59)
        at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.kt:100)
        at okhttp3.internal.connection.ConnectInterceptor.intercept(ConnectInterceptor.kt:34)
        at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.kt:100)
        at okhttp3.internal.cache.CacheInterceptor.intercept(CacheInterceptor.kt:96)
        at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.kt:100)
        at okhttp3.internal.http.BridgeInterceptor.intercept(BridgeInterceptor.kt:83)
        at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.kt:100)
        at okhttp3.internal.http.RetryAndFollowUpInterceptor.intercept(RetryAndFollowUpInterceptor.kt:76)
        at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.kt:100)
        at com.burgstaller.okhttp.AuthenticationCacheInterceptor.intercept(AuthenticationCacheInterceptor.java:49)
        at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.kt:100)
        at okhttp3.internal.connection.RealCall.getResponseWithInterceptorChain$okhttp(RealCall.kt:197)
        at okhttp3.internal.connection.RealCall.execute(RealCall.kt:148)
        at com.marklogic.client.impl.OkHttpServices.sendRequestOnce(OkHttpServices.java:714)
        at com.marklogic.client.impl.OkHttpServices.sendRequestOnce(OkHttpServices.java:709)
        at com.marklogic.client.impl.OkHttpServices.doPost(OkHttpServices.java:4175)
        at com.marklogic.client.impl.OkHttpServices.postResource(OkHttpServices.java:3486)
        at com.marklogic.client.impl.OkHttpServices.postBulkDocuments(OkHttpServices.java:3589)
        at com.marklogic.client.impl.DocumentManagerImpl.write(DocumentManagerImpl.java:649)
        at com.marklogic.client.impl.GenericDocumentImpl.write(GenericDocumentImpl.java:23)
        at com.marklogic.client.impl.DocumentManagerImpl.write(DocumentManagerImpl.java:624)
        at com.marklogic.client.impl.GenericDocumentImpl.write(GenericDocumentImpl.java:23)
        at com.marklogic.client.datamovement.impl.WriteBatcherImpl$BatchWriter.run(WriteBatcherImpl.java:679)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor$CallerRunsPolicy.rejectedExecution(ThreadPoolExecutor.java:2038)
        at com.marklogic.client.datamovement.impl.WriteBatcherImpl$CompletableRejectedExecutionHandler.rejectedExecution(WriteBatcherImpl.java:777)
        at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830)
        at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379)
        at com.marklogic.client.datamovement.impl.WriteBatcherImpl$CompletableThreadPoolExecutor.execute(WriteBatcherImpl.java:810)
        at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112)
        at com.marklogic.client.datamovement.impl.WriteBatcherImpl.add(WriteBatcherImpl.java:233)
        at com.marklogic.client.datamovement.impl.WriteBatcherImpl.add(WriteBatcherImpl.java:241)
        at com.marklogic.client.datamovement.impl.WriteBatcherImpl.add(WriteBatcherImpl.java:248)
        at org.apache.nifi.marklogic.processor.PutMarkLogic.addWriteEvent(PutMarkLogic.java:408)
        at org.apache.nifi.marklogic.processor.PutMarkLogic.onTrigger(PutMarkLogic.java:362)
        at org.apache.nifi.marklogic.processor.PutMarkLogic.onTrigger(PutMarkLogic.java:329)
        at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1273)
        at org.apache.nifi.controller.tasks.ConnectableTask.invoke(ConnectableTask.java:214)
        at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:103)
        at org.apache.nifi.engine.FlowEngine$2.run(FlowEngine.java:110)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
Caused by: javax.xml.stream.XMLStreamException: java.net.SocketException: Broken pipe (Write failed)
        at com.sun.xml.internal.stream.writers.XMLStreamWriterImpl.flush(XMLStreamWriterImpl.java:399)
        at com.marklogic.client.io.DocumentMetadataHandle.sendMetadataImpl(DocumentMetadataHandle.java:788)
        ... 53 common frames omitted
Caused by: java.net.SocketException: Broken pipe (Write failed)
        at java.net.SocketOutputStream.socketWrite0(Native Method)
        at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:111)
        at java.net.SocketOutputStream.write(SocketOutputStream.java:155)
        at okio.OutputStreamSink.write(JvmOkio.kt:53)
        at okio.AsyncTimeout$sink$1.write(AsyncTimeout.kt:103)
        at okio.RealBufferedSink.flush(RealBufferedSink.kt:247)
        at okhttp3.internal.http1.Http1ExchangeCodec$ChunkedSink.flush(Http1ExchangeCodec.kt:310)
        at okio.ForwardingSink.flush(ForwardingSink.kt:32)
        at okhttp3.internal.connection.Exchange$RequestBodySink.flush(Exchange.kt:228)
        at okio.RealBufferedSink.flush(RealBufferedSink.kt:250)
        at okio.RealBufferedSink$outputStream$1.flush(RealBufferedSink.kt:123)
        at com.sun.xml.internal.stream.writers.UTF8OutputStreamWriter.flush(UTF8OutputStreamWriter.java:138)
        at com.sun.xml.internal.stream.writers.XMLStreamWriterImpl.flush(XMLStreamWriterImpl.java:397)
        ... 54 common frames omitted

@ELadner Has this still been an issue for you?

I did some more testing, and I believe this behavior is due to PutMarkLogic rolling back the session and logging an error. That is likely not the correct approach, as the FlowFile that failed will be tried again. In the event of a connection error - such as what's reported above - I think we'd expect the behavior described above, which is that the FlowFile fails repeatedly and we get a ton of useless logging.
I am going to open a new ticket to provide an option for PutMarkLogic to do what ever other processor does, which is to send the failed batch to a "failure" relationship.
Closing this otherwise due to lack of response, but my expectation is that the above ticket will be helpful in resolving this issue.

Thanks for the attention on this issue, but I no longer use MarkLogic or
NiFi in my current role.  I'll pass this information along to those who do,
however.
On Mon, Nov 28, 2022 at 10:10 AM Rob Rudin @.***> wrote:

Closed #124 https://github.com/marklogic/nifi/issues/124 as completed.
—
Reply to this email directly, view it on GitHub
https://github.com/marklogic/nifi/issues/124#event-7904477337, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AA4C3KV6IP65L47R7M7ZIMLWKTKONANCNFSM5LT3BFLA
.
You are receiving this because you were mentioned.Message ID:
@.***>

--
Eric Ladner


Missing secret_token and secret_key_base for 'production' environment, set these values in config/secrets.yml

We have created the secrets.yml file in config folder and formatted it as
api_key = xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
username = xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
endpoint_url = https://api.softlayer.com/xmlrpc/v3/
timeout = 60
However I continue o get error in browser Missing secret_token and secret_key_base for 'production' environment, set these values in config/secrets.yml.
How and where should this file be formatted and located?

Hi Lou,
Actually this is almost a blank rails repo, just the skeleton to keep the development forward. I proposed some dev guidelines here: https://github.com/softlayer/stratos/issues/1 but we haven't moved yet.
To address the secrets.yml file you said I made this commit, you just need to set the SECRET_KEY_BASE environment variable. (you can generate with rake secret)
Thank you

@lsdace30095 just following up this issue and #2 , now we have a usable version on master if you'd like to try, now you should get it working without (I hope so heheh) any issue.


Re: Working With Forms In SvelteKit

In the progressive enhance section, you have the paragraph:

The point is not that your site should work without JavaScript but before it because JavaScript can fail loading for various reasons and this is what makes your app more resilient — instead of relying on JavaScript you can use it to progressive enhance the form and the user experience when JavaScript is available on the page.

I thought I'd share that it didn't read quite clearly to me.
Thanks for all your work in educating the world on programming!

Yeah, that's not great!

JavaScript can fail to load for many reasons but I'm not advocating that every site should work without JavaScript and should instead work before JavaScript is loaded on the page. This approach to development makes your app more resilient and you can use JavaScript once it's available to improve the user experience using progressive enhancement as intended.

How do you feel about that @vorian77?

Sounds good to me, thanks again!On Apr 23, 2023, at 3:52 PM, Matia @.***> wrote:
Yeah, that's not great!
JavaScript can fail to load for many reasons but I'm not advocating that every site should work without JavaScript and should instead work before JavaScript is loaded on the page. This approach to development makes your app more resilient and you can use JavaScript once it's available to improve the user experience using progressive enhancement as intended.
How do you feel about that @vorian77?
—Reply to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you were mentioned.Message ID: @.***>


Retrieval Tool: Indicates "complete" before all transfers finish

JIRA Ticket: https://duracloud.atlassian.net/browse/DURACLOUD-1069

Other Relevant Links (Mailing list discussion, related pull requests, etc.)

What does this Pull Request do?
This updates the shutdown logic of the RetrievalManager to use a phaser to track work completion instead of using awaitTermination.
How should this be tested?

Rebuild the retrieval tool
Run the tool on a large-ish space
When the final status message is printed there should no longer be any retrievals in progress

Additional Notes:
I was considering using submit to return a future and do a get on each to emulate joining the threads, but wasn't sure what the typical space would look like and didn't want a growing list of futures. Not a big deal just an alternate solution which might be a little bit simpler.
Interested parties
Tag (@ mention) interested parties or, if unsure, @duracloud/committers

Spaces can be very large (millions of items) so preventing growing list of futures is a good idea.   As long as this change allows parallel downloads I think this is the right solution.

I gave this a test:  it works great. Thanks @mikejritter


Date format error

Describe the bug
I using docker to run the system. When I try to update record, but get the error message saying that update failed.
I was referred to container log to get more information and I get the actual error message as below:-
System.FormatException: String '19-05-2020 10:49:04' was not recognized as a valid DateTime.
To Reproduce
Steps to reproduce the behavior:

Go to 'Record tab'
Click on 'Document'
Scroll down to 'click Save'
See error

Expected behavior
Should updated successfully.
Desktop (please complete the following information):

OS: Mac Catalina
Browser Chrome
Version 5.6

@clvnong Thank you for reporting this. I reproduced the issue and fixed it. The fix will be available in the v5.7.


Crash on wearing Water Orbs from AM2 and submersing in water

Upon equipping the water orbs rare drop from the Water guardian and diving into the water the game crashes with the following error; http://pastebin.com/tQhXNKni then on subsequent loading of the world the game will crash once more with the following error; http://pastebin.com/GNdWJpLd

Crashes upon world load persist even with update.

On the server?

No, on a single-player world. If you need a copy of the world file I can get that

Nope. On the server we ran into it once or twice and simply teleporting the player out of the water helped. If you can somehow get your player out of it that should fix it for you for the moment.


Using the trained model

I have retrained the default model and trained it on a different data using the downloaded model weights as initial model weights(in Reverse Mode).
So now the question is how to use the model that i trained and not the one that was downloaded through the provided script download_model.py
Also, i wish to use colab environment and i am not sure how to use gpu, as i succesfully configured the libgpuarray but dont know where to put the gpu id or how to find it in colab. The most i could figure was, the gpu device name is "device:GPU:0" with similar steps given in(https://www.kdnuggets.com/2018/02/google-colab-free-gpu-tutorial-tensorflow-keras-pytorch.html/2)
i reached the utils/env.py file in cakechat and there a 'GPU-ID' was discovered but what value to supply is not clear.
It will be great if you could help me with that.
Thanks

Hi, @HarshitSoni1903 !

So now the question is how to use the model that i trained and not the one that was downloaded through the provided script download_model.py

The trained models are stored at <root of cakechag project>/data/nn_models. Since the same folder is used by default for fetching our pretrained models from S3, if you didn't change any settings in config.py you most likely have overwritten the pretrained model with your newly trained one. That's ok, just make sure it's the case by taking a look at the modification time of the model's file. After that you can launch scripts like python tools/generate_predictions.py and the default location will be used to load model's weights, which are in your case the weights of your newly trained model.
If you want to load the model's weights from other location, pass -m flag to the script:
python tools/generate_predictions.py -m <full path to your models weights file>

Also, i wish to use colab environment and i am not sure how to use gpu, as i succesfully configured the libgpuarray but dont know where to put the gpu id or how to find it in colab.

In Theano you need to specify GPU params id via environment variables and that exactly what init_theano_env() does. So you can explicitly change this line
https://github.com/lukalabs/cakechat/blob/1efee48352caebfa4bda737c7e35de8edab89aab/tools/train.py#L10
to
init_theano_env(gpu_id='0')

in order run make GPU 0 visible to Theano. After that proceed running the code as you would on CPU.

Following the changes you specified i used initial model and tried training it on Nvidia GTX 1050Ti(4GB) with train size of 8.3 MB but a whole new error pops up:
[13.03.2019 19:36:28.119][INFO][2539][cakechat.dialog_model.model][410] Compiling train function...
Traceback (most recent call last):
File "tools/train.py", line 107, in
train(init_path=args.init_weights, is_reverse_model=args.reverse)
File "tools/train.py", line 81, in train
train_model(nn_model)
File "/root/cakechat/cakechat/dialog_model/train.py", line 250, in train_model
loss = nn_model.train(*train_batch)
File "/root/cakechat/cakechat/dialog_model/model.py", line 433, in train
return self._train_fn(*args)
File "/usr/local/lib/python2.7/dist-packages/theano/compile/function_module.py", line 898, in call
storage_map=getattr(self.fn, 'storage_map', None))
File "/usr/local/lib/python2.7/dist-packages/theano/gof/link.py", line 325, in raise_with_op
reraise(exc_type, exc_value, exc_trace)
File "/usr/local/lib/python2.7/dist-packages/theano/compile/function_module.py", line 884, in call
self.fn() if output_subset is None else
File "pygpu/gpuarray.pyx", line 654, in pygpu.gpuarray.pygpu_empty (pygpu/gpuarray.c:9764)
File "pygpu/gpuarray.pyx", line 280, in pygpu.gpuarray.array_empty (pygpu/gpuarray.c:5616)
pygpu.gpuarray.GpuArrayException: out of memory
Apply node that caused the error: GpuCrossentropySoftmaxArgmax1HotWithBias(GpuDot22.0, dense_output_probs.b, GpuReshape{1}.0)
Toposort index: 986
Inputs types: [GpuArrayType(float32, (False, False)), GpuArrayType(float32, (False,)), GpuArrayType(int32, (False,))]
Inputs shapes: [(5952, 50000), (50000,), (5952,)]
Inputs strides: [(200000, 4), (4,), (4,)]
Inputs values: ['not shown', 'not shown', 'not shown']
Outputs clients: [[GpuAdvancedSubtensor1(GpuCrossentropySoftmaxArgmax1HotWithBias.0, GpuContiguous.0)], [GpuCrossentropySoftmax1HotWithBiasDx(GpuAdvancedIncSubtensor1{inplace=True, set_instead_of_inc=False}.0, GpuCrossentropySoftmaxArgmax1HotWithBias.1, GpuReshape{1}.0)], []]
HINT: Re-running with most Theano optimization disabled could give you a back-trace of when this node was created. This can be done with by setting the Theano flag 'optimizer=fast_compile'. If that does not work, Theano optimizations can be disabled with 'optimizer=None'.
HINT: Use the Theano flag 'exception_verbosity=high' for a debugprint and storage map footprint of this apply node.
This appears right after step 1( perplexity 42.96).
The only change to train.py:  device_id='0' as specified in previous comment.
Os: Ubuntu 19.04
Environment: docker(as given in set-up instructions).

pygpu.gpuarray.GpuArrayException: out of memory

This line indicates that your GPU's memory isn't enough for the given experiment. Try reducing batch size in config file to a smaller value, for example 64:
https://github.com/lukalabs/cakechat/blob/d231b032a066a5aef4d4ffa227a9a52aa1ff1067/cakechat/config.py#L64
Also you may consider reducing the values of the following params: INPUT_SEQUENCE_LENGTH, OUTPUT_SEQUENCE_LENGTH, MAX_PREDICTIONS_LENGTH.


Add artist invite post badges.

https://www.pivotaltracker.com/story/show/154422731

Thanks @gblakeman. It LGTM if we get Lucians approval.


www.nsanedown.com

This site is used for piracy, but is not malicious.
I have whitelisted on my end, but just alerting you FYI.

fixed


Add panel for current active invocations

Inside the raid it'd be nice to see the list of invocations that were set during the start.
Good examples:

When the raid ends and someone leaves first, the invocations are set to that person's presets.
Stepping away and invocations were changes
Logging in for WDR

Unfortunately the invocations are only synced to the client when the interface is open, and unless you had the invocation panel open at the time they were changed, the client has no way to know which invocations are enabled. Jagex simply does not transmit this information when the interface is not visible.
For this reason, I think an invocation list on the sidebar (while likely to be correct most of the time) would add a lot of confusion when it is incorrect, and enough confusion that it would not be worth adding. If it otherwise becomes possible to track invocations without the panel, I am willing to revisit this.

I only briefly looked into the varbits that were exposed and wasn't quite sure.
I guess the only guarantee is if you are the party leader and have opened the invo board before going in. Better to avoid it all together


Revert "Support int96RebaseModeInWrite and `int96RebaseModeInRead' (#3330)

this is just get revert, no other changes. This commit is not up to date with the latest shim stuff and causes build failures in CDH and potentially others.
 I'll reopen the other PR.

FYI @tgravescs https://github.com/NVIDIA/spark-rapids/pull/3615

Can we hold off on merging this? I may have the fix almost ready

#3630 is ready for review


How to search for lookup for UCI automation(using v9.0.2)

Hello @TYLEROL ,
Am using branch v9.0.2 for New UI automation, could you please help how to search for lookup items.
There are field like Country and Preferred language in the form which are of look up fields.

Hi @SachinAnnam,
For the Unified Interface, we currently support setting values for Lookups, however some features are not yet available compared to the legacy web client.
xrmApp.Entity.SetValue({Name="lookfieldname", Value="LookupValue"});
For other functionality, like interacting with the Lookup Page in the Unified Interface, we hope to include in a future update to support the v9.1 release of Dynamics. We don't have an ETA for this yet, however it shouldn't be too far off.
Best Regards,
Tyler

Hello @ggeiszle  and @TYLEROL
I tried below snippet for lookup but it didn't worked:
xrmApp.Entity.SetValue({ Name = "language", Value = "English"});
Even SelectLookup isn't helping.
xrmApp.Entity.SelectLookup("language");
Please help with some options.


Function call rewriter incorrectly rewrites [self->_lock lock] call as [{class} lock] if {class} contains a "lock" method

If a class has a @property <whatever> lock; that contains a method named lock, the function call rewriter will erronously assume calls to [self.lock lock] (thread that locks the mutex) are calls to [self lock]` (getter function for the mutex)

Duplicate of #33


Clicking on elements that trigger file choosers consecutively cause the process to hang.

Step To Reproduce / Observed behavior
1.) Click button that opens file chooser, select file, click another button that opens file chooser, process hangs.
https://github.com/KonnorRogers/ash-editor/blob/547927784e72990d0a1b0879c062ad3318bef94e/tests/rails/test/system/attachments/attachment_attributes_test.rb#L41-L65
^ Theres an extra "click bold button to fix file chooser" in here.
Expected behavior
It should be expected you choose a file, click another button, open file chooser, choose another button without issue.
Environment
Paste the output of ruby --version
Ruby 3.1.2
Rails 7.0.4
Playwright 1.27.1
Repo: https://github.com/KonnorRogers/ash-editor (need to remove an extra click)
Im not sure if the issue lies with the Playwright-Ruby-Client or with Playwright itself.

Bump.

Hi, sorry for late response.
I tried the code below (input 2 files with 2 threads) however it worked without hang.
  it 'https://github.com/YusukeIwaki/playwright-ruby-client/issues/231' do
    with_page do |page|
      page.content = <<~HTML
      <input type="file" name="file1" />
      <input type="file" name="file2" />
      HTML

      choosers = Concurrent::Promises.zip(
        Concurrent::Promises.future {
          page.expect_file_chooser do
            sleep 1
            page.click('input[name="file1"]')
          end
        },
        Concurrent::Promises.future {
          page.expect_file_chooser do
            sleep 1
            page.click('input[name="file2"]')
          end
        },
      ).value!

      choosers.each do |chooser|
        chooser.set_files(__FILE__)
      end
    end
  end

@KonnorRogers  Could you provide the execution log with DEBUG=1 ?
DEBUG=1 bundle exec rspec ...


Error trying to open an SSH_AUTH_SOCKET with socat in WSL2

IMPORTANT
Please read README and Known issues before creating the issue.
Please fill out the below information:
Describe the issue
I'm trying to use the solution proposed by https://github.com/rupor-github/wsl-ssh-agent to use socat and npiperelay to open a socket to use my ssh keys directly in my ArchWSL instance. It does work with both Ubuntu and Fedora Remix on WSL, but if I try to use it with ArchWSL it says "RTNETLINK answers: Invalid argument" and then operation invalid.
To Reproduce
Steps to reproduce the behavior:
Add this to your .bashrc:
export SSH_AUTH_SOCK=$HOME/.ssh/agent.sock
ss -a | grep -q $SSH_AUTH_SOCK
if [ $? -ne 0   ]; then
rm -f $SSH_AUTH_SOCK
( setsid socat UNIX-LISTEN:$SSH_AUTH_SOCK,fork EXEC:"$HOME/winhome/.wsl/npiperelay.exe -ei -s //./pipe/openssh-ssh-agent",nofork & ) >/dev/null 2>&1
fi
Expected behavior
It should give acess to my ssh keys from Windows openssh inside ArchWSL.
Screenshots
If applicable, add screenshots to help explain your problem.
Enviroment:

Windows build number: Microsoft Windows [version 10.0.19042.630]
Security Software: Windows Defender
WSL version 1/2: WSL2
ArchWSL version <IP_ADDRESS>
ArchWSL Installer type Clean appx
Launcher version 20100500

Additional context
Add any other context about the problem here.

I have the same problem. It's the ss command:
set -x SSH_AUTH_SOCK $HOME/.ssh/agent.sock
#ss -a | grep -q $SSH_AUTH_SOCK
if [ $status != 0 ]
  rm -f $SSH_AUTH_SOCK
  setsid nohup socat UNIX-LISTEN:$SSH_AUTH_SOCK,fork EXEC:/c/tools/wsl-ssh-pageant/wsl2-ssh-pageant.exe >/dev/null 2>&1 &
end

set -x GPG_AGENT_SOCK $HOME/.gnupg/S.gpg-agent
#ss -a | grep -q $GPG_AGENT_SOCK
if [ $status != 0 ]
  rm -rf $GPG_AGENT_SOCK
  setsid nohup socat UNIX-LISTEN:$GPG_AGENT_SOCK,fork EXEC:"/c/tools/wsl-ssh-pageant/wsl2-ssh-pageant.exe --gpg S.gpg-agent" >/dev/null 2>&1 &
end

I have the same problem. It's the ss command:
set -x SSH_AUTH_SOCK $HOME/.ssh/agent.sock
#ss -a | grep -q $SSH_AUTH_SOCK
if [ $status != 0 ]
  rm -f $SSH_AUTH_SOCK
  setsid nohup socat UNIX-LISTEN:$SSH_AUTH_SOCK,fork EXEC:/c/tools/wsl-ssh-pageant/wsl2-ssh-pageant.exe >/dev/null 2>&1 &
end

set -x GPG_AGENT_SOCK $HOME/.gnupg/S.gpg-agent
#ss -a | grep -q $GPG_AGENT_SOCK
if [ $status != 0 ]
  rm -rf $GPG_AGENT_SOCK
  setsid nohup socat UNIX-LISTEN:$GPG_AGENT_SOCK,fork EXEC:"/c/tools/wsl-ssh-pageant/wsl2-ssh-pageant.exe --gpg S.gpg-agent" >/dev/null 2>&1 &
end

And, in particular, the grep part of the command... which seems strange.

And, in particular, the grep part of the command... which seems strange.

I also tried my prior to wsl-ssh-pageant use tool, https://github.com/vuori/weasel-pageant and it doesn't work as well.

I also tried my prior to wsl-ssh-pageant use tool, https://github.com/vuori/weasel-pageant and it doesn't work as well.

I've tested weasel-pageant (https://github.com/vuori/weasel-pageant) and this works, however it's unmaintained currently.

I've tested weasel-pageant (https://github.com/vuori/weasel-pageant) and this works, however it's unmaintained currently.

Also experiencing this issue.

This error has stopped happening recently, so i'm closing this issue.


MemoryError while to_parquet or .repartition

I'm running into a MemoryError when I try to save in a parquet format, or repartition(by size).
I didn't have this issue before, but after merging two dask dataframes, it's giving me this error.
The memory usage of python terminal keeps going up, and the it takes most of my machine's memory even after the error.
EWQ = dd.read_parquet('./merged1.parquet')
R = dd.read_parquet('./price.parquet')
print(EWQ.npartitions);print(R.npartitions)#500, 207 each
EWQR = dd.merge(EWQ, R, on = 'Symbol', how='left')
EWQR.npartitions # 500 partitions

with ProgressBar():
    EWQR.to_parquet('./merged2.parquet')
[########################                ] | 61% Completed | 16min 49.2s

Traceback (most recent call last):
  File "<input>", line 2, in <module>
  File "C:\Users\gunsu.son\AppData\Local\Continuum\miniconda3\lib\site-packages\dask\dataframe\core.py", line 3618, in to_parquet
    return to_parquet(self, path, *args, **kwargs)
  File "C:\Users\gunsu.son\AppData\Local\Continuum\miniconda3\lib\site-packages\dask\dataframe\io\parquet.py", line 1496, in to_parquet
    out.compute()
  File "C:\Users\gunsu.son\AppData\Local\Continuum\miniconda3\lib\site-packages\dask\base.py", line 175, in compute
    (result,) = compute(self, traverse=False, **kwargs)
  File "C:\Users\gunsu.son\AppData\Local\Continuum\miniconda3\lib\site-packages\dask\base.py", line 446, in compute
    results = schedule(dsk, keys, **kwargs)
  File "C:\Users\gunsu.son\AppData\Local\Continuum\miniconda3\lib\site-packages\dask\threaded.py", line 82, in get
    **kwargs
  File "C:\Users\gunsu.son\AppData\Local\Continuum\miniconda3\lib\site-packages\dask\local.py", line 491, in get_async
    raise_exception(exc, tb)
  File "C:\Users\gunsu.son\AppData\Local\Continuum\miniconda3\lib\site-packages\dask\compatibility.py", line 130, in reraise
    raise exc
  File "C:\Users\gunsu.son\AppData\Local\Continuum\miniconda3\lib\site-packages\dask\local.py", line 233, in execute_task
    result = _execute_task(task, data)
  File "C:\Users\gunsu.son\AppData\Local\Continuum\miniconda3\lib\site-packages\dask\core.py", line 119, in _execute_task
    return func(*args2)
  File "C:\Users\gunsu.son\AppData\Local\Continuum\miniconda3\lib\site-packages\dask\compatibility.py", line 107, in apply
    return func(*args, **kwargs)
  File "C:\Users\gunsu.son\AppData\Local\Continuum\miniconda3\lib\site-packages\dask\dataframe\multi.py", line 224, in merge_chunk
    out = lhs.merge(*args, **kwargs)
  File "C:\Users\gunsu.son\AppData\Local\Continuum\miniconda3\lib\site-packages\pandas\core\frame.py", line 6868, in merge
    copy=copy, indicator=indicator, validate=validate)
  File "C:\Users\gunsu.son\AppData\Local\Continuum\miniconda3\lib\site-packages\pandas\core\reshape\merge.py", line 48, in merge
    return op.get_result()
  File "C:\Users\gunsu.son\AppData\Local\Continuum\miniconda3\lib\site-packages\pandas\core\reshape\merge.py", line 546, in get_result
    join_index, left_indexer, right_indexer = self._get_join_info()
  File "C:\Users\gunsu.son\AppData\Local\Continuum\miniconda3\lib\site-packages\pandas\core\reshape\merge.py", line 756, in _get_join_info
    right_indexer) = self._get_join_indexers()
  File "C:\Users\gunsu.son\AppData\Local\Continuum\miniconda3\lib\site-packages\pandas\core\reshape\merge.py", line 735, in _get_join_indexers
    how=self.how)
  File "C:\Users\gunsu.son\AppData\Local\Continuum\miniconda3\lib\site-packages\pandas\core\reshape\merge.py", line 1146, in _get_join_indexers
    return join_func(lkey, rkey, count, **kwargs)
  File "pandas/_libs/join.pyx", line 98, in pandas._libs.join.left_outer_join
MemoryError

One thing I'm a little bit suspicious about is that merged1.parquet file is unevenly partitioned in terms of size. It was partitioned into 500 files, but when I look at the size of each, some partitions have only 23KB, while some others have >500MB. I'm uncertain if this has to do with the error through. What possibly is causing the problem? How can I evade MemoryError in this case?

Hello, thanks for filing an issue. For tasks like this it's hard for us to help without a minimal reproducible example.
High memory usage for tasks like this could be due to several things, but the dataframe partitioning schemes are likely part of it. For parquet what's important is the size of each partition ("row group" in parquet parlance), not the size of each file (each file may have one or more partitions). You may try experimenting with manually repartitioning (.repartition) after reading if the size of each partition is too large.
Another thought would be to switch to using the distributed scheduler (which works fine locally) - this provides better debugging and profiling options with the dashboard (https://distributed.dask.org/en/latest/web.html), and may provide more insights.

Please excuse my lack of detailed work in this posting. With my limited experience with python and dask, I wan't sure how to mimic this problem.
I assumed that the each size of parquet file corresponds to each size of partitions, for I have used dask.to_parquet function to save merged parquet file. (As far as I know, dask.to parquet saves each partitions to each parquet file, but correct me if I am wrong.)
Since I did not have trouble saving merged1 parquet file, I'll try to reparition them by size(so that it is evenly divided) and try above code again. I'll post the result when it's done.

Any updates here @Matthew-gunsuSon?

I assumed that the each size of parquet file corresponds to each size of partitions, for I have used dask.to_parquet function to save merged parquet file. (As far as I know, dask.to parquet saves each partitions to each parquet file, but correct me if I am wrong.)

Yes, usually. Specifying partition_on may change that a bit.

Yeah, seems like uneven partition caused the problem. With even sized paritions it worked.


Make local dev consistent with other apps

Jenom drobné zjednodušení local dev.

nic takovýho jsem tam nenašel

viz. https://travis-ci.com/github/keboola/data-loader/settings a https://github.com/keboola/data-loader/blob/2dbe5f6ba93a50c56fc3f8e3ebdc89d514765a86/.travis.yml#L8

ah, yes, if export_config is not set it needs these transformation params https://github.com/keboola/data-loader/blob/master/src/ConfigValidator.php#L123

tests are successful and it weren't mentioned in doc

ok, it was something I thought of because I remember it from here
https://github.com/keboola/docker-jupyter/blob/master/docker-compose.yml#L11

It looks like it is generated and injected in tests https://github.com/keboola/data-loader/blob/1dc24444b86d2530c1950bfd510e0d6690dfafe1/tests/phpunit/ConfigValidatorTest.php#L32

yeah, you need the KBC_CONFIG_ID and stuff only to actually run it, not for executing tests


chore: move from bower to npm

I think so. I did not find any bower reference there.
https://foundation.zurb.com/sites/docs/installation.html


Carousel issue on Outlook desktop

When you view the carousel in outlook on desktop, Chrome and Safari I've tried so far, in the preview pane it displays the thumbnails and first image, the thumbnails aren't responding though, hover or click. When you open up the email it just shows you the first image, which is the fallback it's meant to display.
Shouldn't the preview pane have the same behaviours as the opened email?

Hey @juliealchin, thanks for creating this issue.
Could you please provide screenshots of the preview pane and once opened?
Cheers!

Sure @ngarnier :

hi @juliealchin
I am not able to reproduce the issue how did you send this email ?

Well with no news on that, I'm closing the issue.

Seems that Outlook and GMail do not allow interactivity with emails. Therefore these types of components will not work. Which may explain why you can not find the accordion or carousel in the mjml-compatibility sections.


Add method Aliases::getArray() that bulk translates a path aliases into an actual paths

Q
A

Is bugfix?
❌

New feature?
✔

Breaks BC?
❌

Fixed issues
-

This is will be handy use for configuration of classes which don't support aliases:
MyClass::class => [
	'__construct' => [
		'directories' => DynamicReference::to(
			static fn(Aliases $aliases) => $aliases->getArray([
				'src' => '@root/src',
				'tests' => '@root/tests',
			])
		),
	],
];

👍


Cameras not streaming in the Home app

Description
When I attempt to view a supported camera through the Home app, I get the error message "No Response - This Camera is not responding" on the app.
I receive the following information from Homebridge:
Unable to spawn ffmpeg process at undefined with error: TypeError: The "file" argument must be of type string. Received undefined
at new NodeError (node:internal/errors:372:5)
at validateString (node:internal/validators:120:11)
at normalizeSpawnArguments (node:child_process:505:3)
at spawn (node:child_process:693:13)
at StreamingDelegate.handleStreamRequest (C:\Users\coleb\AppData\Roaming\npm\node_modules\homebridge-simplisafe3\lib\streamingDelegate.js:372:48) {
code: 'ERR_INVALID_ARG_TYPE'
I understand this is an issue with ffmpeg. I installed the plugin via Homebridge Config UI X, but for some reason ffmpeg did not automatically install. I have attempted to install ffmpeg for Homebridge manually by running the .exe per their install instructions, but this didn't make any difference. I am using Homebridge on Windows 10 at the moment. I know others have submitted similar issues, but they seemed to figure it out on their own and I can't.
Expected behavior
I expect to see a live stream of the camera.
Steps to reproduce

Open the Home app.
Click on any Simplisafe camera.

Homebridge logs
Unable to spawn ffmpeg process at undefined with error: TypeError: The "file" argument must be of type string. Received undefined
    at new NodeError (node:internal/errors:372:5)
    at validateString (node:internal/validators:120:11)
    at normalizeSpawnArguments (node:child_process:505:3)
    at spawn (node:child_process:693:13)
    at StreamingDelegate.handleStreamRequest (C:\Users\coleb\AppData\Roaming\npm\node_modules\homebridge-simplisafe3\lib\streamingDelegate.js:372:48) {
  code: 'ERR_INVALID_ARG_TYPE'

Homebridge config.json contents
"name": "Home Alarm",
            "cameras": true,
            "sensorRefresh": 15,
            "persistAccessories": true,
            "cameraOptions": {
                "enableHwaccelRpi": false
            },
            "platform": "homebridge-simplisafe3.SimpliSafe 3"

Screenshots
No response
Plugin version
1.10.6
Homebridge version
1.5.0
Node.js version
16.15
Host OS
Windows

No worries! Thank you for giving me some other leads.


UnboundLocalError: local variable 'settings_hope_prefix' referenced before assignment

File Not Found using Different Method
Default $settings used for channel<PHONE_NUMBER>7155487980
Exception ignored in thread started by: <bound method GatewayServer._response_loop of <discum.gateway.gateway.GatewayServer object at 0x0000020211B776E0>>
Traceback (most recent call last):
File "C:\Users\Steven\AppData\Roaming\Python\Python310\site-packages\discum\gateway\gateway.py", line 299, in _response_loop
func(resp)
File "C:\Users\Steven\Desktop\MudaeAutoBot-4\MudaeAutoBot.py", line 693, in on_message
msg = get_server_settings(gid,matched_channel)
File "C:\Users\Steven\Desktop\MudaeAutoBot-4\MudaeAutoBot.py", line 186, in get_server_settings
· Prefix: {settings_hope_prefix} ($prefix)
UnboundLocalError: local variable 'settings_hope_prefix' referenced before assignment

did you solve it ? I have the same  Issue


Deprecate the vectorized argument to pure_callback and ffi_call

Currently, the primitives backing pure_callback and (by extension) ffi_call provide a default batching rule that is controlled by the parameter vectorized to these two functions. This batching rule (allegedly) implements the following behavior:

For vectorized=True, vmapping results in a call to the callback directly with the batched inputs after moving the batch axis to the front. This assumes that the callback function directly handles vectorized inputs and (roughly) callback(x_batch) == stack([callback(x) for x in x_batch]).
When vectorized=False, the vmap produces a sequential scan with the callback in the body, which could have significant performance implications.

While these don't seem like unreasonable defaults, the behavior when vectorized=False could result in unexpectedly poor performance for users who aren't familiar with this behavior. More importantly, the vectorized=True semantics are confusing—and I would argue wrong—when the function takes more than one input. For example, consider the following function:
import jax
import jax.numpy as jnp

def callback(x, y):
  print(x.shape, y.shape)
  return x + y

def fun(x, y):
  shape = jnp.broadcast_shapes(x.shape, y.shape)
  dtype = jnp.result_type(x, y)
  out_type = jax.ShapeDtypeStruct(shape, dtype)
  return jax.pure_callback(callback, out_type, x, y, vectorized=True)

We can call this function under vmap as follows:
jax.vmap(fun, in_axes=(0, None))(jnp.ones(3), 0.5)

This prints (3,) and () for the shapes, and the result has shape (3,), as we expect. However, things get a little ugly if we apply a second vmap as follows:
jax.vmap(jax.vmap(fun, in_axes=(0, None)), in_axes=(None, 0))(jnp.ones(3), jnp.ones(4))

In this case, by the time our callback is executed, it receives x and y with shapes (3,) and (4,), respectively, and it crashes with a TypeError because of the mismatched shapes. Even worse, callback doesn't have enough metadata to gracefully handle this case no matter what; how can callback ever know which argument was batched first?
This behavior is bad, and the docs are (at least somewhat) misleading. This confusion has bitten me, and it has come up several times on the JAX issue tracker, most recently in #23624. In this PR, I propose a refactoring of this API.
Proposal
I think that the best approach for handling these issues would be to deprecate both the default behavior (using a lax.map) and the vectorized parameter, in favor of an explicitly opt-in API using a str (or Enum) parameter called vmap_method. After the appropriate deprecation periods, my proposed API would have the following behavior:

Calling vmap on a callback without an explicit vmap_method would raise an error.
Using vmap_method="sequential" would produce a lax.map when vmapped (the current default behavior).
Using vmap_method="broadcast" would be similar to the current vectorized=True behavior, but new axes would be added in the appropriate locations for unbatched inputs. For example, in the double vmap example from above, x would have shape (1, 3) and y would have shape (4, 1) when they reach the callback.
Finally, vmap_method="broadcast_fullrank" would behave like broadcast, but the inputs would be tiled to the expected batched shape (e.g. (4, 3) in the example above). I would argue that the documentation for pure_callback and ffi_call currently imply this behavior for vectorized=True.

This proposed API would continue to support existing use cases, while minimizing the chance of confusion and performance footguns.
Alternatives
Another approach would be to remove support for batching callbacks entirely in favor of an API like custom_vmap or something more general. This was what I suggested in response to #23624, but since custom_vmap isn't documented or well supported, I'm not sure this is a totally satisfying solution. Furthermore, I expect that the vast majority of use cases for batching callbacks will be supported by some simple rules like the ones listed above, with minimal maintenance burden. More advanced needs could still be covered by custom_vmap.

Just a heads up, it seems this did not make it into 0.4.34 despite being mentioned in the changelog.

Thanks for the heads up! You're absolutely right, although the GitHub tag also doesn't seem to include it either. I'll update the changelog accordingly!

What does the "rank" in the name "broadcast_fullrank" refer to? It seems that the array ranks, as in np.ndim, are the same in either broadcast option.
What would you think of renaming the options here to:

"expand" for current "broadcast" with singleton dimensions, and
"broadcast" for current "broadcast_fullrank" with fully broadcast dimensions?

I'm trying to suggest np.expand_dims in the former case, since that inserts singleton dimensions, and to suggest np.broadcast in the latter case, since that behaves as a material common broadcast on all of its arguments.

Good points - naming is hard!
I like your suggestions, and definitely don't feel too attached to the names from this PR. Maybe "broadcast" by itself is confusing, since people have different intuitions for what broadcasting means. I think that the analogy to expand_dims is a good one, but np.broadcast doesn't seem like quite the right comparison here. Maybe np.broadcast_arrays is closer to the semantics we mean. What about "expand_dims" and "broadcast_arrays"?

Expanding to "expand_dims" sounds good to me.
And "broadcast_arrays", or something like "broadcast_all", sounds good to me.

@jakevdp, @superbobry — Do either of you have opinions about this naming question?


int16S limit checks error

When setting any of the thermostat setpoint limits (int16s) a warning is always generated for value being out of range. Correct code is generated though.

This seems completely broken...
I go to Temperature Measurement, which has int16s:

I observe the following:
1.) I can type a number 13 into one of the INT16S fields, and they don't save at all.
2.) The moment I get to that page, I see exceptions:
⇝ (node:2188796) UnhandledPromiseRejectionWarning: ReferenceError: isValidSignedNumberString is not defined
    at validateSpecificAttribute (/home/timotej/git/zap/src-electron/validation/validation.js:79:7)
    at Object.validateAttribute (/home/timotej/git/zap/src-electron/validation/validation.js:38:10)
    at /home/timotej/git/zap/src-electron/rest/user-data.js:210:26
(Use `electron --trace-warnings ...` to show where the warning was created)
⇝ (node:2188796) UnhandledPromiseRejectionWarning: Unhandled promise rejection. This error originated either by throwing inside of an async function without a catch block, or by rejecting a promise which was not handled with .catch(). To terminate the node process on unhandled promise rejection, use the CLI flag `--unhandled-rejections=strict` (see https://nodejs.org/api/cli.html#cli_unhandled_rejections_mode). (rejection id: 1)
(node:2188796) [DEP0018] DeprecationWarning: Unhandled promise rejections are deprecated. In the future, promise rejections that are not handled will terminate the Node.js process with a non-zero exit code.

I have no idea what's going on, but there is no validation happening, numbers are not saving and exceptions are coming from back-end.
Please take a look.


Moved: Z-Library.Z-Library version 1.0.0

https://github.com/microsoft/winget-pkgs/pull/123879

[x] Have you signed the Contributor License Agreement?
[x] Have you checked that there aren't other open pull requests for the same manifest update/change?
[x] This PR only modifies one (1) manifest
[x] Have you validated your manifest locally with winget validate --manifest <path>?
[ ] Have you tested your manifest locally with winget install --manifest <path>?
[x] Does your manifest conform to the 1.4 schema?

Note: <path> is the name of the directory containing the manifest you're submitting.

Microsoft Reviewers: Open in CodeFlow

Possible duplicate package entry.
Similar installer SHA256 hash found in manifest:

InstallerSha256: 96eba9b6c29a025fc3984926ea2c5f05181fde18d825f0ab823e5e172369b7e8

manifests\z\Z-Libray\Z-Libray\1.0.0

This appears to be fixing the typo by adding an R near the end Libray --> Library

@wingetbot waivers Add Validation-Domain


Make tm.snmk working without LastFrameRoi.txt

Currently, one has to define at least one ROI manually to use the sm workflow. By default the sm workflow should create the whole_tissue ROI, therefore the manual ROI definition should be just an option.
Additionally, I would rename LastFrameRoi.txt into userRois.txt in the entire pipeline... (tedious !)

makes sense I'll have a look but not before end of next week

Done ! Included in the new UserRoiTracking.R script. I propagated changes in all related files by using "search in files" in RStudio.


Add TaskQueueStats to DescribeTaskQueueEnhanced

What was changed

Add TaskQueueStats to DescribeTaskQueueEnhanced to report backlog info and task add/dispatch rate.
Why?

Useful for worker scaling.
Checklist

Closes

How was this tested:

Functional test added.

Any docs updates needed?

Yes, will do in a separate PR.

@cretz @Quinn-With-Two-Ns it seems we are unblocked, dependency-wise. Can we get this PR merged?


pull request for e2e test at 01/09/2017 16:15:14

:white_check_mark: Validation status: passed
For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


chore(tree): Move tree related files to root of the lib

Cleanup PR.

Moved reth-blockchain-tree/sc/tree/* files to reth-blockchain-tree/sc/*`
moved eth dao state change file from tree to revm crate, as it is not used by tree.
move test_util files of BlockExecutor and Factory from tree to the reth_provider.

🤖 Generated by Copilot at d2a94c0
Summary
🔀🚚🧪

This pull request refactors the blockchain_tree and revm crates to simplify the module structure, improve the import organization, and enable testing with a mock executor. It also moves the DAO hardfork logic from the blockchain_tree crate to the revm crate, where it belongs. It renames, deletes, and moves several files to reflect the new structure.

We're moving chain to the root, and blockchain_tree too
We're dropping reth-blockchain-tree and adding eth_dao_fork new
We're heaving on the TestExecutor, and the BlockExecutor trait
We're refactoring engine and executor, and we're doing it great

Walkthrough

Reorganize the blockchain_tree crate to expose all the modules and types at the crate root, instead of nesting them under the blockchain_tree sub-module (link,link,link,link,link,link)
Update the imports of the blockchain_tree crate in the chain and engine modules, and remove the dependency of the blockchain_tree crate from the revm crate (link,link,link)
Move the TestExecutor and TestExecutorFactory types from the blockchain_tree crate to the provider crate, and implement the BlockExecutor trait for the TestExecutor type (link,link,link,link,link,link,link)
Add the eth_dao_fork module to the revm crate, which contains the data and logic for the DAO hardfork state change (link,link)
Update the imports and references of the DAO_HARDFORK_BENEFICIARY and DAO_HARDKFORK_ACCOUNTS constants in the executor module in the revm crate (link,link,link,link,link,link,link)
Remove an unused import of BlockChainId from the blockchain_tree module (link)
Simplify the imports of the blockchain_tree module by using a crate-level import instead of multiple sub-module imports (link)

Codecov Report

Merging #2359 (d2a94c0) into main (e2c2707) will decrease coverage by 55.62%.
The diff coverage is 0.00%.

:mega: This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more
@@             Coverage Diff             @@
##             main    #2359       +/-   ##
===========================================
- Coverage   72.05%   16.43%   -55.62%
===========================================
  Files         480      479        -1
  Lines       58130    58123        -7
===========================================
- Hits        41886     9553    -32333
- Misses      16244    48570    +32326

Flag
Coverage Δ

integration-tests
16.43% <0.00%> (-2.41%)
:arrow_down:

unit-tests
?

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

crates/blockchain-tree/src/block_indices.rs
0.00% <ø> (ø)

crates/blockchain-tree/src/blockchain_tree.rs
0.00% <ø> (ø)

crates/blockchain-tree/src/chain.rs
0.00% <ø> (ø)

crates/blockchain-tree/src/config.rs
0.00% <ø> (ø)

crates/blockchain-tree/src/externals.rs
0.00% <ø> (ø)

crates/blockchain-tree/src/lib.rs
0.00% <ø> (-100.00%)
:arrow_down:

crates/blockchain-tree/src/post_state_data.rs
0.00% <ø> (ø)

crates/blockchain-tree/src/shareable.rs
0.00% <ø> (ø)

crates/consensus/beacon/src/engine/mod.rs
3.85% <ø> (-88.21%)
:arrow_down:

crates/revm/src/executor.rs
0.00% <0.00%> (-89.93%)
:arrow_down:

... and 2 more

... and 338 files with indirect coverage changes
Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.


Change test execution order

closes #1100
Checklist before merging

[x] I added an appropriate entry to CHANGELOG.md
[x] I merged main into the current branch.

I guess that pytest-order was not working.. to bad, but thanks for trying! Thus I agree that it's fine to fix this issue as part of the ci.yml file.
I have a couple of comments:

Is there a reason for using
poetry run coverage run -p --concurrency=thread,greenlet,multiprocessing -m pytest -k "tests/api"

rather than one of
poetry run coverage run -p --concurrency=thread,greenlet,multiprocessing -m pytest tests/api
poetry run coverage run -p --concurrency=thread,greenlet,multiprocessing -m pytest tests/api/*.py

?
I find the latter two options a bit more transparent, if one doesn't want to go look in the pytest documentation.

I'd rather avoid the fact that tests in tests/ are not run unless they are part of a subfolder. Also: the others subfolder is not really relevant..
If we follow point 1, then we could simply add
poetry run coverage run -p --concurrency=thread,greenlet,multiprocessing -m pytest tests/*.py

as a last line, and in my understanding we wouldn't need to use the others folder at all.

Could you please sort test groups as detailed in the issue? Or was there a reason for changing the order?

Ref https://github.com/fractal-analytics-platform/fractal-server/issues/1100#issuecomment-1895765277

This PR works, but it introduces an important regression in the CI total time:

I think we should find a better way, or close this.

What about https://pytest-order.readthedocs.io/en/latest/configuration.html#order-marker-prefix? Would it be an option?
Downside: a lot of decorator. This can be maybe solved with https://stackoverflow.com/a/68573824/19085332?


audio crackling after enhancements modifications.

Hi, when i followed the first tutorial, at the end you said to change rate from 44100 to 16000, and it works perfectly, but with the change to pulseaudio, we go back to 44100 and the crackling come back. Is there any way to change this to 16000 ? If yes, could you say where are all the 44100 values to change plz ?
Thanks.

No idea.  If you figure this out, please let me know.  There is some optimization I think we need to put in place within pulse audio.  I'd start by looking at this conf file /etc/pulse/client.conf


#515 Unable to create SlashHandler with same value, different @mention

Ticket
#515
Description
Previously, we were not able to register two slash commands having the same name. This was done in order to avoid registering duplicates. However, two slash commands having the same name are not necessarily duplicates as they can differ in bot's mention required property : In fact, we can have one command requiring bot's mention while the second one is not requiring it. In this case, both of them should be registered.
The issue was coming from the fact that we only relied on command's name to check if it is not already present in the registry. The fix was to check the bot's mention required property as well.

ok to test


[FR]: Provide a way to overwrite existing npm dependency with a Bazel build target

What is the current behavior?
No response
Describe the feature
We have a number of npm dependencies that rely on the lifecycle scripts to build themselves using gyp. Instead of using gyp, we would like to build these packages using our own hermetic cc toolchain in Bazel. It would be great if there is a way to substitute a package in npm_translate_lock with a Bazel target.
Example hypothetical API to substitude node-re2 npm dependency with @node-re2 target:
npm_translate_lock(
  inject_packages = {
     "node-re2@*": "@node-re2//:node-re2"
  }
)

This is now supported with replace_packages in npm_translate_lock: https://github.com/aspect-build/rules_js/pull/1481


Clean up docker-faq.adoc

Spinoff from #1114 which will clean up One sub chapter, while this cleans up the rest of the file.

It felt like developer notes and now seems more FAQ

I actually think the FAQ text copied over from the old docker-solr project was written even before our Dockerfile had the VOLUME declaration, and before data folder was moved to /var/solr. So lots of doc rot there.

The fact that this PR is not yet in the productive documentation https://solr.apache.org/guide/solr/latest/deployment-guide/docker-faq.html as of 2023-03-07 is a source of confusion! The current documentation does not reflect the move of the data folder!

I don't believe changes to ref guides go immediately (unlike the website changes)...    We don't have a "quick push this change to productioin ref guide" that isn't tied to a release.   Hopefully 9.6 will be out soon, and I don't think this will justify a 9.5.x release...

Hmm, if I'm not mistaken, a merge of this fix to branch_9_5 may actually update the 9.5 guide. Let me try.

If this works...    I wonder if we should try an establish a stronger pattern for doc fixes going main --> branch_9x and --> branch_9_5 ?   Though it is a whole nother step....

I did a push, let's wait for daily build of https://ci-builds.apache.org/job/Solr/job/solr-reference-guide-official/ - I think it will kick off in an hour or so.

The theory behind the guide build is that there is not supposed to be any functional change within a minor version, so any fixes pushed to branch_9_5 are by definition bug fixes, including fixes to ref guide. This makes it safe to build the guide immediately even without a code release.
We could even use this to push "Errata" entries to the guide after we discover bugs in a release that will not be fixed in an upcoming release...

Hmm, if I'm not mistaken, a merge of this fix to branch_9_5 may actually update the 9.5 guide. Let me try.

You are not mistaken!


Bankvalue: calculate master scroll book value

Calculates the value of all the teleport scrolls in a master scroll book (if the item is in the bank) and adds them to bank value.

Are these varbits set on login? If not, we likely can't rely on their values.


Use the prop-types package and class Component to fix the React warning

#195

Use prop-types package to fix the first warning
Use class Component to fix the second warning

I didn't use mocha to test it , but the examples can run without warning and errors

Looks really good, thanks a lot.
Will merge and publish later today!


add huntr

Looks good. Before merging, we need a small correction: name should be capitalized, as this is how the vendor stylizes it.

@ndr-qef sorry, just fixed

No problem. Thanks again for your contributions.


Dockerization for VATUSA deployment

Optimize build and use nginx to keep things slim

Will reopen after I figure out poi