Add documentation for the library

[ ] create a documentation webpage (using MkDocs)
[ ] update basic info in the README

Codecov Report
All modified lines are covered by tests :white_check_mark:

Comparison is base (05b74f6) 100.00% compared to head (b985e11) 100.00%.

Additional details and impacted files
@@            Coverage Diff            @@
##              main        #3   +/-   ##
=========================================
  Coverage   100.00%   100.00%
=========================================
  Files            2         2
  Lines           41        41
=========================================
  Hits            41        41

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


[BACKLOG-12442] Update UX for job executor dialog

@ddiroma

Build Completed
:fire: This pull request has some issues. It would be preferable to fix them in order for it to be just perfect. See below for more details. Some links are also available below for further assistance in addressing those issues.
Build Commands
ant -Dtestreports.dir=bin/reports/unit-test -f engine/build.xml clean-all resolve jacoco && ant -f engine/build.xml checkstyle publish-local
ant -Dtestreports.dir=bin/reports/unit-test -f ui/build.xml clean-all resolve jacoco && ant -f ui/build.xml checkstyle publish-local

Cleanup Commands
rm -r ~/.ivy2/local || echo no publish local to remove

Changed files
  engine/src/org/pentaho/di/trans/steps/jobexecutor/messages/messages_en_US.properties
  ui/src/org/pentaho/di/ui/trans/steps/jobexecutor/JobExecutorDialog.java

Unit test coverage change
These statistics help you identify how your changes have affected the coverage of the following files. If a file is not in this list, then its coverage was not affected by your changes. To get some help interpreting these metrics, please refer to Jacoco's documentation.
org.pentaho.di.core.auth.core.impl.DefaultAuthenticationConsumerFactory

Branch Change: -7.14%:small_red_triangle_down:
Complexity Change: -7.69%:small_red_triangle_down:

org.pentaho.di.core.injection.bean.BeanInjector

Branch Change:  + .84%
Complexity Change:  + 1.39%

org.pentaho.di.job.entries.evaluatetablecontent.JobEntryEvalTableContent

Branch Change: -1.01%:small_red_triangle_down:
Complexity Change: -1.06%:small_red_triangle_down:
Instruction Change: -.17%:small_red_triangle_down:

org.pentaho.di.job.entries.sql.JobEntrySQL

Instruction Change: -3.28%:small_red_triangle_down:
Line Change: -3.87%:small_red_triangle_down:

org.pentaho.di.trans.step.StepMeta

Instruction Change:  + .19%
Line Change:  + .26%

org.pentaho.di.trans.steps.checksum.CheckSumMeta

Instruction Change: -.11%:small_red_triangle_down:

org.pentaho.di.trans.steps.datagrid.DataGridMeta

Instruction Change: -.09%:small_red_triangle_down:

org.pentaho.di.trans.steps.ifnull.IfNullMeta

Branch Change:  + 2.00%
Complexity Change:  + 1.89%
Instruction Change:  + .17%

org.pentaho.di.trans.steps.singlethreader.SingleThreaderMeta

Instruction Change: -.10%:small_red_triangle_down:

org.pentaho.di.trans.steps.sortedmerge.SortedMergeMeta

Instruction Change: -.18%:small_red_triangle_down:

org.pentaho.di.trans.steps.synchronizeaftermerge.SynchronizeAfterMergeMeta

Instruction Change:  + .04%

org.pentaho.di.trans.steps.uniquerows.UniqueRowsMeta

Instruction Change: -.18%:small_red_triangle_down:

org.pentaho.di.trans.steps.webservices.WebServiceMeta

Branch Change: -1.79%:small_red_triangle_down:
Complexity Change: -1.19%:small_red_triangle_down:
Instruction Change: -.07%:small_red_triangle_down:

@bmorrise Do all the colons need to be escaped in the properties file...e.g. :

I am going to merge this so it goes into tonight's build and we'll revisit this in the AM


after_find called twice

after_find is being called twice, after find. seeing this from 1.0.0 up to 1.0.3.

Can you help us with a failing test or steps to reproduce?


Optimize Crater Lake IPMI (main_v2)

Note: This is the first package in PR189 (subset of PR189)
Optimize CL IPMI and libraries
Summary:
- Move IPMI handler from project code to common code.
- Move some IPMI handler related libraries from project code to common code.
- Reconstruct folders: create "hal", "lib" directory in common code.
-lib: Includes common library for corresponding feature or general sharing between different threads.
Such as FRU, GUID, Firmware update, …, and Utility Library (eg. checksum function, etc).
-hal: This is hardware abstract layer which includes I2C, PECI, GPIO and JTAG communication API.

Should this be building on Yv3.5 BB or is it expected not to in this state?

Hi @GoldenBug

The pic shows OpenBIC code optimization sequence.
For each PR, BB should also be building but we didn't modify the BB portion at the beginning.
Do you observe any issues on building BB BIC?
Reminder:
Pls review code from this PR and notfrom PR #189 because PR #189 is only for architecture overview and is out-of-date.

Hi @GoldenBug
Just saw the CI build BB fail - would you mind to let it go first. let's see the BB build status at the PR for BB change.

Yes I think that's fine in order to keep this moving.

Committed seperately


Uncaught TypeError: Cannot convert undefined or null to object when I try session.connect

My Opentok setup used to work but recently I started getting an error. The browser I'm using is:
-Chrome Version 69.0.3497.100 (Official Build) (64-bit)
macOS Sierra Version 10.12 Beta
ruby '2.5.1
gem 'opentok', '~> 3.0.3'
gem 'rails', '~> 5.2.1'
Please see below the error I'm getting:
index.js:20 Uncaught TypeError: Cannot convert undefined or null to object
    at slice (<anonymous>)
    at nodeListToArray (index.js:20)
    at selectorToElementArray (index.js:70)
    at new ElementCollection (index.js:103)
    at module.exports (shorthandSelector.js:6)
    at Object.browserAjax.request (browser.js:52)
    at Object.browserAjax.post (browser.js:95)
    at analytics.js:17
    at loop (QueueRunner.js:22)
    at QueueRunner.run (QueueRunner.js:26)

nodeListToArray | @ | index.js:20
-- | -- | --
  | selectorToElementArray | @ | index.js:70
  | ElementCollection | @ | index.js:103
  | module.exports | @ | shorthandSelector.js:6
  | browserAjax.request | @ | browser.js:52
  | browserAjax.post | @ | browser.js:95
  | (anonymous) | @ | analytics.js:17
  | loop | @ | QueueRunner.js:22
  | run | @ | QueueRunner.js:26
  | add | @ | QueueRunner.js:9
  | post | @ | analytics.js:17
  | Analytics.logEvent | @ | analytics.js:130
  | (anonymous) | @ | analytics.js:75
  | (anonymous) | @ | guid_storage.js:118
  | get | @ | guid_storage.js:126
  | getClientGuid | @ | guid_storage.js:30
  | guidStorage.get | @ | guid_storage.js:96
  | logEvent | @ | analytics.js:66
  | Session.logEvent | @ | index.js:531
  | Session.connect | @ | index.js:768
  | (anonymous) | @ | 33:255

when I run this code:
  // Connect to the Session using a 'token'
  session.connect(token, function(error) {
    if (error) {
      console.log("Error connecting: ", error.name, error.message);
    } else {
    debugger
    var publisher = OT.initPublisher('publisher-div', {
                                              frameRate: 80,
                                              insertMode: 'append',
                                              width: '300px',
                                              height: '220px'
                                            }
                                    );
      session.publish(publisher);
      console.log("Connected to the session.");
    }
  });

The error comes from this file: webpack:///./src/js/common-js-helpers/elementCollection/index.js
// A helper for converting a NodeList to a JS Array
const nodeListToArray = function nodeListToArray(nodes) {
  if (env.name !== 'IE' || env.version > 9) {
    return Array.prototype.slice.call(nodes);  // <=---- This line returns the error because nodes is undefined
  }

  // IE 9 and below call use Array.prototype.slice.call against
  // a NodeList, hence the following
  const array = [];

  for (let i = 0, num = nodes.length; i < num; ++i) {
    array.push(nodes[i]);
  }

  return array;
};

My token, api and sessionId are already set up and are correct.

@richardsondx Thanks for sharing your stack trace and code. This does not look line an issue that's related to the Ruby SDK, but could be related to the JS SDK.
Could you please open an issue on the following repo with the stack trace?https://github.com/opentok/opentok-web-samples

@msach22 I wouldn't close this since I'm using the RUBY SDK Gem.. other ruby developers will experience this issue.


Last commit to master branch lost several src/ files

c02ba17   has mysteriously lost src/ and src/resources files

This is due to a rewrite of the internals for the inclusion of the continuous time simulation and the migration to Documenter.jl. I hope to have restored all functionality by the end of the month. The previous version can be found in the release-0.3 branch.
The new code is a lot more julian and less pythonic;) JuliaCon was a big inspiration for the changes.

Ok sounds good. Just wanted to make sure you're aware of it and nothing weird happened.


[T5A2][F10-B2]Ravi Shwetha

Ready for Review

@ravishwetha : Some comments added. Please close the PR after reading comments.


Disable complexity warnings?

I added the next option to my .vimrc:
let g:flake8_complexity_marker=''  " disable McCabe complexity warnings
But running flake#Flake8()  still displays complexity warnings:

Could you please advise?

It’s probably easiest if you turn off complexity checking in flake8 directly (using the .flake8 config file). For example:
[flake8]
max-complexity = 99

Does that do the trick?


Visual glitch: wrong background for new Bot Settings header notification

Version
1.3.1-nightly.219396.61c944a
To Reproduce
Steps to reproduce the behavior:

Go to the new bot settings page while a notification is active (with a ⚠ or 🛑 icon)

Expected behavior
The notification icon/number should get the same "dark mode" treatment as the rest of that new header block and toolbar.
Screenshots

Closing as the UI has been completely redone


Race condition in startup causing panic

This only happens sometimes. Have noticed on many different ROMs, so I don't think it is ROM specific.
On OSX Yosemite.
> ./Fergulator test_roms/nestest.nes
2015/02/08 12:15:10 nestest .nestest.state
-----------------
ROM:
  PRG-ROM banks: 1 (1 real)
  CHR-ROM banks: 2 (1 real)
  Mirroring: Horizontal
  Mapper: 0x0 -> NROM
fatal error: unexpected signal during runtime execution
[signal 0xb code=0x1 addr=0x3b0 pc=0x7fff92b59c30]

runtime stack:
runtime.gothrow(0x43986f0, 0x2a)
	/usr/local/Cellar/go/1.4.1/libexec/src/runtime/panic.go:503 +0x8e
runtime.sigpanic()
	/usr/local/Cellar/go/1.4.1/libexec/src/runtime/sigpanic_unix.go:14 +0x5e

goroutine 1 [syscall, locked to thread]:
runtime.cgocall_errno(0x40042a0, 0xc2080e7cf8, 0xc200000000)
	/usr/local/Cellar/go/1.4.1/libexec/src/runtime/cgocall.go:130 +0xf5 fp=0xc2080e7cd8 sp=0xc2080e7cb0
github.com/go-gl/gl._Cfunc_glewInit(0x0)
	github.com/go-gl/gl/_obj/_cgo_gotypes.go:4399 +0x4b fp=0xc2080e7cf8 sp=0xc2080e7cd8
github.com/go-gl/gl.Init(0xc20800c700)
	/Users/xavier/Code/go/src/github.com/go-gl/gl/gl.go:1232 +0x28 fp=0xc2080e7d08 sp=0xc2080e7cf8
main.(*Video).initGL(0x45c6660)
	/Users/xavier/Code/go/src/github.com/scottferg/Fergulator/video.go:86 +0x27 fp=0xc2080e7da8 sp=0xc2080e7d08
main.(*Video).Init(0x45c6660, 0xc20809b3e0, 0x7fff5fbff79f, 0x7)
	/Users/xavier/Code/go/src/github.com/scottferg/Fergulator/video.go:76 +0x392 fp=0xc2080e7e40 sp=0xc2080e7da8
main.main()
	/Users/xavier/Code/go/src/github.com/scottferg/Fergulator/main.go:77 +0xaa1 fp=0xc2080e7f98 sp=0xc2080e7e40
runtime.main()
	/usr/local/Cellar/go/1.4.1/libexec/src/runtime/proc.go:63 +0xf3 fp=0xc2080e7fe0 sp=0xc2080e7f98
runtime.goexit()
	/usr/local/Cellar/go/1.4.1/libexec/src/runtime/asm_amd64.s:2232 +0x1 fp=0xc2080e7fe8 sp=0xc2080e7fe0

goroutine 5 [chan send]:
github.com/scottferg/Go-SDL/sdl.pollEvents()
	/Users/xavier/Code/go/src/github.com/scottferg/Go-SDL/sdl/event.go:37 +0x1dc
created by github.com/scottferg/Go-SDL/sdl.init·1
	/Users/xavier/Code/go/src/github.com/scottferg/Go-SDL/sdl/event.go:64 +0x25

goroutine 17 [syscall, locked to thread]:
runtime.goexit()
	/usr/local/Cellar/go/1.4.1/libexec/src/runtime/asm_amd64.s:2232 +0x1

Looks similar to latest updates on https://github.com/tedsta/gosfml/issues/2

It's definitely not ROM specific and it's plagued me for ages. Thanks for the formal bug, I need a kick in the butt to fix this since it's pretty bad these days.

Things I have learned. Much of this is likely obvious.
It's a segfault in C-code
fatal error: unexpected signal during runtime execution
[signal 0xb code=0x1 addr=0x3b0 pc=0x7fff92b59c30]

From https://groups.google.com/forum/#!topic/golang-nuts/65pdWIYga4E "code 0x0b is 11, which is SIGSEGV."
glewInit segfaults all the time
https://www.google.com/webhp?#q=glewinit segfault D:
Reproducing
Comment out everything after videoOut.Init(videoTick, nes.GameName) in main.go, which means it will exit as soon as it has inited, then: `while ./Fergulator smb.nes; do; done. That reliably produces a crash within a few runs.
Adding a one second sleep before the Init code, I still get crashes.
Commenting out everything except video init avoids the crash.
Workaround
PR incoming.


ListView jank when app resumed from background

This is something I noticed a while back and applies to any screen on any app, so it isn't specific to the version of flutter that was just released today.
I've provided a code sample below, but any screen with a ListView will work.
1.) Install a release version of the app on iOS (not sure about Android)
2.) Run app, and then send the app to the background
3.) Click the app icon to bring the app back up from the background and immediately swipe up or down.
4.) You will see jank on the scroll.
Additional notes:
1.) After resuming the app, if you pause for half a second before swiping then you will not see jank.
2.) You will continue to get jank until you stop scrolling for half a second.  Meaning if you click the app icon to resume the already running app, and you swipe immediately, and keep swiping then you will keep getting jank for many seconds.
3.) This is the weirdest one: If you are doing a screen record IT DOES NOT JANK.  I figured this out when trying to create a screen recording of the issue.
3.b.) I'm not sure what starting a screen recording does that resolves this issue, but Native iOS apps don't have this issue either way.
4.) It may seem like a minor issue, but in practice, users regularly start scrolling as soon as they resume apps with lists of data, which hurts the perceived quality of the app.
Here is a minimum code sample that you can plug into a new flutter project:
class _MyHomePageState extends State<MyHomePage> {
  @override
  Widget build(BuildContext context) {
    return Scaffold(
      appBar: AppBar(
        title: Text(widget.title),
      ),
      body: ListView.builder(
        itemCount: 200,
        itemBuilder: (BuildContext context, int index) {
          return Container(
            height: 100,
            color: index.isEven ? Colors.grey.shade600 : Colors.grey.shade800,
            child: Row(
              mainAxisAlignment: MainAxisAlignment.center,
              children: [
                Column(
                  mainAxisAlignment: MainAxisAlignment.center,
                  children: [
                    Text(
                      index.toString() + ' line of text',
                      style: const TextStyle(color: Colors.white),
                    ),
                    const SizedBox(height: 32),
                    Text(
                      index.toString() + ' line of text',
                      style: const TextStyle(color: Colors.white),
                    ),
                  ],
                ),
                const SizedBox(
                  width: 32,
                ),
                Column(
                  mainAxisAlignment: MainAxisAlignment.center,
                  children: [
                    Text(
                      index.toString() + ' line of text',
                      style: const TextStyle(color: Colors.white),
                    ),
                    const SizedBox(height: 32),
                    Text(
                      index.toString() + ' line of text',
                      style: const TextStyle(color: Colors.white),
                    ),
                  ],
                )
              ],
            ),
          );
        },
      ),
    );
  }
}

Flutter doctor --verbose
[✓] Flutter (Channel stable, 2.10.2, on macOS 12.2.1 21D62 darwin-arm, locale en-US)
    • Flutter version 2.10.2 at /Users//flutter
    • Upstream repository https://github.com/flutter/flutter.git
    • Framework revision 097d3313d8 (3 days ago), 2022-02-18 19:33:08 -0600
    • Engine revision a83ed0e5e3
    • Dart version 2.16.1
    • DevTools version 2.9.2

[✓] Android toolchain - develop for Android devices (Android SDK version 31.0.0)
    • Android SDK at /Users//Library/Android/sdk
    • Platform android-31, build-tools 31.0.0
    • Java binary at: /Applications/Android Studio.app/Contents/jre/Contents/Home/bin/java
    • Java version OpenJDK Runtime Environment (build 11.0.11+0-b60-7772763)
    • All Android licenses accepted.

[✓] Xcode - develop for iOS and macOS (Xcode 13.2.1)
    • Xcode at /Applications/Xcode.app/Contents/Developer
    • CocoaPods version 1.11.2

[✓] Chrome - develop for the web
    • Chrome at /Applications/Google Chrome.app/Contents/MacOS/Google Chrome

[✓] Android Studio (version 2021.1)
    • Android Studio at /Applications/Android Studio.app/Contents
    • Flutter plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/6351-dart
    • Java version OpenJDK Runtime Environment (build 11.0.11+0-b60-7772763)

@m-j-g
I tried to replicate on iOS device in release mode using latest stable and master, but was unable to replicate the jank behavior you reported.
https://user-images.githubusercontent.com/67046386/155082982-b98e06fa-6e78-4d2e-9655-3f2e1413ce92.MP4
Channel stable, 2.10.2
Channel master, 2.11.0-0.0.pre.634
However, I see a similar / related issue describing same case as yours, https://github.com/flutter/flutter/issues/96381. Please check that because the author of that issue does mention that they see a jank on scroll behavior after coming back from background. https://github.com/flutter/flutter/issues/96381#issuecomment-1009645653
Also this is similar, but including add2app behavior: https://github.com/flutter/flutter/issues/80367

Ahh yes. It does seem to be the same issue as https://github.com/flutter/flutter/issues/96381
I’m using an iPhone 11 Pro which falls in line with their discovery that it happens on iphoneX and later.

Closing this as a duplicate of https://github.com/flutter/flutter/issues/96381


"Lets reintroduce deadlocks! Yay!"

Frankly I am not impressed by your article.
by replacing let balance = 0; with
const balance = (() => {
  let amount = 0;
  return Object.freeze({
    amount: () => amount,
    add: (addend) => { amount += addend; return amount; },
    subtract: (subtractend) => { amount -= subtractend; return amount; },
  });
})();

and do the needul code changes were balance is accessed, you completely bypass the need for mutexes.
Mutexes only make sense in low level code that is written in an programming languages lacking encapsulation like js has.
Sorry, but not sorry bad practices such as using mutex must be discauraged.

That's a very valid point. Thanks for reading the article and for taking the time to create this issue.
The goal of balance in the example was just to simulate data available in a remote data source, therefore only accessible asynchronously.
One of the remarks we make at the end is to try to avoid implementing sequential access (in a mutex-like way) at all cost. We recommend preferring an "increment" primitive directly in the data source when that's available and we make an example with SQL.
I'd be happy to know what you think about this. I hope the article doesn't come through as a suggestion to use the mutex pattern everywhere without any due diligence on better alternatives...

That's a very valid point. Thanks for reading the article and for taking the time to create this issue.
The goal of balance in the example was just to simulate data available in a remote data source, therefore only accessible asynchronously.
One of the remarks we make at the end is to try to avoid implementing sequential access (in a mutex-like way) at all cost. We recommend preferring an "increment" primitive directly in the data source when that's available and we make an example with SQL.
I'd be happy to know what you think about this. I hope the article doesn't come through as a suggestion to use the mutex pattern everywhere without any due diligence on better alternatives...

Something related worth a watch.

Something related worth a watch.

While reading the article, that I enjoyed, I was thinking the hole time why are database transactions not in here.
The mutex thing is a valid design choice for some middleware, but @zarutian's snippet gave me ideas to refactor some of my in memory accounting/auditing.


RudderStack referrer bug

Describe the bug
Both @TiffanyGYJ  and @thisisjoshford are interested in knowing the user journey (how they got from one page to another). This requires referrer and initial_referrer to be correctly tracked with RudderStack. Until this is fixed, the measurement on user journey will be blocked. My understanding is that we plan to do more data driven analytics in the new year. In that case, this fix should be a priority in January.
Expected behavior

referrer should record the previous page tab_url
initial_referrer should record the initial referrer of the current page in the browser
See documentation here: https://www.rudderstack.com/docs/event-spec/standard-events/common-fields/

@jinouyang Closing this as not a bug. The referrer properties are automatically collected by Rudderstack, with data coming from a browser's document object itself. There are valid cases when this value is empty, such as when a user navigates to the page directly (not through a link, but, for example, by using a bookmark such as a homescreen icon on a mobile device.)

i've found an alternate path forward.

Testing initial referrer vs. referrer does appear that this might be buggy
Here's a specific example session, where we can see page changing, but referrer is set to $direct along with initial referrer (I usually would expect this to change).
Als looking across the data (query - I excluded when the URL matched the first URL of the session) it appears that Initial Referrer and Ref might be the same sometimes as high as 80%

Reopening since we was not able to fully resolve the issue: when the page is not full reloaded, referrer won't be accurate. Potential solution discussed with @charleslavon : storing the last url in local storage or cookie
Context: this is flagged as a high priority by Founder Success lead.


'Operation not permitted' when accessing network shares mounted with drvfs from an IBM iSeries host

Currently using Insider build 16176.
When attempting to access a network share from an IBM iSeries running OS version V5R1 (if that matters), any command returns the error "Operation not permitted".  Like so:
$ sudo mkdir /mnt/ibm
$ sudo mount -t drvfs '\\ibmserver\ifs' /mnt/ibm
$ ls /mnt/ibm
ls: reading directory '/mnt/ibm': Operation not permitted
$ sudo ls /mnt/ibm
ls: reading directory '/mnt/ibm': Operation not permitted

Also tried mapping the share to a Windows drive letter first, but the same result was encountered:
$ sudo mount -t drvfs Z: /mnt/ibm
$ ls /mnt/ibm
ls: reading directory '/mnt/ibm': Operation not permitted
$ sudo ls /mnt/ibm
ls: reading directory '/mnt/ibm': Operation not permitted

I have verified in Windows Credential Manager that all of the credentials are correct and, indeed, simply accessing the files via Windows Explorer like "normal" works just fine.  It is also worth noting that accessing removable storage (USB thumb drive) and folders shared from other Windows machines appears to work fantastically.

Not sure if it's relevant, but thought I'd also include that our IBM server is a "System p" and not an "AIX" server.

Can you share what network file protocol the server is providing?

Hi @mphaney
Could you run enable tracing as per the instructions here under point 8, and send me the log files? Hopefully it'll provide a clue as to what's going wrong.

@dethoma When I spoke with our system manager, he believed it is providing both NFS and Samba.  Unfortunately I don't know enough to be able to judge the usefulness or accuracy of that statement.
@SvenGroot Attached are the 4 log files generated.  Thank you!
drvfs_mount_logs.zip

Rats. Appears to still be an issue in build 16188. Anything else I can try to provide? @SvenGroot @dethoma?

The logs are empty for me, can you start the logs before you do the first bash launch and then stop it after you close the bash instance?

Dang it. Ok, with a freshly rebooted system, I opened up an elevated command prompt, ran exactly these commands (all from within the same window):
> logman.exe create trace lxcore_kernel -p {0CD1C309-0878-4515-83DB-749843B3F5C9} -mode 0x00000008 -ft 10:00 -o .\lxcore_kernel.etl -ets
> logman create trace lxcore_adss -p {754E4536-6735-4194-BE81-1374BD2E9B0D} -ft 1:00 -rt -o .\lxcore_adss.etl -ets
> logman create trace lxcore_user -p {D90B9468-67F0-5B3B-42CC-82AC81FFD960} -ft 1:00 -rt -o .\lxcore_user.etl -ets
> logman create trace lxcore_service -p {B99CDB5A-039C-5046-E672-1A0DE0A40211} -ft 1:00 -rt -o .\lxcore_service.etl -ets

> bash
$ sudo mount -t drvfs '\\qspokane\usr\local\zendsvr6\var\log' /mnt/logs
$ ls /mnt/logs
$ sudo ls /mnt/logs
$ sudo umount /mnt/logs
$ exit

> logman stop lxcore_kernel -ets
> logman stop lxcore_adss -ets
> logman stop lxcore_user -ets
> logman stop lxcore_service -ets

Then I rebooted again and did the same thing except with a non-elevated command prompt.  Zipped all of the files up here. Sure hoping I got it right this time :-P
drvfs_mount_logs.zip

Just another quick update to note the problem still exists in build 16193 (so much for hoping for dumb luck :-) ).  @dethoma How'd I do on the logs this go-around?

Thanks for sharing the logs, we are failing on the getdents system call(used with ls) with the file share and also failing on querying volume information on it. Since we only support SMB today it is highly likely there is some aspect of the server that is not compatible with our SMB expectations if it is indeed an SMB server.
From regular Windows cmd prompt how are you accessing this share today? That will reveal more clues.

From the regular cmd prompt, the follow commands have always worked successfully for me:
> net use y: \\qspokane\usr\local\zendsvr6\var\log
> y:
> dir

I'll see if I can figure out whether it's truly using SMB or not. The tools IBM gives us to configure these things aren't terribly verbose, so I'm kind of flailing blind.

You could start a packet trace when you run that command and see what happens after the mount command using Wireshark. Just a thought.

Ok, this is my first shot at a Wireshark trace. Hopefully I've exported relevant data. This trace represents the initial mount after a fresh boot (which gave no errors on the screen), an attempt to list the contents of the mounted folder, and a subsequent umount:  https://pastebin.com/vecKavEJ
Thank you. Let me know if I can provide anything else.

Everything is SMB1, so yeah. Would it work better if you used the net use from Windows first? You could add that to your bash shell.

We believe we understand this issue. The problem is that the server does not support the file enumeration class we're using to list the directory. We've recently fixed this internally by allowing DrvFs to fall back to a different enumeration class if the preferred one isn't supported. This fix should be available in a future insider build.

Excellent, thank you! I look forward to seeing that :-)


Template debugging

Currently recommend approach to template debugging is:
https://gohugo.io/templates/template-debugging/
{{ printf "%#v" $.Site }}
{{ printf "%#v" .Permalink }}
{{ printf "%#v" . }}

It would be far more convenient and more powerful if https://github.com/davecgh/go-spew was added as a template function so we can do something like:
{{ spew $.Site }}

It will look like this sort of thing:
(main.Foo) {
 unexportedField: (*main.Bar)(0xf84002e210)({
  flag: (main.Flag) flagTwo,
  data: (uintptr) <nil>
 }),
 ExportedField: (map[interface {}]interface {}) {
  (string) "one": (bool) true
 }
}

instead of:
hugolib.Pages{(*hugolib.Page)(0xc0003c7400), (hugolib.Page)(0xc0008b5400), (hugolib.Page)(0xc0008b4a00), (*hugolib.Page)(0xc0008b4f00)}

It will recursively dereference pointers.

Duplicate of #3957


Specifying migration name should not fail if migration has already been run

I opened a ticket on knex-migrate issue tracker, but after investigating, I feel this issue is really more about umzug.
When

doing an "up" migration
the migration name is specified
and the migration has already run

currently the library rejects the migration with the message: "Migration is not pending: %migration_name%".
I contend that this would be better as a success state. If I want a given migration to be run and it has already been run, then... mission accomplished? I think if this were the case, we could print "Migration already applied" and exit with a success status.
What do you think?

I'd be happy to submit a PR along these lines if this is something you'd be open to having changed.

I am suffering from the same error and totally agree with your thoughts on this @chadxz
Is anyone looking into how to fix this at all?

Yes we're discussing this. Existing flows might be depending on the current behaviour, making this a breaking change. So any update will be in v3, which isn't finalised yet. We can use this issue to discuss what the behaviour should be. As I see it there are three options, when an already-run migration is explicitly requested:

Throw
No-op
Run again

It sounds like the request here is 2. Is that right?

@mmkal Yes, option 2 would be preferable. You could add an option to control this behaviour to avoid breaking any existing code that relied on the old behaviour - e.g.:
await umzug.up({ to: '20141101203500-task', alreadyAppliedBehaviour: Behaviour.NOOP });

where the default value would be Behaviour.THROW.

FWIW, my use case was this: I needed to run a single migration, then run some custom logic, then run the remainder of the migrations. I was able to work around the issue in this ticket with this:
I created a npm run script with the following:
knex-migrate list | grep -q '20180315084901_needed_migration_name' && echo 'YES' || echo 'NO'

Then checked the output of that command to determine whether it should run or not.

It sounds like the request here is 2. Is that right?

To me that would be the least surprising thing, which is always good 👍

Hi @asnaseer-resilient and @chadxz, I think it is a good idea to have this configurable, and the default choice could be the one such that no breaking change happens.
@mmkal what do you think?


Define why and what we're doing for MVP

The general MVP Project description is:
The Artificial Wisdom™ Cloud provides real-time dedicated accelerated compute to inference with ASL2 pre-trained models on your secured data.
We should be able to explain this in a more detailed overview.
Acceptance Criteria:

[x] Document describing the MVP and it's use cases

https://docs.google.com/document/d/12GqF2jaDrqHORuEy_UmNnPqy3CgqJKAjKpyhgzOnzwg/edit


Run a specific spec file end up running almost all tests

I just upgraded our application from Rails 3.2 to Rails 4.0
I am using Rspec-rails 3.6.0
When I run a single spec file with for example rspec spec/orders/order_spec.rb which only consists of 2 tests, rspec will run total 956 tests altogether. It doesn't start with the file that I want to run and it doesn't end with it either. All the extra tests it's running are not related.
This happens to every single test file that I run and it's taking extremely long time to run a file that only has 2 tests. I suspect that my Rspec config has something wrong but not sure which part.
Here is a part of my spec_helper.rb regarding to Rspec config:
RSpec.configure do |config|
  config.treat_symbols_as_metadata_keys_with_true_values = true
  config.filter_run :show_in_doc => true if ENV['APIPIE_RECORD']
  config.include Devise::TestHelpers, :type => :controller
  config.include ControllerMacros, :type => :controller
  #DatabaseCleaner.strategy = :transaction

  config.infer_spec_type_from_file_location! # Turn on file type by location

  VCR.configure do |c|
    c.cassette_library_dir = 'spec/cassettes'
    c.hook_into :webmock
    c.allow_http_connections_when_no_cassette = false
    c.configure_rspec_metadata!
    c.ignore_localhost = true
  end

  #config.fixture_path = "#{::Rails.root}/spec/seed_data"

  # Database cleaner strategy
  # from http://devblog.avdi.org/2012/08/31/configuring-database_cleaner-with-rails-rspec-capybara-and-selenium/

  config.before(:each) do
    DatabaseCleaner.strategy = :transaction
  end

  config.include(Matchers)

  config.before(:each, :js => true) do
    DatabaseCleaner.strategy = :truncation, { except: Dir["#{Rails.root}/test/fixtures/*.yml"].map do |f|
      f.match(/\/([^\/]*)\.yml/)[1]
    end - ['users'] }
  end

  config.filter_run_excluding :broken => true

  config.include FactoryGirl::Syntax::Methods
  # setup devise
  config.extend ControllerMacros, type: :controller
  config.extend ControllerAccessMacros, type: :controller
  config.include AccessTokenRequestHelper
  config.extend RequestDeviseMacros, type: :request
  config.include Macros::RequestAuthenticationMacros, type: :request
  config.include Devise::TestHelpers, :type => :controller
  config.include BasicAuthHelper, type: :controller
  config.extend Macros::DiaperMacros
  config.include Helpers::VariantHelper
  config.include Macros::OnTracMacros
  config.include Macros::CreditCardMacros
  config.include Macros::SftpMacros
  config.include Macros::AddressMacros
  config.include Macros::SettingMacros
  config.include Macros::FedexRateMacros
  config.include Macros::NestedAttributesFor
  config.extend Macros::QueueMacros
  config.include Macros::TaxMacros
  config.include Macros::WebmockMacros
  config.include Macros::TestingContext
  config.include Macros::FactoryGirlExtensionMacros
  config.extend PerformanceSpecHelper

  config.before(:suite) do
    ValueStore::LocalStorage.ensure_cache!
  end

  config.before(:all) do
    WebMock.disable_net_connect! :allow_localhost => true

  end

  config.before(:each, freeze_time: true) { Timecop.freeze }
  config.after(:each, freeze_time: true) { Timecop.return }

  stored_assets_cache = Rails.application.assets.cache
  config.before(:each, disable_assets_cache: true) do
    Rails.application.assets.cache = ActiveSupport::Cache.lookup_store(:null_store)
  end
  config.after(:each, disable_assets_cache: true) do
    Rails.application.assets.cache = stored_assets_cache
  end

  config.before(:each) do
    Rails.cache.clear
    RequestStore.clear!

    InventoryTracking.collection.drop

    @old_content_cached_values = ValueStore::LocalStorage::VALUES
    @old_content_cached_version = ValueStore::CachedVersion::LOCAL_VERSION || {}
    ActionMailer::Base.deliveries.clear

    stub_payment
    stub_refund
    stub_on_trac_zips
    stub_credit_card
    stub_tax_calculation
    stub_invalid_credit_card
    stub_address_validation(score: 100)
    stub_rate_request(shipping_speed: "SMART_POST")
    stub_rate_request(shipping_speed: "GROUND_HOME_DELIVERY")
    stub_rate_request(shipping_speed: "FEDEX_2_DAY")
    stub_rate_request(shipping_speed: "STANDARD_OVERNIGHT")
    stub_rate_request(shipping_speed: "multiple")

    stub_successful_bespin_charge
    stub_successful_bespin_delete
    stub_successful_bespin_refund

    #ap "Database Cleaner.start #{ValueStore::CachedValue.count}"
    DatabaseCleaner.start
    #ap "Database Cleaner.start #{ValueStore::CachedValue.count}"
    SarcasticBunny.clear!
    @old_cached_values         = ValueStore::LocalStorage.values
    allow(Airbrake).to receive(:notify)
    allow($redis).to receive(:lock_for_update) do |&block|
      block.call
    end
  end

  config.after(:each) do
    #ap "Database Cleaner.clean #{ValueStore::CachedValue.count}"
    DatabaseCleaner.clean
    #ap "Database Cleaner.clean done #{ValueStore::CachedValue.count}"
    Sidekiq::Worker.clear_all

    session = DataLogger.session
    session.collections.each do |collection|
      collection.delete_many({})
    end

    silence_warnings do
      ValueStore::LocalStorage::VALUES = @old_content_cached_values
      ValueStore::CachedVersion::LOCAL_VERSION = @old_content_cached_version
    end

    RequestStore.clear!

  end
end

Thank you!

Ok I figured out. We are using Factory Girl and previously the factories folder is under the root directory and all the factory specs are under ./spec and is also named factory. For some reason after the Rails 4 update, Factory Girl recognized the factory specs as factories and try to load them all. After I move the real factories folder inside ./spec, everything is solved.


feat: improve flashing speed

This PR improves the flashing speed by ignoring the pollTimeout returned by ST's DFU bootloader, which is way too long and just polls the status continuously.

Taking into account rounding error, and observer error/lag, basically no difference here atm yet.

It seems the PR has been deployed to buddy.edgetx.org as well...

Ok, that was more like it... Buddy now took about 24s to erase, 2m37s to write, for a total of 3m01s (on Linux) vs the (still) 55s overall with the preview build... T12MAX was ~18-19 seconds to erase and flash... at these speeds... I'll be DFU flashing instead of uploading to SD and bootloader flashing from now on :rofl:

Nice! Not sure what configuration has been made for the pages to deploy to production 🤔


Run EDPM job from podified-multinode-edpm-pipeline job template

https://github.com/openstack-k8s-operators/ci-framework/pull/534 adds the Zuul Project template for running content provider and edpm/baremetal jobs.
It will allow devs to update the job at one place and test anywhere. edpm-ansible-crc-podified-edpm-baremetal is the similar job of ci-framework-crc-podified-edpm-baremetal but different name.
Depends-On: https://github.com/openstack-k8s-operators/ci-framework/pull/548

recheck

recheck

recheck

recheck

recheck

recheck

recheck

/hold cancel


Header nav should be dropdown navigation bar to help navigate the site

Is your feature request related to a problem?
Its hard to some parts of the site like resources, it would be easier if the header nav had a dropdown for each section that related to it

A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
Want to access resources/press without having to scroll down page

Describe the solution you'd like
Dropdown navigation bar

A clear and concise description of what you want to happen.
Dropdown navigation bar for header

Describe alternatives you've considered
Links for each part of the site but that wouldnt work too well for a header

A clear and concise description of any alternative solutions or features you've considered.
Dropdown navigation bar for header

Additional context

Add any other context or screenshots about the feature request here.

Example from CreditKarma

/request Hi - can I tackle this one

Yes its yours @TiffanieJ

@fvntr pull-request added, thanks.

I will finish adding the last details on this @cclaro
Thank you for your contribution


Convolution1D inconsistent with Convolution2D

Convolution1D behaves differently from Convolution2D, e.g. the output shape are inconsistent. Shouldn't these two layers be equivalent for the following example?
from keras.models import Sequential
from keras.layers import Convolution1D, Convolution2D

model = Sequential()
model.add(Convolution2D(32, 1, 3, input_shape=(1, 1, 128)))
print(model.output_shape)  # -> (None, 32, 1, 126)

model = Sequential()
model.add(Convolution1D(32, 3, input_shape=(1, 128)))
print(model.output_shape)  # -> (None, -1, 32) instead of (None, 32, 126), which I would expect

Is this a bug or is there a reason for this that I don't understand?

Convolution1D(32, 3, input_shape=(128, 1)) # -> (None, 126, 32)

Ah, okay so it is like Convolution2D with the non-default dim_ordering ('tf' instead of 'th'). Maybe it would make sense to also have a dim_ordering argument for Convolution1D and have their default behaviors consistent ..
Anyways, thank you very much for your quick and helpful response!!!

Convolution1D is consistent with the recurrent and time-distributed layers

I see. Thanks again.


chore: cleanup header, Navbar

What changed? Why?
Follow-up on comments from PR #329
Notes to reviewers
How has it been tested?

@eragon512 let's run prettier to get the build passing and then we can approve and merge.

@arsood updated :+1:


Image import support

Removed custom parser and used remark + jsdom

This is an interesting approach. I see you're doing markdown-string -> remark-ast -> html-string -> dom -> contentState. I'm hesitant to proceed with this due to double-parsing, but maybe that's not a huge deal given the wins of using mostly other people's well-tested code for the various conversions. If we do proceed with this approach, I'll certainly want to use the browser's native html parser instead of jsdom's. See here for an example.
I have been working on a dev branch that uses remark to parse the markdown to ast, but in my implementation I started writing custom code to go from remark-ast -> contentState

Since draft-js doesn't support nested blocks for elements other then lists - https://facebook.github.io/draft-js/docs/advanced-topics-nested-lists.html i will make temporary fix for blockquote by removing inner paragraph node

Added temp fix for blockquote

This is an old issue and has some conflicts. I'll close for now, but I'd be open for another attempt in the future.


How to change the metro dialog style?

I get MahApps.Metro from nuget.
The metro dialog's button is too big, how can i change the metro dialog's button?
--
Environment

MahApps.Metro <IP_ADDRESS>
Windows 7
Visual Studio 2013
.NET Framework 4.5

What button are you talking about? Could you provide a screenshot?
Besides helping me understanding the problem, it's good for future reference.


Fix buttons

More minor version of Herbie's PR that just switched the position of the assignments and resources buttons because they were confusing me as I toggled between them.

Hey @anlandu do you think you could refactor based off of the current branch? There are 314 files changed because I think that your PR has a ton of font files... I'm going to close this for now but if/when you get a chance to take a look definintely please reopen! 🎉


Implementation of the term "Rotor diameter"

Description of the issue
Implementation of the term "Rotor diameter"
Ideas of solution
As subclass of: entity/continuant/specifically dependent continuant/quality (like hub height)
Workflow checklist

[ ] I discussed the issue with someone else than me before working on a solution
[ x] I already read the latest version of the workflow for this repository
[x ] The goal of this ontology is clear to me

I am aware that

[x ] every entry in the ontology should have a definition
[ x] classes should arise from concepts rather than from words

axioms:

rotor diameter has quantity value some length unit
wind energy converting unit has quality some rotor diameter


[Bug] Can't access one click llms on runpod

Checklist

[X] 1. I have searched related issues but cannot get the expected help.
[X] 2. The bug has not been fixed in the latest version.
[X] 3. Please note that if the bug-related issue you submitted lacks corresponding environment info and a minimal reproducible demo, it will be challenging for us to reproduce and resolve the issue, reducing the likelihood of receiving feedback.
[X] 4. If the issue you raised is not a bug but a question, please raise a discussion at https://github.com/sgl-project/sglang/discussions/new/choose Otherwise, it will be closed.
[X] 5. Please use English, otherwise it will be closed.

Describe the bug
Tried to use https://github.com/TrelisResearch/one-click-llms for llama 3.1 70b inference on runpod.
I've tried several model (llama 3.1 8b, 70b, ...) with several hardware (2xH100, 4xA100, ...) in several regions.
After the server started I could saw from the gpu memory saturation that the service was started. Yet I could not access the API.
I've tried from outside with the given runpod server address. Tried curl and python openai api. Zero success.
From the openai api the error was APIConnectionError, from curl was Connection refused.
Then changed strategy and tried locally, but with similar lack of luck. Curl still failed to connect to <IP_ADDRESS>, and the openai api still got APIConnectionError.
Server logs of one of tre runs:
2024-10-08T14:04:42.084138969-07:00
2024-10-08T14:04:42.084177391-07:00 ==========
2024-10-08T14:04:42.084182932-07:00 == CUDA ==
2024-10-08T14:04:42.084230141-07:00 ==========
2024-10-08T14:04:42.089361837-07:00
2024-10-08T14:04:42.089426700-07:00 CUDA Version 12.1.1
2024-10-08T14:04:42.090731427-07:00
2024-10-08T14:04:42.090738982-07:00 Container image Copyright (c) 2016-2023, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
2024-10-08T14:04:42.092021788-07:00
2024-10-08T14:04:42.092023251-07:00 This container image and its contents are governed by the NVIDIA Deep Learning Container License.
2024-10-08T14:04:42.092025495-07:00 By pulling and using the container, you accept the terms and conditions of this license:
2024-10-08T14:04:42.092027369-07:00 https://developer.nvidia.com/ngc/nvidia-deep-learning-container-license
2024-10-08T14:04:42.092028901-07:00
2024-10-08T14:04:42.092029813-07:00 A copy of this license is made available in this container at /NGC-DL-CONTAINER-LICENSE for your convenience.
2024-10-08T14:04:42.102473897-07:00
2024-10-08T14:04:48.672137338-07:00 [14:04:48] server_args=ServerArgs(model_path='NousResearch/Meta-Llama-3.1-70B-Instruct', tokenizer_path='NousResearch/Meta-Llama-3.1-70B-Instruct', tokenizer_mode='auto', skip_tokenizer_init=False, load_format='auto', dtype='auto', kv_cache_dtype='auto', trust_remote_code=False, context_length=8192, quantization='fp8', served_model_name='NousResearch/Meta-Llama-3.1-70B-Instruct', chat_template=None, is_embedding=False, host='<IP_ADDRESS>', port=8000, mem_fraction_static=0.87, max_running_requests=None, max_total_tokens=None, chunked_prefill_size=8192, max_prefill_tokens=16384, schedule_policy='lpm', schedule_conservativeness=1.0, tp_size=2, stream_interval=1, random_seed=948742540, constrained_json_whitespace_pattern=None, log_level='info', log_level_http=None, log_requests=False, show_time_cost=False, api_key=None, file_storage_pth='SGLang_storage', dp_size=1, load_balance_method='round_robin', dist_init_addr=None, nnodes=1, node_rank=0, json_model_override_args='{}', attention_backend='flashinfer', sampling_backend='flashinfer', disable_flashinfer=False, disable_flashinfer_sampling=False, disable_radix_cache=False, disable_regex_jump_forward=False, disable_cuda_graph=False, disable_cuda_graph_padding=False, disable_disk_cache=False, disable_custom_all_reduce=False, disable_mla=False, enable_mixed_chunk=False, enable_torch_compile=False, max_torch_compile_bs=32, torchao_config='', enable_p2p_check=False, triton_attention_reduce_in_fp32=False, lora_paths=None, max_loras_per_batch=8)
2024-10-08T14:04:55.513847948-07:00 [14:04:55 TP1] Init nccl begin.
2024-10-08T14:04:55.574631614-07:00 [14:04:55 TP0] Init nccl begin.
2024-10-08T14:04:57.108305808-07:00 [14:04:57 TP0] Load weight begin. avail mem=78.38 GB
2024-10-08T14:04:57.108327449-07:00 [14:04:57 TP1] Load weight begin. avail mem=78.38 GB
2024-10-08T14:04:58.483092543-07:00 [14:04:58 TP1] lm_eval is not installed, GPTQ may not be usable
2024-10-08T14:04:58.671272847-07:00 [14:04:58 TP0] lm_eval is not installed, GPTQ may not be usable
2024-10-08T14:04:59.586841489-07:00 INFO 10-08 14:04:59 weight_utils.py:236] Using model weights format ['.safetensors']
2024-10-08T14:04:59.668187687-07:00 INFO 10-08 14:04:59 weight_utils.py:236] Using model weights format ['.safetensors']
The log looks fine. But whenI tried with the exact curl command provided in the help of the template:
curl https://xxxxxxxxxxxxx-8000.proxy.runpod.net/v1/completions -H "Content-Type: application/json" -d '{"model": "NousResearch/Meta-Llama-3.1-70B-Instruct","prompt": "San Francisco is a","max_tokens":
7,"temperature": 0}'
I've gor error code: 502, which indicates server side problem.
I also tried the one-click vllm versions. Only the llama 3.1 8b model seems to work.
Reproduction
Even tried the openai endpoints:
curl https://xxxxxxxxxxxx-8000.proxy.runpod.net/openai/v1/completions
-H "Content-Type: application/json"
-d '{"model": "NousResearch/Meta-Llama-3.1-70B-Instruct", "prompt": "Say this is a test", "temperature": 0}'
curl localhost:8000/v1/completions
-H "Content-Type: application/json"
-d '{"model": "NousResearch/Meta-Llama-3.1-70B-Instruct", "prompt": "Say this is a test", "temperature": 0}'
curl http://<IP_ADDRESS>:8000/v1/completions
-H "Content-Type: application/json"
-d '{"model": "NousResearch/Meta-Llama-3.1-70B-Instruct", "prompt": "Say this is a test", "temperature": 0}'
client=OpenAI(base_url='https://xxxxxxxxxxxx-8000.proxy.runpod.net/openai/v1')
client=OpenAI(base_url='localhost:8000/openai/v1')
client=OpenAI(base_url='http://<IP_ADDRESS>:8000/openai/v1')
Environment
Environment was set with one click runpod template

cc @RonanKMcGovern

Thanks Lianmin (@merrymercy).
@kovern this is a question about the template rather than SGLang necessarily. I'll answer here, and feel free to follow up with a new issue in one-click-llms if the issues persist.

What GPUs did you select? Did you ensure that the tensor parallel setting in the template matches the number of GPUs you selected?

You should see a message in logs "the server is ready to roll" or similar. I don't see that in your logs. It looks like downloading is not complete.

I just ran on 2xA100. I had to wait a bit for weight downloads and ensure there was 200 GB of disk space (I've now set the template default to 250 GB).

Thanks

same issue here, pod has been deploying for 20min now and the same message is being logged to the console:

RunPod template:

1 x H100 SXM
26 vCPU 251 GB RAM

Looks like the mode name is wrong. There is no 3.2 for llama 8B
Swap to 3.1
If that’s an error in the template I’ll fix it later tonight. Thanks
On Sat 26 Oct 2024 at 02:00, Robert Czikkel @.***>
wrote:

same issue here, pod has been deploying for 20min now and the same message
is being logged to the console:
Screenshot.2024-10-26.at.00.49.15.png (view on web)
https://github.com/user-attachments/assets/69d087d4-603a-40ae-ba88-2a9c0824e304
RunPod template:
Screenshot.2024-10-26.at.00.50.26.png (view on web)
https://github.com/user-attachments/assets/54f93a35-31a5-4009-9ea2-9f4f0cd58d37
1 x H100 SXM
26 vCPU 251 GB RAM
—
Reply to this email directly, view it on GitHub
https://github.com/sgl-project/sglang/issues/1610#issuecomment-2439058271,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ASVG6CRLVJUOVJI4M2JBMXDZ5LLRVAVCNFSM6AAAAABPS5T4D6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDIMZZGA2TQMRXGE
.
You are receiving this because you were mentioned.Message ID:
@.***>


Missing files in sample application linked from article

I've just downloaded the master branch of the Power BI Developer Samples linked from this article and attempted to use the AppOwnsData sample for .NET Framework. When then running the application, it fails due to missing files (initially powerbi.js, then others). If this sample is intended to be used for a tutorial, it would be good if it actually worked!

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 54016cab-2de5-0d30-2dfa-ee386dcfb881
Version Independent ID: 4e464b91-bc16-270d-cd51-9bfa396c0326
Content: Embed content in your application for your customers - Power BI
Content Source: powerbi-docs/developer/embedded/embed-sample-for-customers.md
Service: powerbi
Sub-service: powerbi-developer
GitHub Login: @KesemSharabi
Microsoft Alias: kesharab

Thanks for your comment, @JPassenger . This issue has been assigned to the doc author for review.

Hi @JPassenger,
I'm sorry to hear that you had a bas experience when using the sample application.  The Embed Power BI content using a sample embed for your customers application tutorial, and the sample applications have recently been updated.
We've run several checks to verify that the samples work. I assume you followed the tutorial, is that correct? If so, can you please list the files you think are missing from the sample application and explain were you got stuck?
Thanks,
Kesem

Hi @KesemSharabi,
I was indeed following that tutorial which took me to the sample application.
I have been able to run the .NET Core App Owns Data version of the sample application without a problem, but I initially attempted to use the .NET Framework App Owns Data version and ran into numerous issues.
My initial problems I believe were local to me (missing references, etc.), but then I ran into several missing files. Unfortunately I did not keep a log of them all.
The first one I ran into was the powerbi.js file, which was referenced in one of the files (in /AppOwnsData/Scripts), but was not present in the solution. I checked this against the repository in case it was a download failure, or some other user error(!), but the file (and the folder in which it resided) was not present in the online repo either. I have a screenshot of the repository folder with no /scripts folder present:

I attempted to use an earlier commit, which does have the referenced file:

However, this had other issues and flagged different missing files.
Initially this meant that the sample application would load a local web page but then be unable to load the Power BI embedded report, then when I switched to the earlier commit it regressed to the point it would not build successfully.
I had not attempted to make any changes, except for the IDs as directed by the tutorial, so I'm confident it was not on my side.

Hi @JPassenger,
Thanks for the detailed info. I've asked our dev team to look into this and will get back to you shortly.
Kesem

Hi @JPassenger,
This seems to be a known issue. You need to reinstall the NuGet packages as suggested in the note at the bottom of the Step 8 - Embed your content (after step 9):

There's also a reference to this in the .NET Framework README file:

Hope this helps,
Kesem


formatting fig 3

svg now looks like this in chrome

unfortunately, the top graph isn't working in IE :-1:


Suppress Warning Messages during Flyway Migrate

Which version and edition of Flyway are you using?
5.1.4
If this is not the latest version, can you reproduce the issue with the latest one as well?
(Many bugs are fixed in newer releases and upgrading will often resolve the issue)
Haven't tried, but I'm confident it will reproduce
Which client are you using? (Command-line, Java API, Maven plugin, Gradle plugin)
Command-line
Which database are you using (type & version)?
MSSQL 2014
Which operating system are you using?
Linux
What did you do?
(Please include the content causing the issue, any relevant configuration settings, the SQL statement that failed (if relevant) and the command you ran.)

What did you expect to see?
When running flyway migrate we expected to see only that the versioned migration had executed in the output.
What did you see instead?
Instead, we see that it executed but also a WARNING for every call to sp_rename since it returns said WARNING.  This is causing developers to question if that is expected since it looks alarming.  I see in #843 that WARNINGs were shown intentionally, at least back 2014.  Can we suppress these?

Starting with 5.2, this is possible with errorOverrides. See https://flywaydb.org/documentation/erroroverrides
In your case you all you would need to add to your conf file is flyway.errorOverrides=S0001:15477:D and Flyway will automatically transform all these warnings into debug messages (only shown with -X)

@axelfontaine shoot... we're on community.  I'm curious how you determine which features are for community.


Specs probably too small

I have an old AMD X4 646 and 16GB. Running with CPU did not hog the CPU, so something went wrong.
My father has a new Windows 11 PC with 8GB. Running with CPU did not hog the CPU, so something went wrong.
Finally I decided to rent a Azure NC6_Promo with K80 cuda. That does the job after a reboot for installing the K80.

Even on that near empty K80 8GB is just too short

It's already running more than an hour on quadrupalizing a 300 dpi A4, so the 6 core K80 is no luxury.

After one and a half hour the memory footprint has more than doubled:

Next morning still a bit more memory... Glad I disabled Windows update...

Used memory still growing a bit:

Wow! Thank you for the comprehensive tests that you did!
I suppose that Pytorch-directml is not well optimized with CPU, in my tests i found that even when i set more cpus, it just use 1. The only thing i can say is that this library is still in alpha state, so maibe in future will be better optimized.
:D

The K80 contains a GPU, with CUDA codes sm_30, sm_35 and sm_37. It might be ignored by the used software.

Yes, sadly the library just ignore this GPU

How long do you estimate a 300 dpi A4 will take with only 6 cores?

Do you know an Azure VM which supports DirectML?

I estimate from 15 to 30 minutes

Sorry, i m not pratical with Azure stuff

DirectML should support Kepler according to the readme:
https://github.com/microsoft/DirectML

Yes, but i suppose maibe they refers to commercial GPUs like GTX

Just to be sure, can you try first a x0.5 upscale or x1 to check if everything works fine, this must be quick

Just broke off the long run and started x0.5

oook thanks, i was thinking did you installed nvidia drivers on the vm?

Should the tool nvidia-smi be on Windows? It can't find it.

There was a popup stating K80 driver installed.

I'm now installing the Tesla-driver from the Nvidia-site.

yes, maibe that will do the catch because when you screened the task manager i saw that there was no GPU panel. That usually happen when the driver is not installed

yes, maibe that will do the catch because when you screened the task manager i saw that there was no GPU panel. That usually happen when the driver is not installed

That feature only works with WDDM 2.0 I understand from this video.
https://www.youtube.com/watch?v=gOo73cyeMUU
The K80 has 1.3.

I've restarted the x1 upscale after a reboot. nvidia-smi responds.
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 473.47       Driver Version: 473.47       CUDA Version: 11.4     |
|-------------------------------+----------------------+----------------------+
| GPU  Name            TCC/WDDM | Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|                               |                      |               MIG M. |
|===============================+======================+======================|
|   0  Tesla K80           TCC  | 00000001:00:00.0 Off |                    0 |
| N/A   32C    P8    35W / 149W |      9MiB / 11448MiB |      0%      Default |
|                               |                      |                  N/A |
+-------------------------------+----------------------+----------------------+

+-----------------------------------------------------------------------------+
| Processes:                                                                  |
|  GPU   GI   CI        PID   Type   Process name                  GPU Memory |
|        ID   ID                                                   Usage      |
|=============================================================================|
|  No running processes found                                                 |
+-----------------------------------------------------------------------------+

CPU is high, nvidia-smi states "No running processes found"

Really strange, so if you upscale on gpu it does nothing?

Ah, also did you try install all Visual Studio runtimes?
https://www.techpowerup.com/download/visual-c-redistributable-runtime-package-all-in-one/

I'm downloading/uploading those other VC runtimes.
There might be some truth in this thread:
https://discuss.pytorch.org/t/ubuntu-what-version-of-cuda-pytorch-etc-can-run-on-a-nvidia-gtx-680-compute-capability-3-0/118469/4
The files mention 3.7, however there might be some issues with 3.7. The Tesla-driver I downloaded is supporting Cuda 11.4, so that might be introducing other issues.


AL-12-month-end-dates-reschedule-issue-fix

Description
Describe the changes made and why they were made. Ignore if these details are present on the associated Jira ticket
https://mifosforge.jira.com/browse/AL-12
Checklist
Please make sure these boxes are checked before submitting your pull request - thanks!

[x] Commit message starts with the issue number from https://issues.apache.org/jira/projects/FINERACT/. Ex: FINERACT-646 Pockets API.

[x] Coding conventions at https://cwiki.apache.org/confluence/display/FINERACT/Coding+Conventions have been followed.

[ ] API documentation at fineract-provider/src/main/resources/static/api-docs/apiLive.htm has been updated with details of any API changes.

[ ] Integration tests have been created/updated for verifying the changes made.

[x] All Integrations tests are passing with the new commits.

[x] Submission is not a "code dump".  (Large changes can be made "in repository" via a branch.  Ask on the list.)

Our guidelines for code reviews is at https://cwiki.apache.org/confluence/display/FINERACT/Code+Review+Guide

@fynmanoj would you be willing to create a JIRA issue on the ASF JIRA, instead of referencing an issue from an issue tracker that is now a downstream redistribution of Fineract?

@avikganguly01 knowing that @fynmanoj works with you, and assuming that you are still an active committer to this project (are you?), I was wondering if you would like to engage on code review feedback and possible evental merge of PRs such as this one? (I don't want to be a bottleneck on this project, and won't have the spare time to help review changes like this. If there are other active commiters such as @awasum @ptuomola @xurror or others reading this who want to engage on this PR, please don't let me hold you up / wait for me - I'll ignore this one, and try to help on others.)

@vorburger I opened up tickets on JIRA for these pull requests and referenced them in the title of the PR. I tagged @avikganguly01 as a reviewer and assume he can do the needful in reviewing and merging the PRs as we are going to start testing this development branch with these pull requests merged on the user's test server.

@vorburger I opened up tickets on JIRA for these pull requests and referenced them in the title of the PR. I tagged @avikganguly01 as a reviewer and assume he can do the needful in reviewing and merging the PRs as we are going to start testing this development branch with these pull requests merged on the user's test server.

@avikganguly01 did you have a chance to review this PR? Just want to make sure we have enough time before the release next week to test everything in the develop branch


Adding v3/apps/guid/droplets endpoint; Fixes #3552

Is there a related GitHub Issue?
Fixes #3552
What is this change about?
Adding /v3/apps/guid/droplets endpoint
Does this PR introduce a breaking change?

No, adds a new endpoint
Acceptance Steps

Tag your pair, your PM, and/or team

@danail-branekov thanks for detailed feedback, will have a look into it next week :)

@danail-branekov @georgethebeatle please review again


Enable secret output for rhoas generate-config

Description
Config generation should produce kuberentes secret. Secret should use env var type keys that will allow developers to mount secret as environment variables.

Open Question - Should we add the same for service account create command as well?

apiVersion: v1
kind: Secret
metadata:
  name: mysecret
type: Opaque
stringData:
  RHOAS_SERVICE_ACCOUNT_CLIENT_ID: YWRtaW4=
  RHOAS_SERVICE_ACCOUNT_SECRET: MWYyZDFlMmU2N2Rm

Closed by #1539


"Fatal Error" while using start_replaying.py

So i followed the format to play the .rec file, but it seems to crash. Here's the pic

Hi! It is hard to determine the cause of the issue without any additional information. Could you please send the recording file so we can learn more? Meanwhile, try running 'make check' from your DReyeVR directory to ensure it is installed correctly.

Hi! Herein i have attached the .rec file in zip format. Lemme know if there's any issues.
exp_a1_test_06_09_2023_12_39_33.zip
For sure, I shall run make check and update you asap.

Update: make check was successful. No issues.

Any update?

After getting the fatal error, could you upload the file $CARLA_ROOT$/Unreal/CarlaUE4/Saved/Logs/CarlaUE4.log here?

CarlaUE4.log
Hey, thanks for your response! Here's the file.

Removed and installed again, and this time I made sure to run script using x64 Native Tools CMD prompt. Worked.


Update various NuGet dependencies

Motivation
Security vulnerabilities in transitive dependencies and general modernization.
Modifications

Update NuGet.Commands due to transitive security vulnerabilities
Resolve obsoletion of RestoreCommandProvider.Create
Update unit test dependencies
Update System.Threading.Tasks.Extensions to align SourceLink with the new repository (supposedly has no code changes)

/merge


[BUG] TypeScript support not working

Describe the bug
Since the files are written with ES6 syntax and JSDOC instead of actual typescript, Babel is prefixing variables with an underscore making the JSDOC invalid since the "correct" variable name had an underscore.
Since this was originally meant to be for JS only, TypeScript support would likely require a near full rewrite in TS. This will stay updated until the TypeScript version is done, which I will have as a separate npm package.
To Reproduce
Steps to reproduce the behavior:

Create a typescript project and import the client
Construct Client
Compile code
See errors

Expected behavior
Should compile fine using the d.ts files, but still read JSDOC comments.
Screenshots
If applicable, add screenshots to help explain your problem.
Desktop (please complete the following information):

OS: Windows
Node Version: 17.2
Version: 3.0.10

Additional context
Intellisense seems to work fine.

I'm currently working on a TypeScript rewrite. The rewrite is ~80% complete and has loads more type annotations as well as Event Listener type annotations using tiny-typed-emitter. I'll push as a v4 once it's finished

The rewrite has turned into a complete refactor from the ground up. This library is fairly buggy with errors I could've caught in TypeScript, doesn't have probably TypeScript support, compiles incorrectly, and is overall clunky to use. the new wrapper will be posted under ifunny-co/iFunny.ts once the beta version is ready.


Lock user account after 10 failed login attempts

Code looks good but my concern is that we are locking users out for an hour without telling them anything other than that their account is locked.
We need something that tells them that they are locked out for an hour.
This actually makes me think that unlocking the account via email is better as it means they won't contact us to fast forward the one hour lockout.
We should also be reminding them that they can reset their password when they are getting close to getting locked out.


[Technology Exploration] use libmpv (https://mpv.io/) instead of ffmpeg shared libraries for video/image previews

refs https://mpv.io/manual/stable/#options-hwdec

google angle (chromium builtin) can be supported in a simple way via --gpu-context=angle

Closing as not enough context provided


Github Actions: change reviewers to be comma separated

For some reason this doesn't change (not sure if the reason was new line separation - docs mentions it should work)

Maybe let's switch to team-reviewers and use the newly created https://github.com/orgs/SumoLogic/teams/opensource-collection-team ?

Please squash commits


Recent metric data not displayed until flushed to disk

I wasn't sure if I should file this against graphite-web or carbon, so apologies if I've chosen poorly.
We have a carbon-relay instance fronting 4 x carbon-cache instances, no aggregation in the stack, but when building graphs or fetching data via the api the most recent metric values are not immediately available. If we wait long enough they do appear (typically 5-30 minutes, we're always starved for IOPS), so I thought the query cache lookups from graphite-web were failing, but I see successful cache lookups logged in the cache instances:
29/01/2016 11:28:48 :: [query] [<IP_ADDRESS>:37758] cache query bulk for "32" metrics returned 2025 values

A bit of debug logging and tcpdump'ing shows the metric updates coming into the relay and passing straight through to the cache instances, so there's no delay getting the data into the cache processes - we just cant seem to get the data out until (I assume) they're flushed to disk. These are not new metrics, the whisper files were created long ago.
You can find config files and log snippets in this gist, if anyone can see if we're missing something that would be very much appreciated. Or if I'm totally wrong about how this is supposed to work and we just need more IOPS you can tell me that too :)

Hi I'm experiencing the same behavior, while carbon cache instances are queuing data graphite doesn't return recent metrics , we have 6x carbon-cache instances (200k metrics/minute aprox)
As you can see in this queue graph , we have this error frequently.

the problem persists until data queues disappear, usually 10/15 minutes  ( sometimes 20/30 minutes)

Should also say the carbon and graphite-web version is 0.9.15 on python 2.7.3 on Ubuntu 12.04

@DazWorrall - something is definitely wrong with your cache, but config looks perfectly fine. Try to disable CARBONLINK_QUERY_BULK  - but I'm just 'shooting in the dark'.

Thanks for the suggestion @deniszh but no joy I'm afraid - I can see the queries come in for individual metrics so the change took affect but we're still seeing gaps :(

@DazWorrall @deniszh , we have noticed exactly the same behavior but in our case we are working with git master versions

graphite-web:   ( commit 8710ff76f0b4571481d295d997a83e4c895dd092) from june 2015.  Which has not implemented CARBONLINK_QUERY_BULK option yet.

carbon: ( commit https://github.com/graphite-project/carbon/commit/b80ce915a5e420b46e6972512801491e536db1b6 ) from April 2015.

We have only last values when carbon instances can flush all data to disk.

Nah, CARBONLINK_QUERY_BULK was just a guess. In both cases the reason is the same - cache is not working and graphite reads data from disk, and that's slow. But what's an issue - hard to say. :(

@toni-moreno: You can try to set DIVERSE_REPLICAS=False for your carbon (if your version has DIVERSE_REPLICAS implemented) - if you have more than one host and REPLICATION_FACTOR >1

sorry @deniszh I have not implemented DIVERSE_REPLICAS option. :(
If there is any way to "force"/"simulate"  data queue growing  , we could update to the last master version in a testing box and debug anything you need to fix this error.
How can simulate it?

@toni-moreno: That's fine - DIVERSE_REPLICAS  can interfere with cache behaviour, but if you don't have it - then you have nothing to worry about.
And if your problem is not persistent and happening only when queue grows  - then, I'm afraid, your installation just can't keep up with load.

@deniszh . I'm not sure about that.
I Think there is some error when queue grows , as a example we have already opened an issue (https://github.com/graphite-project/graphite-web/issues/1399) ( carbon  metrics query crashes), this happens only when queue grows and only with carbon metrics, all other metrics queries are working but only until last flush to disk.

Hi @deniszh , @DazWorrall we have increased in 6Gb RAM and 2 cpu's our resources in a graphite node ( a VMware VM), and restarted the machine after that at 6:00 ( aprox).
NOTE: This machine has 210K metrics /minute.

As you can see in our queue graph all all cache instances wr07x have been caching for 3 hours , while this happens  graphite-web query's response contains only data until 6:00 am.graphite-web response time is really good here.
Once all data is cached on memory  ( at 9:30 aprox) it seems like carbon-caches begin to flush all data to disk.. cpu wait time disappears and graphite-web query's responses contains all previous data. ( no data lost seems to happen).
In all this process the only problem is he have been working 3 hours without recent data. If graphite-web is running ok, it have enough cpu why carbon-cache are not sending queued data? and only  disk data?

I noticed if there is huge in-memory cache and the physical file is not update often (let's say modify time of wsp is more than 2 hours ago) such file is not taken into account when returning data. It is probably configurable by some option.
Could it be this case?

@FractalizeR : That's a slightly different issue - metric will not be visible until whisper file will be created on disk. That's also known, but unfortunately quite hard to fix in the current codebase.

@deniszh I see, thanks!


90 days pipeline information

Hi,
We don't find any good detailed documents for Product Dashboard 90 days Health trend. Please post here if there is any.
Thanks,
Booma Baskaran.

From #1024:

In 90 days pipeline health trend, code coverage tab (2nd tab)says its code coverage but the label in the vertical line shows its the # of code issues per day. What does it mean?

@mrpudn - Any update on this.

I think I'll defer to @tabladrum on this one :)

Ah.... good catch - haven't noticed it. Should be "code coverage" on the Y axis. Is a quick fix on this line:
https://github.com/capitalone/Hygieia/blob/master/UI/src/components/widgets/product/quality-details/qualityDetails.js
ctrl.codeCoverageChartOptions = getDefaultChartOptions('# of code issues per day');

@tabladrum.. Any detailed documents are there for product dashboard especially for 90 days pipeline chart?

@BoomaBaskaran refer https://github.com/capitalone/Hygieia/issues/1512 . Reopen if you need more information


Outgoing Post Request Not getting cancelled

I am posting data to my server which is in json format.
public static void post(String url, RequestParams params, AsyncHttpResponseHandler responseHandler,Context context) {        client.post(context,url,params,responseHandler).setTag(CURRENT_REQUEST_TAG);     }
And cancelling a request:
`public static void cancelAllRequests(Context context) {
    try {
        client.cancelRequestsByTAG(CURRENT_REQUEST_TAG,true);
        client.cancelRequests(context, true);
        client.cancelAllRequests(true);
    }
    catch (Exception e) {}`

My request gets cancelled and I don't receive any success/failure in my response handler but my data is posted to server. I have checked the context and its not null.
I am using version 1.4.8
Thanks,

I have tried with the latest version 1.4.9 but still request is not getting cancelled and data is successfully posted to server. I think library is not closing the TCP connection with server.


Store rest API gives wrong total API count for pagination

Description:
Store rest API gives wrong total API count for pagination subsequent to creating and deleting few apis
Affected Product Version: APIM 1.10.0
Steps to reproduce:

Create 5 APIs.
Delete 2 of the created APIs.
Get the list of apis via the store rest api.
Then a response similar to the following will be returned

{
 "list": [
 {
 "name": "test1",
 "context": "/t1/1",
 "id": "f69b7fef-36ea-4108-8f63-f4bfa7925aa1",
 "scopes": [],
 "version": "1",
 "description": null,
 "provider": "admin",
 "status": "PUBLISHED"
 },
 {
 "name": "test3",
 "context": "/t3/1",
 "id": "fa8f8034-8408-44b6-aaf4-20e7a4ec617a",
 "scopes": [],
 "version": "1",
 "description": null,
 "provider": "admin",
 "status": "PUBLISHED"
 },
 {
 "name": "test5",
 "context": "/t5/1",
 "id": "85540ce9-f2c2-4011-acda-f2d37be32984",
 "scopes": [],
 "version": "1",
 "description": null,
 "provider": "admin",
 "status": "PUBLISHED"
 }
 ],
 "count": 3,
 "next": "",
 "previous": "",
 "pagination": {
 "offset": 0,
 "total": 5,
 "limit": 25
 }
}

Note that the count is given as 3 and the pagination total is given as 5 which is the count prior to deleting the apis.

This issue is fixed


Phi3 support compresskv

Description
Phi3 support compresskv.

[x] Test on arc
[x] Test on MTL

1. Why the change?

2. User API changes

3. Summary of the change

4. How to test?

[ ] N/A
[ ] Unit test: Please manually trigger the PR Validation here by inputting the PR number (e.g., 1234). And paste your action link here once it has been successfully finished.
[ ] Application test
[ ] Document test
[ ] ...

5. New dependencies

[ ] New Python dependencies
- Dependency1
- Dependency2
- ...
[ ] New Java/Scala dependencies and their license
- Dependency1 and license1
- Dependency2 and license2
- ...

See comments above; otherwise LGTM

PR validation https://github.com/intel-analytics/ipex-llm-workflow/actions/runs/10314792036


add beartype

Add beartype https://github.com/beartype/beartype for runtime type checking.

gradually adding beartype support


Data race in middleware/closenotify

Using the close notify middleware is giving me data races. I'm hitting ctrl+r like crazy in the browser.
This is the only part of the handler that writes in http.ResponseWriter, in case of context done, the program don't do anything.
select {
case <-r.Context().Done():
  fmt.Println("end of request")
case err := <-chanErr:
  c.sendInvalidRequest(w, err)
case resp := <-chanResp:
  c.sendResponse(r, w, resp)
}

return

But the last request get processed because the browser tab is open, then the headers are writted and this error popup on console:
2017/01/21 10:18:32 http: multiple response.WriteHeader calls
Am i doing anything wrong?
System details
go version go1.8rc2 linux/amd64
GOARCH="amd64"
GOBIN=""
GOEXE=""
GOHOSTARCH="amd64"
GOHOSTOS="linux"
GOOS="linux"
GOPATH="/home/diego/projects/go/1.8rc2"
GORACE=""
GOROOT="/home/diego/programs/go/1.8rc2"
GOTOOLDIR="/home/diego/programs/go/1.8rc2/pkg/tool/linux_amd64"
GCCGO="gccgo"
CC="gcc"
GOGCCFLAGS="-fPIC -m64 -pthread -fmessage-length=0 -fdebug-prefix-map=/tmp/go-build796800410=/tmp/go-build -gno-record-gcc-switches"
CXX="g++"
CGO_ENABLED="1"
PKG_CONFIG="pkg-config"
CGO_CFLAGS="-g -O2"
CGO_CPPFLAGS=""
CGO_CXXFLAGS="-g -O2"
CGO_FFLAGS="-g -O2"
CGO_LDFLAGS="-g -O2"
GOROOT/bin/go version: go version go1.8rc2 linux/amd64
GOROOT/bin/go tool compile -V: compile version go1.8rc2 X:framepointer
uname -sr: Linux 4.8.13-1-ARCH
/usr/lib/libc.so.6: GNU C Library (GNU libc) stable release version 2.24, by Roland McGrath et al.

Forgot the data race message:
==================
WARNING: DATA RACE
Read at 0x00c4201a01e8 by goroutine 25:
  net/http.(*response).finishRequest()
      /home/diego/programs/go/1.8rc2/src/net/http/server.go:1534 +0x57
  net/http.(*conn).serve()
      /home/diego/programs/go/1.8rc2/src/net/http/server.go:1830 +0x76b

Previous write at 0x00c4201a01e8 by goroutine 32:
  net/http.(*response).WriteHeader()
      /home/diego/programs/go/1.8rc2/src/net/http/server.go:1056 +0xb9
  stash.b2w/alpha/omega/vendor/github.com/pressly/chi/middleware.CloseNotify.func1.1()
      /home/diego/projects/go/1.8rc2/src/stash.b2w/alpha/omega/vendor/github.com/pressly/chi/middleware/closenotify.go:25 +0x6f

Goroutine 25 (running) created at:
  net/http.(*Server).Serve()
      /home/diego/programs/go/1.8rc2/src/net/http/server.go:2668 +0x35f
  net/http.(*Server).ListenAndServe()
      /home/diego/programs/go/1.8rc2/src/net/http/server.go:2585 +0xe0
  net/http.ListenAndServe()
      /home/diego/programs/go/1.8rc2/src/net/http/server.go:2787 +0xee
  stash.b2w/alpha/omega.server()
      /home/diego/projects/go/1.8rc2/src/stash.b2w/alpha/omega/server.go:96 +0x4bb
  stash.b2w/alpha/omega.Server()
      /home/diego/projects/go/1.8rc2/src/stash.b2w/alpha/omega/omega.go:11 +0xca
  main.main.func1()
      /home/diego/projects/go/1.8rc2/src/stash.b2w/alpha/omega/cli/omega.go:27 +0xc9
  stash.b2w/alpha/omega/vendor/github.com/spf13/cobra.(*Command).execute()
      /home/diego/projects/go/1.8rc2/src/stash.b2w/alpha/omega/vendor/github.com/spf13/cobra/command.go:636 +0x85d
  stash.b2w/alpha/omega/vendor/github.com/spf13/cobra.(*Command).ExecuteC()
      /home/diego/projects/go/1.8rc2/src/stash.b2w/alpha/omega/vendor/github.com/spf13/cobra/command.go:722 +0x46b
  stash.b2w/alpha/omega/vendor/github.com/spf13/cobra.(*Command).Execute()
      /home/diego/projects/go/1.8rc2/src/stash.b2w/alpha/omega/vendor/github.com/spf13/cobra/command.go:681 +0x38
  main.main()
      /home/diego/projects/go/1.8rc2/src/stash.b2w/alpha/omega/cli/omega.go:44 +0x794

Goroutine 32 (finished) created at:
  stash.b2w/alpha/omega/vendor/github.com/pressly/chi/middleware.CloseNotify.func1()
      /home/diego/projects/go/1.8rc2/src/stash.b2w/alpha/omega/vendor/github.com/pressly/chi/middleware/closenotify.go:28 +0xc5
  net/http.HandlerFunc.ServeHTTP()
      /home/diego/programs/go/1.8rc2/src/net/http/server.go:1942 +0x51
  stash.b2w/alpha/omega/vendor/github.com/pressly/chi.(*Mux).ServeHTTP()
      /home/diego/projects/go/1.8rc2/src/stash.b2w/alpha/omega/vendor/github.com/pressly/chi/mux.go:79 +0x37f
  net/http.serverHandler.ServeHTTP()
      /home/diego/programs/go/1.8rc2/src/net/http/server.go:2568 +0xbc
  net/http.(*conn).serve()
      /home/diego/programs/go/1.8rc2/src/net/http/server.go:1825 +0x716
==================
==================
WARNING: DATA RACE
Read at 0x00c4201a0230 by goroutine 25:
  net/http.(*chunkWriter).writeHeader()
      /home/diego/programs/go/1.8rc2/src/net/http/server.go:1200 +0x21c7
  net/http.(*chunkWriter).close()
      /home/diego/programs/go/1.8rc2/src/net/http/server.go:379 +0x17a
  net/http.(*response).finishRequest()
      /home/diego/programs/go/1.8rc2/src/net/http/server.go:1540 +0xc1
  net/http.(*conn).serve()
      /home/diego/programs/go/1.8rc2/src/net/http/server.go:1830 +0x76b

Previous write at 0x00c4201a0230 by goroutine 32:
  net/http.(*response).WriteHeader()
      /home/diego/programs/go/1.8rc2/src/net/http/server.go:1057 +0xd2
  stash.b2w/alpha/omega/vendor/github.com/pressly/chi/middleware.CloseNotify.func1.1()
      /home/diego/projects/go/1.8rc2/src/stash.b2w/alpha/omega/vendor/github.com/pressly/chi/middleware/closenotify.go:25 +0x6f

Goroutine 25 (running) created at:
  net/http.(*Server).Serve()
      /home/diego/programs/go/1.8rc2/src/net/http/server.go:2668 +0x35f
  net/http.(*Server).ListenAndServe()
      /home/diego/programs/go/1.8rc2/src/net/http/server.go:2585 +0xe0
  net/http.ListenAndServe()
      /home/diego/programs/go/1.8rc2/src/net/http/server.go:2787 +0xee
  stash.b2w/alpha/omega.server()
      /home/diego/projects/go/1.8rc2/src/stash.b2w/alpha/omega/server.go:96 +0x4bb
  stash.b2w/alpha/omega.Server()
      /home/diego/projects/go/1.8rc2/src/stash.b2w/alpha/omega/omega.go:11 +0xca
  main.main.func1()
      /home/diego/projects/go/1.8rc2/src/stash.b2w/alpha/omega/cli/omega.go:27 +0xc9
  stash.b2w/alpha/omega/vendor/github.com/spf13/cobra.(*Command).execute()
      /home/diego/projects/go/1.8rc2/src/stash.b2w/alpha/omega/vendor/github.com/spf13/cobra/command.go:636 +0x85d
  stash.b2w/alpha/omega/vendor/github.com/spf13/cobra.(*Command).ExecuteC()
      /home/diego/projects/go/1.8rc2/src/stash.b2w/alpha/omega/vendor/github.com/spf13/cobra/command.go:722 +0x46b
  stash.b2w/alpha/omega/vendor/github.com/spf13/cobra.(*Command).Execute()
      /home/diego/projects/go/1.8rc2/src/stash.b2w/alpha/omega/vendor/github.com/spf13/cobra/command.go:681 +0x38
  main.main()
      /home/diego/projects/go/1.8rc2/src/stash.b2w/alpha/omega/cli/omega.go:44 +0x794

Goroutine 32 (finished) created at:
  stash.b2w/alpha/omega/vendor/github.com/pressly/chi/middleware.CloseNotify.func1()
      /home/diego/projects/go/1.8rc2/src/stash.b2w/alpha/omega/vendor/github.com/pressly/chi/middleware/closenotify.go:28 +0xc5
  net/http.HandlerFunc.ServeHTTP()
      /home/diego/programs/go/1.8rc2/src/net/http/server.go:1942 +0x51
  stash.b2w/alpha/omega/vendor/github.com/pressly/chi.(*Mux).ServeHTTP()
      /home/diego/projects/go/1.8rc2/src/stash.b2w/alpha/omega/vendor/github.com/pressly/chi/mux.go:79 +0x37f
  net/http.serverHandler.ServeHTTP()
      /home/diego/programs/go/1.8rc2/src/net/http/server.go:2568 +0xbc
  net/http.(*conn).serve()
      /home/diego/programs/go/1.8rc2/src/net/http/server.go:1825 +0x716
==================

@diegobernardes hey there - can you provide a small gist example that shows the problem? Im not sure what chanErr and chanResp are in the first example.
Maybe was the middlewares or the order of then that caused that error.

Thanks @diegobernardes I'll fix it soon

I believe the fix is very easy, which is to just comment out https://github.com/pressly/chi/blob/master/middleware/closenotify.go#L25 because its really just for internal communication to the logger to print disconnected, its not that useful. I will update the behaviour. From that point, I do believe middleware.CloseNotify() will effectively be a no-op in go 1.8, perhaps panic that it should be be used 1.8+ because the default behaviour is to cancel a context when a client disconnects.

Didn't know that in 1.8 the CloseNotify cancel the context, good to know.
Thanks!

Resolved by 7765b0916fdc6791938554e9d53d39cae059ac8c


Banned 6/16/2020

Did anyone else get banned 4 hours after using the new OverWolf verson of Poe-Overlay?
   But causes bans? RIP
Was on for like 6 hours yesterday, didn't really use poe-overlay much.
but was on for like 3-4 hours today, and started messing with the new trade buttons
then got banned. so beware the new poe trade features? idk

Did you recive an email from GGG about the ban reason?


Pipenv misbehaves when installing local packages from Pipfile when .egg directories aren't present

Unable to correct install packages that are defined locally.
Using pipenv 11.8.3 to target Heroku, so upgrading is hard.
 I'm doing this in editable mode, so I can do development work.
The initial pipenv install -e ./some-local-package works fine, but inserts a .egg directory, which is ignore by git when committing. If another developer tries to check this code out, without the egg and just runs pipenv install or pipenv lock pipenv crashes, especially if the lock file (which changes a lot in dev) isn't present.
So if the .egg directories are removed (which aren't in source control), pipenv locks fail with an intuitive message.
So what am I doing wrong?
$ python -m pipenv.help output
Pipenv version: '11.8.3'
Pipenv location: '/usr/local/lib/python2.7/site-packages/pipenv'
Python location: '/usr/bin/python27'
Other Python installations in PATH:

2.7: /usr/bin/python2.7

2.7: /usr/bin/python2.7

3.6: /usr/bin/python3.6m

3.6: /usr/bin/python3.6

2.7.12: /usr/bin/python

2.7.12: /usr/bin/python2

3.6.2: /usr/bin/python3

PEP 508 Information:
{'implementation_name': 'cpython',
 'implementation_version': '0',
 'os_name': 'posix',
 'platform_machine': 'x86_64',
 'platform_python_implementation': 'CPython',
 'platform_release': '4.9.70-25.242.amzn1.x86_64',
 'platform_system': 'Linux',
 'platform_version': '#1 SMP Wed Jan 3 05:36:22 UTC 2018',
 'python_full_version': '2.7.12',
 'python_version': '2.7',
 'sys_platform': 'linux2'}

System environment variables:

PROMPT_COMMAND
rvm_version
NVM_CD_FLAGS
C9_HOSTNAME
AWS_PATH
rvm_path
PYTHONDONTWRITEBYTECODE
LESSOPEN
RUBY_VERSION
SSH_CLIENT
CVS_RSH
LOGNAME
USER
NVM_DIR
HOME
PATH
PYTHONUNBUFFERED
NODE_PATH
PORT
SSH_CONNECTION
LANG
GEM_PATH
TERM
SHELL
TMUX_PANE
EC2_AMITOOL_HOME
LESS_TERMCAP_me
LESS_TERMCAP_md
LESS_TERMCAP_mb
HISTSIZE
NVM_BIN
NVM_PATH
EDITOR
MANPATH
IP
HGUSER
AWS_ELB_HOME
JAVA_HOME
EC2_HOME
HISTFILESIZE
rvm_bin_path
LESS_TERMCAP_se
rvm_prefix
C9_PROJECT
C9_USER
IRBRC
TMUX
_system_type
MY_RUBY_HOME
AWS_AUTO_SCALING_HOME
_system_name
PIP_PYTHON_PATH
_
C9_PID
LESS_TERMCAP_ue
_system_arch
NVM_IOJS_ORG_MIRROR
AWS_CLOUDWATCH_HOME
OLDPWD
HOSTNAME
GEM_HOME
HISTCONTROL
SHLVL
PWD
LESS_TERMCAP_us
ISOUTPUTPANE
_system_version
MAIL
LS_COLORS
C9_PORT
PYTHON_INSTALL_LAYOUT
NVM_NODEJS_ORG_MIRROR

Pipenv–specific environment variables:
Debug–specific environment variables:

PATH: /home/ec2-user/.nvm/versions/node/v6.12.3/bin:/usr/local/rvm/gems/ruby-2.4.1/bin:/usr/local/rvm/gems/ruby-2.4.1@global/bin:/usr/local/rvm/rubies/ruby-2.4.1/bin:/usr/local/bin:/bin:/usr/bin:/home/ec2-user/.local/bin:/home/ec2-user/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/aws/bin:/home/ec2-user/.local/bin:/home/ec2-user/bin:/home/ec2-user/.local/bin:/home/ec2-user/bin:/opt/aws/bin:/usr/local/rvm/bin:/home/ec2-user/.local/bin:/home/ec2-user/bin:/home/ec2-user/.local/bin:/home/ec2-user/bin
SHELL: /bin/bash
EDITOR: ``
LANG: en_US.UTF-8
PWD: /home/ec2-user/environment/git/aristotle-cloud/dev

Contents of Pipfile ('/home/ec2-user/environment/git/aristotle-cloud/dev/Pipfile'):
[[source]]
url = "https://pypi.python.org/simple"
verify_ssl = true
name = "pypi"

[dev-packages]

[packages]
aristotle-metadata-registry = {editable = true, path = "../../aristotle-metadata-registry/python/aristotle-metadata-registry/"}

[requires]
python_version = "3.6"

Expected result
A lock file is generated
Actual result
Creating a virtualenv for this project…
Using /usr/local/bin/python3.6m (3.6.4) to create virtualenv…
Running virtualenv with interpreter /usr/local/bin/python3.6m
Using base prefix '/usr/local'
New python executable in /root/.local/share/virtualenvs/dev-mLGR0Vyd/bin/python3.6m
Also creating executable in /root/.local/share/virtualenvs/dev-mLGR0Vyd/bin/python
Installing setuptools, pip, wheel...done.

Virtualenv location: /root/.local/share/virtualenvs/dev-mLGR0Vyd
Locking [dev-packages] dependencies…
Using pip: -i https://pypi.python.org/simple

                          ROUND 1
Current constraints:

Finding the best candidates:

Finding secondary dependencies:
------------------------------------------------------------
Result of round 1: stable, done

Locking [packages] dependencies…
Using pip: -i https://pypi.python.org/simple

                          ROUND 1
Current constraints:
  file:///usr/src/app/aristotle-metadata-registry/python/aristotle-metadata-registry

Finding the best candidates:
  found candidate -e file:///usr/src/app/aristotle-metadata-registry/python/aristotle-metadata-registry (constraint was <any>)

Finding secondary dependencies:

Traceback (most recent call last):
  File "/usr/local/lib/python3.6/site-packages/pipenv/resolver.py", line 82, in <module>
    main()
  File "/usr/local/lib/python3.6/site-packages/pipenv/resolver.py", line 71, in main
    clear=do_clear,
  File "/usr/local/lib/python3.6/site-packages/pipenv/resolver.py", line 63, in resolve
    verbose=verbose,
  File "/usr/local/lib/python3.6/site-packages/pipenv/utils.py", line 425, in resolve_deps
    pre,
  File "/usr/local/lib/python3.6/site-packages/pipenv/utils.py", line 336, in actually_resolve_reps
    resolved_tree.update(resolver.resolve(max_rounds=PIPENV_MAX_ROUNDS))
  File "/usr/local/lib/python3.6/site-packages/pipenv/patched/piptools/resolver.py", line 102, in resolve
    has_changed, best_matches = self._resolve_one_round()
  File "/usr/local/lib/python3.6/site-packages/pipenv/patched/piptools/resolver.py", line 200, in _resolve_one_round
    for dep in self._iter_dependencies(best_match):
  File "/usr/local/lib/python3.6/site-packages/pipenv/patched/piptools/resolver.py", line 275, in _iter_dependencies
    for dependency in self.repository.get_dependencies(ireq):
  File "/usr/local/lib/python3.6/site-packages/pipenv/patched/piptools/repositories/pypi.py", line 174, in get_dependencies
    legacy_results = self.get_legacy_dependencies(ireq)
  File "/usr/local/lib/python3.6/site-packages/pipenv/patched/piptools/repositories/pypi.py", line 193, in get_legacy_dependencies
    dist = ireq.get_dist()
  File "/usr/local/lib/python3.6/site-packages/pipenv/vendor/pip9/req/req_install.py", line 1069, in get_dist
    egg_info = self.egg_info_path('').rstrip('/')
  File "/usr/local/lib/python3.6/site-packages/pipenv/vendor/pip9/req/req_install.py", line 515, in egg_info_path
    'No files/directories in %s (from %s)' % (base, filename)
pip9.exceptions.InstallationError: No files/directories in /usr/src/app/aristotle-metadata-registry/python/aristotle-metadata-registry (from )

Steps to replicate
mkdir tmp && cd tmp
git clone https://github.com/aristotle-mdr/aristotle-metadata-registry
pipenv install -e ./aristotle-metadata-registry/python/aristotle-metadata-registry
rm ./aristotle-metadata-registry/python/aristotle-metadata-registry/aristotle_metadata_registry.egg-info -rf
rm Pipfile.lock
pipenv --rm && pipenv install
ls ./aristotle-metadata-registry/python/aristotle-metadata-registry/

This happens when pipenv tries locking the dependencies. I never caught this because Pipfile.lock is usually in version control.

pipenv install would work, however. Whatever install does specially to an editable package, lock should probably do it as well.

This is fixed in master I believe ? Can someone check?

@uranusjr because resolver needs egg info and install creates that. However bare lock will fail, on master.

Yes pipenv install works with master branch

pipenv install from a pipfile using an egg directory was fixed in #1812 and #1815. As far as if you are starting from no environment with a copy of a lockfile, I’m not really sure of the use case for running pipenv lock without installing first. Thanks for the report, closing for now!

Thanks for the response!
I'll see if I can submit a PR for Heroku to upgrade too.

@LegoStormtroopr haven't cut a release yet -- just got testing infrastructure working

I just want to jump back to @techalchemy 's question:

I’m not really sure of the use case for running pipenv lock without installing first

The reason I see this happening is that often I'll create my own pipenv files or edit them after they've been created - which given that they are text files, I'm guessing is ok. So
If you don't have a lock file, doing a pipenv install with just a Pipfile will force it to try and lock it, and when nothing has been previously installed, it fails.

@LegoStormtroopr having had an opportunity to mull this over I’m much more certain about this now anyway. It seems valid to me, we could hide the internals if necessary


Difference between IDA_up and DLA_up

The paper mentions DLA, IDA and HDA.
But how are DLAUp and IDAUp in your code different? Can you provide some reference please?
Thanks.

DLA consists of groups of HDA. It is mainly used for classification tasks. IDA is used for upsampling DLA to get high-resolution output, so it is called IDAUp in the code. DLAUp is the final structure after putting DLA and IDAUp together.


thread 'main' panicked at ...kani-verifier-0.54.0/src/lib.rs:156:38: No exit code?

I'm not able to provide an example here, but a proof is causing Kani version 0.54 to panic with the message above and references the following line:
https://github.com/model-checking/kani/blob/e6f8a62d689d0b0ebcbabe3661be6273c5ab9be8/src/lib.rs#L156
There were no issues w/ version 0.53 or prior.

Hi @weaversa , is there any information about your invocation that you can provide that could help us reproduce this crash?
Some details that would be useful are

The command that you invoked that caused the crash.
The OS that you are running the command on
Did verification fail or succeed before this crash?
Did you go through the setup process by running cargo-kani setup for example.

Thank you @jaisnan --

cargo kani
Ubuntu 22.04
I see that Kani is checking harness ... then Compiling ... and then thread 'main' panicked...
Kani is installed in the container via RUN curl https://sh.rustup.rs -sSf | bash -s -- -y \
  && cargo install --locked kani-verifier \
  && cargo kani setup

I am using Kani in a CI job and many theorems are checked just fine. One in particular is now failing with version 0.54.0 with the panic message above.

Would it be possible to share a synthetic example that might have caused the crash?

I'm sorry that I don't have such an example.

Hi @weaversa, sorry for the late reply. May I ask you to run kani with RUST_BACKTRACE and send us information about the stack trace you are getting (if any). Thanks!