NBD - Notebook Benchmark Directory

hummm, there is only one team though...or did some others pop up?

the hard part is getting this link to everyone and letting them know this is the place to be for testing....

 

What's the point of the teams? Group people by site?

No comment on the other two.

 

Okey, how about you put this code on a CVS server and then we can develop it in a collaborative way. This way everybody may come with a contribution to the system and it will be kept up to date more easily in the future.

Of course there should be a small team that would approve any improvement/patch proposal based on a set of developing rules, including the current maintainer BIGX333, much like Linus Torvald does with the Linux kernel.

I think that the database should include at least the fields that are covered in the benchmark at
http://www.notebookforums.com/laptop-benchmarks.html,
of course avoiding copyright infringements, and adding several fields for:
- sorting order
- member account
- benchmark date
- system signature
- laptop manufacturer
- laptop brand/barebone
- cpu manufacturer: Intel, AMD, etc
- cpu class: dual core, core 2 duo, core 2 quad, nehalem
- cpu physical cores (number)
- cpu logical cores (number)
- cpu filter: Q9100, Q9660, etc
- cpu speed (to differentiate between stock and overclock)
- gpu manufacturer: ATI, Nvidia, Intel
- gpu type: 8800M GTX, etc
- gpu custom: stock or overclock
- gpu cores/shaders (number)
- gpu speed: core, memory, shader
- gpu drivers + link to download
- gpu bus width
- MXM form factor
- gpu multi (number)
- gpu setup: Single, SLI, XF, Hybrid
- LCD form factor
- LCD manufacturer
- LCD native resolution
- Architecture: Intel x64, Intel x86, etc
- Operating System Name: Windows 7, Vista, XP, etc
- Operating System Type: 32-bit, 64-bit
- monitor resolution:
- system tweaks: on/off
- benchmark type: Vantage, Windows Experience Index, Crysis, COD4, etc
- Api: DirectX 9, DirectX 10, etc.
- benchmark tweaks: on/off
- standard benchmark resolution (1024x768, 1280x1024, 1680x1050,
1920x1200)
- custom benchmark resolution: Horizontal and Vertical
- quality settings: low, medium, high, very high
- performance options: anti-aliasing (on/off), scaling (monitor/card manufacturer), vsync, etc.
- benchmark result/value: Total: P9762 (Vantage), GPU Score, CPU score, SM 2.0, SM 3.0, etc
- benchmark images link: link to a forum thread where the snapshot is uploaded, link to Vantage/ORB score, etc.

Maybe the list of fields should be present in the first page, so that everybody may have an opinion or suggestion.

 

I think those are too many fields, some info is useful as a reference, but I don't feel people is going to make searches for number of GPU shaders and so. Keep it simple and put a link to the specs of the manufacturer.

 

Agreed. Most people wont care what MXM form factor the GPU is for example. I understand why you'd want as much data as possible, but then you have the potential issue where people only fill in a small percentage of the fields, then to anybody using the tool, it looks unfinished and people may begin to lose faith in the tool.

Trying to find the right balance is difficult, but when in doubt, I always say you should keep it simple.

 

Some of the fields would be just filled in by default, because knowing the laptop type you will know for example a lot of the hardware details.
But if you want to put it into perspective, in a few years it may be useful information, at least from a historical point of view

 

Nice idea, but especially considering how much some notebooks can be customised, it wouldn't work like that without having software read specs from the notebook.

 

A lot of that info can be provided by a GPU-Z and CPU-Z screenshot.

 

But if it is text it would be easier to search and organize.

 

True, but people really won't be searching/filtering for all of those different things. Realistically, at most people want to search for laptop model, GPU (9600M, HD3670, etc), CPU, and OS. I doubt the majority of people will want to do a search for GPU multi or CPU logical cores. I feel like like the screenshots could adequately provide the information that is nice to know, but not worth searching a database for.

Don't get me wrong, it'd be great if all that info could be in a database/spreadsheet, but it'd be a ton of work for users to contribute and to maintain.

 

If the thread doesn't get stickied it will die. If it does, it's got a shot.

The most important things to me are (1) small number of benchmarks - otherwise the results get watered down. (2) relevant benchmarks - thanks for not having 3dmark06, it's about time it gets retired... gotta keep games up to date as well. and (3) easy uploading. This has improved since last I looked, and I think I'll post my vantage score now

 

3DMark06 benchmarks are still useful for people who are (god forbid ) still running XP.

EDIT: BIGX333, if you add Dell Inspiron 1520 to the laptop model list and nVidia 8600M GT to the GPU list, I could add some benchmarks.

You may also want to add wprime for CPU benchmarks.

Also, for the NBD front page, I recommend sorting the benchmarks by GPU or laptop model, not by type of benchmark. For instance, one would look for 280M benchmarks and fine Vantage, DMC, Crysis, etc benchmarks for it.

 

TBH i don't think that it's a good idea, while the idea of having help would be nice (especially due my lack of free time) publishing the code don't for sites because it potentially expose critical flaws (while i don't think that my system have one because I'm really paranoiac ).

The work isn't that big so... A CVS is a bit exaggerated.

- sorting order - The system already support, just need to be added to design.

- member account - Don't really understood what you was talking about.

- benchmark date - The system already support, just need to be added to design.

- system signature - Don't really understood what you was talking about.

- laptop manufacturer
- laptop brand/barebone

Using more than 1 name cause misleading and make harder to ppl filter the results, my idea is to add the barebone name and give some common reseller name examples in a ajax box.

- cpu manufacturer: Intel, AMD, etc
- cpu class: dual core, core 2 duo, core 2 quad, nehalem
- cpu physical cores (number)
- cpu logical cores (number)
- cpu filter: Q9100, Q9660, etc
- cpu speed (to differentiate between stock and overclock)

That's excess of information but i agree about manufacturer, class, model and clock.

- gpu manufacturer: ATI, Nvidia, Intel - Already implemented.

- gpu type: 8800M GTX, etc - Already implemented.

- gpu custom: stock or overclock - The request for clocks make the management easier and already do the job.

- gpu cores/shaders (number) - If one want this should look in nvidia/ati website.

- gpu speed: core, memory, shader - Already implemented.

- gpu drivers + link to download - Link for download is overkill and would create a problem for me if i do a list of every driver in the world with links or for the user... And you have to consider that files can be deleted from servers which may create broken links which is more headache.

- gpu bus width - I can do a page of information for every notebook with things like that but using it's as a filter is overkill.

- MXM form factor - I can do a page of information for every notebook with things like that but using it's as a filter is overkill.

- gpu multi (number) - Notebooks only have 2 GPU's in sli and i don't think that more will be implemented (and if it happens is a matter of change the field from tinyint (1) to int).

- gpu setup: Single, SLI, XF, Hybrid - If you have 2 geforces you are using SLI and if you have 2 radeons you have crossfire, plus the system accepts single card which already cover single gpu runs.

- LCD form factor
- LCD manufacturer
- LCD native resolution

I can do a page of information for every notebook with things like that but using it's as a filter is overkill (but for this one... i really don't think that have a place in a benchmark database).

- Architecture: Intel x64, Intel x86, etc - Intel/AMD page already exists.

- Operating System Name: Windows 7, Vista, XP, etc
- Operating System Type: 32-bit, 64-bit - Useful to include in benchmark details but not as a filter.

- monitor resolution: - What about concentrate in which resolutions the benchmark as run? .

- system tweaks: on/off - ?

- benchmark type: Vantage, Windows Experience Index, Crysis, COD4, etc - Already implemented.

- Api: DirectX 9, DirectX 10, etc. - I'm wondering how to implement this and still have a standard.

- benchmark tweaks: on/off - ?

- standard benchmark resolution (1024x768, 1280x1024, 1680x1050,
1920x1200)
- custom benchmark resolution: Horizontal and Vertical

- quality settings: low, medium, high, very high

- performance options: anti-aliasing (on/off), scaling (monitor/card manufacturer), vsync, etc.

I want to create a standard here and adding too much options destroy any chance of comparing benchmarks.

Theres will be 2 or 3 resolutions and no custom resolutions.

The quality/performance settings fall in the same problem of API... I don't know how to implement it and still have a standard (while I'm not going to include monitor, scaling, vsync or anything like this). I'm accepting suggestions

- benchmark result/value: Total: P9762 (Vantage), GPU Score, CPU score, SM 2.0, SM 3.0, etc - I will be adding special fields for gpu and cpu score but no 3dmark06 so no need for SM .

- benchmark images link: link to a forum thread where the snapshot is uploaded, link to Vantage/ORB score, etc. - This make the result depending of a forum/topic, if the topic gets deleted the result will have no screenshot, if the forum go down happens the same (and it's already being uploaded to my server anyway). The link is already implemented.

Those informations can work in a page with description for every laptop but not in every benchmark result, this is overkill.

And if i add it as filters the system will became way too complex to be useful.

1 - I totally agree.

2 - My idea is to move the old games to an "archive" and make drop the option of add benchmark for they (this make the site more clean and comprehensive).

3 - It still way too hard but I'm working on it for the next version.

People with XP may want to stick with the games benchmarks because 3dmark06 doesn't means much those days anyway.

I'm not going to add it now because you guys give me lots of ideas and I'm already working in a new version of the site (and as you can imagine adding more options now can make hard to migrate the results) but i promise that in the next version it will be there .

I'm gonna add superpi and wprime i think (in the next verson too).

I'm going to change it to no restrictions, you will be able to put any in every filter in the next version.

I want to thank all the feedbacks, bug reports and i have to say that i already have a concept for the new version and i think that you guys gonna like it .

 

SuperPi is outdated - it's only single-threaded. With every new processor (and many old processors) being multi-core and multi-threaded, SuperPi is pretty limited. wPrime is a better measure of a multi-core CPU's speed. I guess SuperPi is an ok indicator of game performance comparison, since many games aren't optimized for multi-cores (yet).

I also wanted to say thanks for doing all this Once you're done with your new version, I'll see to adding it to the gaming sticky. Also, once there are a decent amount of benchmarks, I'll reference it in a few other threads (Can my Notebook Run It, GPU Guide, etc).

 

heh he needs a donation spot on his site because he is doing serious work for people

 

I did some concepts:

Filters:
http://tehpwnerer.net/filters.html

Results:
http://tehpwnerer.net/tables.html

Of course it just an example of which information will be displayed , i did something simply because i want to keep it compatible with 1024 resolutions.

The list of benchmarks so far:

SuperPI 1MB
wPrime
3DMark vantage
Crysis
DMC4
?

I want to put superpi 1mb because it's useful to compare with old processors. I would like another synthetic benchmark which can provide an overview of the system performance (maybe pcmark?), suggestions are welcome (I'm more a overclocker than a benchmarker TBH ).

Games benchmark suggestions are welcome too .

And just to keep you guys updated... The new version EER:

http://tehpwnerer.net/nbd.png

 

PCMark Vantage is the only modern comprehensive benchmark I can think of... but the problem is that, like Vantage, it costs money, so some people might be left out. I for one still believe 3dMark06 is relevant, at least for now.

Another decent game benchmark that comes to mind is FEAR... I know it's an old game but it might be useful for comparing performance of older systems. If FEAR 2 has a benchmark (not sure if it does) then that's another option.

 

The member forum alias so that you could have some rankings.

Pretty much a condensed small text information of the system, much like the forum members´ signatures.

If some game config mods have been used, such as to lower the quality of the game: static shadows, etc in Crysis or distance viewing in GTA.

 

I don't think this is important or necessary - it just adds clutter and is likely to be just a repeat of other info.

It'd be easier to just say that the benchmarks have to be run WITHOUT any changes to the config files.

 

I agree wholeheartedly.

 

Hi , most of the time im a reader here at nbr forum ,but then i saw your topic , and i said "gotta register to compliment the job"
and really thought what a cool initiative ,btw from same country as me ,pehaps i could give a hand with something.

keep this ideia in mind man
hug a.k.a "Abraço"!

 

I agree that 3DMark06 isn't really worthwhile today, but IMO it would be great to see added. Most people still associate it as a required benchmark (even though most of us would disagree) among others. Just a thought.

 

Looking good BIGX! Just let me know when it's time for my part!

 

Well i just finished some wireframes and was going to send you

http://tehpwnerer.net/nbd_home_wire.png

http://tehpwnerer.net/nbd_add_benchmark_wire.png

In the home my idea is to show the extra filters on demand (i love js :x) and in the add benchmark the idea is use the right side to show some help balloons.

It's just to give you an idea of what information gonna be displayed in the pages, feel to create whatever you want .

BTW... My paint sk1llz are s00 l33t

 

dammn great job and idea you have there!! great work bigx333!

how much was it?

 

Thx jonkss

BTW... How much was what? lol

 

no problem
hosting the site

 

Hi BIG333,

Nice work here, well done.
I tried to register and when I follow the email link to register I get the homepage with "Hash not found" written at the top.

Any advice?

 

I'm not sure about what happened (hash not found is when the registration ticket was expired or already used) but i checked your account and it's already activated.

 

Hey labus,

http://tehpwnerer.net/big_01.jpg

Just some ideas

 

Ok mate thanks for the info.

Maybe I am using the wrong password. I registered at work then checked the email when I got home so maybe lost the plot in the meantime

Can you delete that account and I'll start again or reset password?

 

http://nbd.tehpwnerer.net/users/retrievePassword

Just let me know if you have any problem

 

delete my account too... same problem

 

@sgilmore62

Your account wasn't active, i activated it

 

Worked like a charm, thanks BIGX333

 

Nice idea. Only problem for me is that I have no reference point for any of the benchmarks. Unless you have one of the games you have listed, or Vista + a DX10 video card (and are willing to shell out for 3Dmark08 or remember the trial version's numbers), it's not as useful. I'd like to see 3Dmark06 added for that reason - it's free and almost anyone can run it. More games would also be good - the more games that are present, the more people can run them, and the more useful comparisons will be.

Another benefit of multiple games is that it makes it easier for people to see what is the best system for the particular game they are interested in. It's great to have the power-sucking Crysis, COD4, etc. present, but if someone's looking for Battlefield 2142 performance (for instance), they'd probably prefer benchmarks of Battlefield 2142.

 

Well, I think one of the main purposes is to compare laptops so that people know which they want to buy, and any they would want to buy right now have vista+dx10 GPU. It's all fine and dandy to supply benchmarks for Nvidia 7xxx series cards and ATI x1xxx cards, but it doesn't help anyone looking for a new laptop. By nature, most benchmarkers keep their systems more up to date than that anyway.

Also, if you put a lot of games up, the results will get watered down. Sure you'll be able to find 2 or 3 results for BF2142, but you won't be able to find consistent results for any one benchmark, because most people won't bother submitting more than 3 or 4. With only a few benchmarks, people all submit the same ones, and we get more accurate comparisons since there is a larger sample size.

 

Agreed, i would love to have low, med, high for every game in the world but it don't work.

No-one is going to run benchmark in 15 games in 3 different settings .

 

.... i would

 

No-one except the crazy cow (?)

 

Just wondering... Wprime 32 or 1024?, pifast yes/no ?

 

I was thinking about it last night...

3DMark06 doesn't means much in notebooks because actually Intel don't have any competition and basically theres only one platform around but when the i7's start to be produced 3DMark06 can be useful to compare with C2 systems so... I decided to include 3DMark06 .

BTW... Just a update, the back-end is done I'm just waiting labus design to start working in the UI .

 

Awesome! Hit me up on Yahoo! Messenger and we'll start working on it!

 

I'm going to use 1920x1080, 1680x050 and 1280x720.

It covers almost every notebook

 

SSD doesn't increase fps

 

Added Crysis benches (16.22 and 27.51 FPS, at 1080p and 720p). I'm still the only one with DMC4 benches, don't be shy, it's a damn fine bench!

 

I'm waiting on blablus and I'm having a BIG personal problem so it's pretty hard to give an eta

 

While i wait blablus design i had some free time...

http://tehpwnerer.net/layout_01.png

Yeah i know it sux... But I'm not a designer

 

hi, nice to find a Brazilian here, was researching the ATI 4870M and stopped by here, my M17x ecomendas arrived yesterday, I was sad to know that the left ati4870M for the m17x, wanted to screen, but technology is always very fast.Cool their part to mount the NBD