Test cases broken?

Christoph Thiel cthiel at suse.de
Mon Aug 18 09:52:26 PDT 2008


Hi there,

just enabled the testsuite in openSUSE's smart package and got the following
fall-out:


[tests/rpmdir.txt]
**********************************************************************
File "./tests/rpmdir.txt", line 45, in rpmdir.txt
Failed example:
    cache.getPackages()
Expected:
    [name1-version1-release1 at noarch, name2-version2-release2 at noarch]
Got:
    [name2-version2-release2 at noarch, name1-version1-release1 at noarch]
**********************************************************************
File "./tests/rpmdir.txt", line 55, in rpmdir.txt
Failed example:
    pkg.name
Expected:
    'name1'
Got:
    'name2'
**********************************************************************
File "./tests/rpmdir.txt", line 57, in rpmdir.txt
Failed example:
    pkg.version
Expected:
    'version1-release1 at noarch'
Got:
    'version2-release2 at noarch'
**********************************************************************
File "./tests/rpmdir.txt", line 60, in rpmdir.txt
Failed example:
    sorted(pkg.provides)
Expected:
    [name1 = version1-release1 at noarch, providename1 = provideversion1]
Got:
    [name2 = version2-release2 at noarch, providename2 = provideversion2]
**********************************************************************
File "./tests/rpmdir.txt", line 65, in rpmdir.txt
Failed example:
    sorted(pkg.requires)
Expected:
    [/bin/sh, prerequirename1 = prerequireversion1, requirename1 =
requireversion1]
Got:
    [/bin/sh, prerequirename1 = prerequireversion2, requirename2 =
requireversion2]
**********************************************************************
File "./tests/rpmdir.txt", line 70, in rpmdir.txt
Failed example:
    sorted(pkg.upgrades)
Expected:
    [name1 < version1-release1 at noarch, obsoletesname1 = obsoletesversion1]
Got:
    [name2 < version2-release2 at noarch, obsoletesname2 = obsoletesversion2]
**********************************************************************
File "./tests/rpmdir.txt", line 75, in rpmdir.txt
Failed example:
    sorted(pkg.conflicts)
Expected:
    [conflictsname1 = conflictsversion1, obsoletesname1 = obsoletesversion1]
Got:
    [conflictsname2 = conflictsversion2, obsoletesname2 = obsoletesversion2]
**********************************************************************
File "./tests/rpmdir.txt", line 87, in rpmdir.txt
Failed example:
    info.getGroup()
Expected:
    u'Group1'
Got:
    u'Group2'
**********************************************************************
File "./tests/rpmdir.txt", line 89, in rpmdir.txt
Failed example:
    info.getSummary()
Expected:
    u'Summary1'
Got:
    u'Summary2'
**********************************************************************
File "./tests/rpmdir.txt", line 91, in rpmdir.txt
Failed example:
    info.getDescription()
Expected:
    u'Description1'
Got:
    u'Description2'
**********************************************************************
File "./tests/rpmdir.txt", line 94, in rpmdir.txt
Failed example:
    info.getURLs()
Expected:
    ['file:///.../tests/data/rpm/name1-version1-release1.noarch.rpm']
Got:

['file:///usr/src/packages/BUILD/smart-1.0/tests/data/rpm/name2-version2-release2.noarch.rpm']
**********************************************************************
File "./tests/rpmdir.txt", line 99, in rpmdir.txt
Failed example:
    info.getSize(url)
Expected:
    2160L
Got:
    2160
**********************************************************************
1 items had failures:
  12 of  36 in rpmdir.txt
***Test Failed*** 12 failures.
(failures=12, tests=36)

[tests/yast2.txt]
(failures=0, tests=32)

[tests/load-hooks.txt]
(failures=0, tests=19)

[tests/urpmi.txt]
(failures=0, tests=33)

[tests/backend.txt]
(failures=0, tests=38)

[tests/debdir.txt]
**********************************************************************
File "./tests/debdir.txt", line 45, in debdir.txt
Failed example:
    cache.getPackages()
Expected:
    [name1_version1-release1, name2_version2-release2]
Got:
    [name2_version2-release2, name1_version1-release1]
**********************************************************************
File "./tests/debdir.txt", line 55, in debdir.txt
Failed example:
    pkg.name
Expected:
    'name1'
Got:
    'name2'
**********************************************************************
File "./tests/debdir.txt", line 57, in debdir.txt
Failed example:
    pkg.version
Expected:
    'version1-release1'
Got:
    'version2-release2'
**********************************************************************
File "./tests/debdir.txt", line 60, in debdir.txt
Failed example:
    sorted(pkg.provides)
Expected:
    [name1 = version1-release1, providesname1]
Got:
    [name2 = version2-release2, providesname2]
**********************************************************************
File "./tests/debdir.txt", line 65, in debdir.txt
Failed example:
    sorted(pkg.requires)
Expected:
    [prerequirename1 = prerequireversion1, requirename1 = requireversion1]
Got:
    [prerequirename2 = prerequireversion2, requirename2 = requireversion2]
**********************************************************************
File "./tests/debdir.txt", line 70, in debdir.txt
Failed example:
    sorted(pkg.upgrades)
Expected:
    [name1 < version1-release1]
Got:
    [name2 < version2-release2]
**********************************************************************
File "./tests/debdir.txt", line 76, in debdir.txt
Failed example:
    sorted(pkg.conflicts)
Expected:
    [conflictsname1 = conflictsversion1]
Got:
    [conflictsname2 = conflictsversion2]
**********************************************************************
File "./tests/debdir.txt", line 88, in debdir.txt
Failed example:
    info.getGroup()
Expected:
    u'Group1'
Got:
    u'Group2'
**********************************************************************
File "./tests/debdir.txt", line 90, in debdir.txt
Failed example:
    info.getSummary()
Expected:
    u'Summary1'
Got:
    u'Summary2'
**********************************************************************
File "./tests/debdir.txt", line 93, in debdir.txt
Failed example:
    info.getDescription()
Expected:
    u'Description1'
Got:
    u'Description2'
**********************************************************************
File "./tests/debdir.txt", line 96, in debdir.txt
Failed example:
    info.getURLs()
Expected:
    ['file:///.../tests/data/deb/name1_version1-release1_all.deb']
Got:

['file:///usr/src/packages/BUILD/smart-1.0/tests/data/deb/name2_version2-release2_all.deb']
**********************************************************************
File "./tests/debdir.txt", line 101, in debdir.txt
Failed example:
    info.getSize(url)
Expected:
    1038L
Got:
    1038
**********************************************************************
1 items had failures:
  12 of  36 in debdir.txt
***Test Failed*** 12 failures.
(failures=12, tests=36)

[tests/aptrpm.txt]
(failures=0, tests=36)

[tests/yast2comp.txt]
(failures=0, tests=32)

[tests/aptdeb.txt]
(failures=0, tests=36)

[tests/metadata.txt]
(failures=0, tests=37)

[tests/nothing.txt]
(failures=0, tests=3)

Total failures: 24
Total tests: 402
make: *** [test] Error 1


Can anyone confirm this? I guess the testcases are just wrong.


Best,
Christoph
-- 
Christoph Thiel, Tech. Project Management, Research & Development
SUSE LINUX Products GmbH, GF: Markus Rex, HRB 16746 (AG Nürnberg)



More information about the Smart mailing list